The Taylor series for this function is exactly zero to all orders in perturbation theory, but the function is non-zero if x ≠ 0.
The implication of this for Physics is that there are some phenomena which are impossible to understand by perturbation theory, however many orders of perturbation theory we use. Instantons are an example.
Therefore; in Theoretical Physics, a non-perturbative solution or theory is one that does not require perturbation theory to explicate, or does not simply describe the dynamics of perturbations around some fixed background. For this reason; non-perturbative solutions and theories yield insights into areas and subjects perturbative methods cannot reveal.