In the proof of the Fourier inversion formula for $\mathcal S(\mathbb R^n)$ functions, it is observed that in the integral $$\int_{\mathbb R^n} \widehat f(\xi)e^{i\xi\cdot x}\,\mathrm d\xi = \int_{\mathbb R^n}\int_{\mathbb R^n} f(y) e^{-iy\cdot\xi} e^{i\xi\cdot x}\,\mathrm dy\mathrm d\xi$$ one cannot change the order of integration, because then the inner integral might diverge. I'm probably missing something simple, but how is that so?
The inner integral is bounded by $$\int_{\mathbb R^n} |f(y)|\,\mathrm dy$$ which should be convergent, since Schwartz functions decay faster than any negative power of $x$. Then my doubt is whether it's the outer integral that wouldn't converge after the change. Can someone shed some light here?