24
$\begingroup$

The characteristic function of a random variable X is given by $$\Phi_X(\omega) = \mathbb{E}e^{j\omega X}=\int_{-\infty}^\infty e^{j\omega x}f_X(x) dx.$$ One can easily capture the similarity between this integral and the Fourier transform.

For a standard normal random variable, the characteristic function can be found as follows: $$\Phi_X(\omega)= \int_{-\infty}^\infty \frac{1}{\sqrt{2\pi}}e^{-\frac{x^2}{2}}e^{j\omega x} dx = \int_{-\infty}^\infty \frac{1}{\sqrt{2\pi}}\exp\left(-\frac{(x^2-2j\omega x)}{2}\right)dx $$

I know that the answer must be $\Phi_X(\omega) = \exp(-\omega^2/2)$, but can you explain how to evaluate the integral with a complex number in the exponent?

  • 2
    You can take the derivative with respect to $\omega$, and integrate by parts to get a differential equation.2011-11-27
  • 0
    Is it a good way to use the fact that "If $f$ and $g$ are real functions then $\int (f + i g) = \int f + i \int g$" http://math.stackexchange.com/q/85941/1281 ?2011-11-27

1 Answers 1

35

I will give two answers:

Do it without complex numbers, notice that

$$ \begin{eqnarray} \mathcal{F}(\omega) = \int_{-\infty}^\infty \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{x^2}{2}} \mathrm{e}^{j \omega x} \mathrm{d} x &=& \int_{0}^\infty \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{x^2}{2}} \mathrm{e}^{j \omega x} \mathrm{d} x + \int_{-\infty}^0 \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{x^2}{2}} \mathrm{e}^{j \omega x} \mathrm{d} x \\ &=& \int_{0}^\infty \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{x^2}{2}} \mathrm{e}^{j \omega x} \mathrm{d} x + \int_{0}^{\infty} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{x^2}{2}} \mathrm{e}^{-j \omega x} \mathrm{d} x \\ &=& 2 \int_{0}^\infty \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{x^2}{2}} \cos(\omega x) \mathrm{d} x \end{eqnarray} $$ Now, compute $\mathcal{F}^\prime(\omega)$, and integrate by parts: $$\begin{eqnarray} \mathcal{F}^\prime(\omega) &=& -\frac{2}{\sqrt{2\pi}} \int_0^\infty \mathrm{e}^{-\frac{x^2}{2}} x \sin(\omega x) \mathrm{d} x = \frac{2}{\sqrt{2\pi}} \int_0^\infty \sin(\omega x) \mathrm{d} \left( \mathrm{e}^{-\frac{x^2}{2}} \right) \\ &=& \frac{2}{\sqrt{2\pi}} \left. \mathrm{e}^{-\frac{x^2}{2}} \sin(\omega x) \right|_0^\infty - \frac{2}{\sqrt{2\pi}} \int_0^\infty \mathrm{e}^{-\frac{x^2}{2}} \omega \cos(\omega x) \mathrm{d} x \\ &=& - \omega \mathcal{F}(\omega) \end{eqnarray} $$ The solution to so obtained ODE, $\mathcal{F}^\prime(\omega) = - \omega \mathcal{F}(\omega)$ is $\mathcal{F}(\omega) = c \exp\left( - \frac{\omega^2}{2} \right)$, and the integration constant is seen to be one from normalization requirement $\mathcal{F}(0)=1$ of the Gaussian probability density.

Complex integration: As you have started, complete the square: $$ \left( -\frac{x^2}{2} + j \omega x \right) = \left( -\frac{x^2}{2} + j \omega x + \frac{\omega^2}{2} \right) - \frac{\omega^2}{2} = -\frac{1}{2} \left( x - j \omega \right)^2 - \frac{\omega^2}{2} $$ We then have: $$ \mathcal{F}(\omega) = \mathrm{e}^{-\frac{\omega^2}{2}} \cdot \int_{-\infty}^\infty \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{1}{2} \left( x - j \omega \right)^2 } \mathrm{d} x $$ The integral $I = \int_{-\infty}^\infty \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{1}{2} \left( x - j \omega \right)^2 } \mathrm{d} x$ is indeed $1$. To see this, consider $$ \begin{eqnarray} I_L &=& \int_{-L}^L \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{1}{2} \left( x - j \omega \right)^2 } \mathrm{d} x = \int_{-L-j \omega}^{L-j \omega} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z \\ &=& \left(\int_{-L-j \omega}^{L-j \omega} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z - \int_{-L}^{L} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z\right) + \int_{-L}^{L} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z \\ &=& \left(\int_{-L-j \omega}^{L-j \omega} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z - \int_{-L}^{L} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z\right) + \mathcal{I}_L \end{eqnarray} $$ Here we denoted $\mathcal{I}_L = \int_{-L}^{L} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z$. Notice that $\lim\limits_{L \to \infty} \mathcal{I}_L = 1$.

Consider a complex contour $\mathcal{C}$, $ -L \to L \to L - j \omega \to -L - j \omega \to -L$: $$ \begin{eqnarray} I_L - \mathcal{I}_L &=&\left(\int_{-L-j \omega}^{L-j \omega} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z - \int_{-L}^{L} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z\right) \\ &=& -\int_\mathcal{C} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z - \int_{L}^{L-j \omega} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z - \int_{-L-j \omega}^{-L} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z \end{eqnarray} $$ The integral over $\mathcal{C}$ is zero, since the integrand is holomorphic. Therefore: $$ I-1 = \lim_{L \to \infty} (I_L-\mathcal{I}_L) = \lim_{L \to \infty} \left( - \int_{L}^{L-j \omega} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z - \int_{-L-j \omega}^{-L} \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{z^2}{2} } \mathrm{d} z \right) $$ And the limit above is easily seen to vanish. Indeed: $$ \lim_{L\to\infty} \left| \mathrm{e}^{-\frac{-(-L - j \omega t)^2}{2}} \right| = \lim_{L\to\infty} \left| \mathrm{e}^{-\frac{-(L^2 + \omega^2 t^2)}{2}} \right| =0. $$

  • 0
    +1. Thanks! Why instead of directly computing $\int_{0}^\infty \frac{1}{\sqrt{2\pi}} \mathrm{e}^{-\frac{x^2}{2}} \cos(\omega x) \mathrm{d} x $ (btw, I don't know how to directly integrate it), you solved it indirectly by constructing a ODE?2011-11-27
  • 0
    @Tim It seemed like the simplest approach. The only two other approaches I am aware of are 1) to write $\cos(\omega x)$ into Taylor series and integrate term-wise, 2) use Mellin-convolution theorem. Neither is simpler.2011-11-27
  • 0
    Sasha: the $+1$ term which appears at the third line in the computation of $I_L$ should read $1+o(1)$, I believe.2011-12-10
  • 0
    @DidierPiau Welcome back and thank you for the feedback. I have edited the post to make the equation precise.2011-12-10
  • 0
    how in the first method, is moving d/dw into the integral justified?2012-11-13
  • 0
    It is justified by the absolute continuity of the integrand in $\omega$ for all $x \in \mathbb{R}$.2012-11-13