suppose $X_1,X_2,\ldots,X_n$ have joint distribution. if $X_1\sim\mathcal{N}(0,1)$ and for $j=0,1,\ldots,n-1$ conditional distribution $X_{j+1}|X_1=x_1,\ldots,X_j=x_j\sim\mathcal{N}(\rho x_j,1)$, then find $MLE$ parameter $\rho$.
MLE of parameter in distribution of gaussian time series
-
0Apparently not. – 2017-05-08
2 Answers
This looks like a homework problem, so I will give you hints in a series of steps for you to carry out.
Write the joint distribution function using the formula $f(X_1, \dots, X_n) = f(X_1)f(X_2|X_1)f(X_3|X_1,X_2) \cdots f(X_n|X_1,\dots,X_{n-1})$.
Use the information provided to write this expression explicitly in terms of gaussian density functions.
Take the natural log of the result of step 2 and write the log of the product as a sum of logs.
Differentiate the result of step 3 with respect to $\rho$.
Set the result of step 4 equal to zero and solve for $\rho$.
Your answer should be an expression involving $x_i x_{i+1}$ terms and $x_i^2$ terms.
Assume the distribution of $X_1$ is $\mathcal N(0,1)$ and the conditional distribution of $X_2$ conditionally on $X_1=x$ is $\mathcal N(\varrho x,1)$. Then the distribution of $X_2$ is $\mathcal N(0,1+\varrho^2)$.
Hence, the hypotheses of the post are never met (except if $n=1$ or $\varrho=0$).