can someone give me some pointers on deriving p(alpha|rest) on page 4 of http://www.stat.cmu.edu/~brian/724/week06/lec15-mcmc2.pdf (pdf warning)? I'm having trouble separating it out from beta. This isn't homework, but it seems substantially similar, so I'll mark it as such.
deriving a bayesian statistics equation
-
3Post the question here because future readers will understand nothing if the PDF is removed. – 2011-06-24
1 Answers
You have an expression $p(y,\theta,\alpha,\beta)= \prod_{i=1}^{N} {n_i \choose y_i} \theta_i^{y_i} (1-\theta_i)^{n_i-y_i} \prod_{i=1}^{N} \frac{\Gamma(\alpha+\beta)}{\Gamma(\alpha)\Gamma(\beta)}\theta_i^{\alpha} (1-\theta_i)^{\beta} p(\alpha,\beta).$
The proportionate expression for $p(\alpha | y,\theta,\beta)$ treats $y$, $\theta$ and $\beta$ as known constants, and so removes any multiplicative term which does not depend on $\alpha$, including all of the lefthand product and part of the righthand product to give $p(\alpha | y,\theta,\beta) \propto \prod_{i=1}^{N} \frac{\Gamma(\alpha+\beta)}{\Gamma(\alpha)}\theta_i^{\alpha} p(\alpha,\beta).$ The next stage is to notice for example that $\prod_{i=1}^N k = k^N$ and similarly for the terms in the product not depending on $i$. That gives the stated result of $p(\alpha | y,\theta,\beta) \propto \left[\frac{\Gamma(\alpha+\beta)}{\Gamma(\alpha)}\right]^N \prod_{i=1}^{N} \theta_i^{\alpha} p(\alpha,\beta).$ [This "key observation" also applies to the conditional expressions for $\theta_i$ and $\beta$.]
If you want to turn the proportionate expression into an exact expression, you then need to divide by the integral over $\alpha$ of the proportionate expression.