Proof:
With $I = \int_a^b gf \, d\alpha$, apply the mean value theorem for integrals (since $f$ is continuous and $\alpha$ is non-decreasing) to a Riemann-Stieltjes sum. There exists $\eta_j \in (x_{j-1},x_j)$ for all $j$ such that
$$\beta(x_j) - \beta(x_{j-1}) = \int_{x_{j-1}}^{x_j} f \, d \alpha = f(\eta_j)(\alpha(x_j) - \alpha(x_{j-1})) ,$$
and
$$\left|\sum_{j=1}^n g(\xi_j)(\beta(x_j) - \beta(x_{j-1})) - I\right| \\ = \left|\sum_{j=1}^n g(\xi_j)f(\eta_j)(\alpha(x_j) - \alpha(x_{j-1}))- I \right|\\ \leqslant \left|\sum_{j=1}^n g(\xi_j)f(\xi_j)(\alpha(x_j) - \alpha(x_{j-1}))- I \right| + \left|\sum_{j=1}^n g(\xi_j)(f(\eta_j)-f(\xi_j))(\alpha(x_j) - \alpha(x_{j-1}))\right|. $$
For all sufficiently fine partitions the first term on the right-hand side is smaller than $\epsilon/2$ since $I = \int_a^b gf d\alpha$ exists.
The second term on the right-hand side is also smaller than $\epsilon/2$ with sufficiently fine partitions since $f$ is uniformly continuous on $[a,b]$, $g$ is bounded, and $\alpha$ is non-decreasing. We have $|g(x)| \leqslant M$ for $x \in [a,b]$ and $\delta > 0$ such that if $|x-y| < \delta$ then $|f(x) - f(y)| < \epsilon/(2M (\alpha(b) - \alpha(a)))$ for all $x,y \in [a,b]$. Hence, if the partition norm is less than $\delta$, then
$$\left|\sum_{j=1}^n g(\xi_j)(f(\eta_j)-f(\xi_j))(\alpha(x_j) - \alpha(x_{j-1}))\right| \leqslant \sum_{j=1}^n |g(\xi_j)||f(\eta_j)-f(\xi_j)||\alpha(x_j) - \alpha(x_{j-1})| \\ \leqslant M(\alpha(b) - \alpha(a))\frac{\epsilon}{2M(\alpha(b)-\alpha(a))} \\ = \frac{\epsilon}{2}.$$
Thus,
$$\int_a^b g d \beta = I = \int_a^b gf d \alpha.$$