2
$\begingroup$

I was wondering whether people can comment on the problem of finding the derivative of the singular values and the singular vector w.r.t. the entries of that matrix.

Any help is appreciated.

1 Answers 1

1

The singular values of $A$ are the square roots of the nonzero eigenvalues of $M = A^* A$. Let $P(t) = \det(M - t I)$ be the characteristic polynomial of $M$. If $\lambda$ is one of the eigenvalues and P'(\lambda) \ne 0, implicit differentiation gives \frac{\partial \lambda}{\partial m_{ij}} = - \frac{1}{P'(\lambda)} \text{adj}(M - \lambda I)_{ji}, where $\text{adj}(M - \lambda I)$ is the adjugate or classical adjoint of $M - \lambda I$. Now use the chain rule with $\frac{\partial m_{ii}}{\partial a_{ki}} = 2 a_{ki}$, $\frac{\partial m_{ij}}{\partial a_{ki}} = a_{kj}$ and $\frac{\partial m_{ij}}{\partial a_{kj}} = a_{ki}$ if $i \ne j$, $\frac{\partial m_{ij}}{\partial a_{kl}} = 0$ otherwise

  • 0
    What is $P^'(\lambda)$? $\frac{\mbox{d} P}{\mbox{d} \lambda}$?2011-06-18