3
$\begingroup$

Is SVD decomposition rotationally invariant?

If so can you provide the underlying intuition or a demonstration?

  • 1
    The SVD applies to an arbitrary matrix $A$ that maps one real vector space to another, say $A\colon \mathbb R^n \to \mathbb R^m$. What do you mean by rotational invariance in this case? @dineshdileep's answer deals with rotating only the target space $\mathbb R^m$, but you could also rotate just the source space $\mathbb R^n$, or both. The proof doesn't change very much, in any case.2012-10-30

1 Answers 1

5

svd is rotationally invariant in the sense that it won't change the singular values (but it does change the column space). Consider a matrix $A$ with its svd $A=U\Sigma V^{H}$. Consider a rotation matrix $R$. By virtue of it being a rotation matrix, $R$ is unitary. Now consider applying the rotation matrix $R$ on $A$, so that $B=RA=RU\Sigma V^{H}=(RU)\Sigma V^{H}$ is the svd of $B$. This is because product of unitary matrices is again unitary. So $B$ has the same singular values as $A$. Note that $B$ and $A$ will have same row space, same rank, and if $A$ is hermitian, same eigenvalues also.

  • 1
    No it won't, since its a left multiplication2012-10-30