9
$\begingroup$

It is well known that eigenvalues for real symmetric matrices are the same for matrices $A$ and its transpose $A^\dagger$.

This made me wonder: Can I say the same about the singular values of a rectangular matrix? So basically, are the eigenvalues of $B B^\dagger$ the same as those of $B^\dagger B$?

  • 0
    I know that $BB^T$ is not the transpose of $B^T B$. I was using the definition of the singular values of $B$ as the square-root of the eigenvalues of $B^T B$. Then, the singular values of $B^T$ should be $B B^T$, shouldn't they?2011-03-31
  • 0
    Oh, okay then. Sorry about that.2011-03-31

1 Answers 1

16

Both eigenvalues and singular values are invariant to matrix transpose no matter a matrix is square or rectangular.

The definition of eigenvalues of $A$ (must be square) is the $\lambda$ makes $$\det(\lambda I-A)=0$$ For $A^T$, $\det(\lambda I-A^T)=0$ is equivalent to $\det(\lambda I-A)=0$ since the determinant is invariant to matrix transpose. However, transpose does changes the eigenvectors.

It can also be demonstrated using Singular Value Decomposition. A matrix $A$ no matter square or rectangular can be decomposed as $$A=U\Sigma V^T$$ Its transpose can be decomposed as $A^T=V \Sigma^T U^T$. The transpose changes the singular vectors. But the singular values are persevered.

  • 0
    Thanks. I should have looked at the SVD from the beginning.2011-03-31
  • 2
    Maybe it's a bit pedantic, but since it confused me for a moment maybe it's worth to point it out: if you define the singular values of $A$ as the square roots of the eigenvalues of $A^TA$ - as the OP does in the comment - then this is not true in general. A could have zero as singular value and $A^T$ not (or viceversa)...you probably define here singular values as square roots of the NON-ZERO eigenvalues of $A^TA$.2012-08-20
  • 3
    You brought up a good point. I didn't notice this before. I also would like to add a point. The most exact definition is this: non-zero singular values of $A$ are the square roots of the non-zero eigenvalues of $A^TA$ or $AA^T$. Note the singular value can also be zero.2012-08-24
  • 0
    "since the determinant is invariant to matrix transpose" doesn't seem sufficient. That shows $A$ and $A^T$ would have the same determinant, but those are not the matrices we're taking the determinant of -- we're subtracting those from $\lambda I$. For that to apply you would have to demonstrate that $(\lambda I - A)^T = \lambda I - A^T$.2018-01-29
  • 0
    ... which I've now convinced myself must be true because the elements on the diagonal stay the same under transpose, and adding/subtracing $I$ can only affect those. Still this comment may help someone else understand ;)2018-01-29