I am reading the following proof of second derivative test for higher dimension, but get stuck with one key step.
In the following, $H(x)$ stands for the Hessian matrix of $f:\Bbb R^n \to \Bbb R$ at $x$ with continuous second-order mixed derivatives near and at $x$. It looks like an easy piece that "when $v$ is small enough" then the inequality follows, but I cannot figure out how this is true following the author's reasoning.
Note in the proof, $t$ is a fixed value in $(0,1)$ from the Lagrange remainder, but we can let $\bf v$ go to $\bf 0$. So ${\bf H}({\bf x}+t{\bf v})$ is actually a function of $\bf v$. Also every element of ${\bf H}({\bf x}+t{\bf v})$ goes to the corresponding element of $\bf H(x)$ as $\bf v \to 0$ since the second order derivatives of $f$ are assumed to be continuous.
PS: I did some investigation and find that the eigenvalues of ${\bf H}({\bf x}+t{\bf v})$ should be continuous with respect to $\bf v$ and goes to the eigenvalues of $\bf H(x)$, but this requires a lot of external knowledge to prove this theorem first, and it looks to me that the following proof does not use this.
where 7.19 is derived from Taylor's formula.

