33
$\begingroup$

Given $f(x) = \frac{1}{2}x^TAx + b^Tx + \alpha $

where A is an nxn symmetric matrix, b is an n-dimensional vector, and alpha a scalar. Show that

$\bigtriangledown _{x}f(x) = Ax + b$

and

$H = \bigtriangledown ^{2}_{x}f(x) = A$

Is this simply a matter of taking a derivative with respect to X, how would you attack this one?

  • 0
    The first equation you wrote with a superscript 2. I don't see how the terms reduce in this problem.2010-09-20

2 Answers 2

31

$\nabla f = (\partial f/\partial x_1, \ldots, \partial f/\partial x_n)^t$ denotes the vector of partial derivatives of $f$ and is a completely standard notation.

On the other hand, $\nabla^2 f$ seems to be used here in an unusual way, namely to denote the Hessian (the matrix of all second order partial derivatives), $(\partial^2 f/\partial x_i \partial x_j)_{i,j=1}^n$.

(The usual meaning of $\nabla^2 f$ is the Laplacian, $\partial^2 f/\partial x_1^2 + \ldots + \partial^2 f/\partial x_n^2$.)

  • 2
    Better notation, in my opinion: $\nabla ^{2}\cdot\overrightarrow{F}$, since here the operator $\nabla$ "is" a vector, while in $\nabla^2 f$ "is" a scalar.2010-09-20
8

$\bigtriangledown f$ finds the direction of maximal change in f.

  • 1
    While this answer is true, it is not tremendously helpful, to someone who is asking such a basic question.2016-10-17