0
$\begingroup$

background: I'm working on a problem that uses the implicit function theorem to show the existence of a solution. I have a continuously differentiable function $f(x,y)=0$ with nonzero Jacobian at a point $(a,b)$. A direct corollary of the implicit function theorem asserts that for sufficiently small changes in $a$, say $a+\delta$ there is a $b+\epsilon$ such that $f(a+\delta,b+\epsilon)=0$.

Question: How do one find such a new solution in a concrete problem?

Example: Let's look at a simple function like $f(x,y)=x^2+y^2-1=0$. $(\frac{\sqrt{2}}{2},\frac{\sqrt{2}}{2})$ is a solution, and the Jacobian of $f$ is nonzero at this point. How do you find a solution of the form $(\frac{\sqrt{2}}{2}+0.1,y)$?

Note: I know that the above example can be solved directly, but I want to make use of a method (something like Newton's method maybe) for higher dimensional problems, where $x=(x_1,\ldots,x_m)$, and $y=(y_1,\ldots,y_n)$

  • 1
    For a numerical answer, I would use Newton's method. (Not that it matters, but many proofs of the IFT and Newton method convergence are very similar.) You need to have a scheme to deal with approaches to points where the Jacobian becomes singular. The IFT gives the derivative of the solution at a solution, so this can be used to compute an initial guess for the perturbed solution.2012-09-10

2 Answers 2

1

In your example, the IFT guarantees the existence of a $C^1$ function $y$ defined in the neighborhood of $\frac{1}{\sqrt{2}}$ such that $f(x,y(x)) = 0$. Furthermore, $\frac{\partial y(\frac{1}{\sqrt{2}})}{\partial x} = -(\frac{\partial f(\frac{1}{\sqrt{2}}, \frac{1}{\sqrt{2}}))}{\partial y})^{-1} \frac{\partial f(\frac{1}{\sqrt{2}}, \frac{1}{\sqrt{2}}))}{\partial x} = -1$.

To solve $f(\frac{1}{\sqrt{2}}+0.1, y) = 0$, use Newton's method starting from the initial estimate $y_0 = y(\frac{1}{\sqrt{2}}+0.1) \approx y(\frac{1}{\sqrt{2}})+\frac{\partial y(\frac{1}{\sqrt{2}})}{\partial x} 0.1 = \frac{1}{\sqrt{2}}-0.1$.

This converges quickly (quadratically, of course):

y_1 = 0.590635214224 y_2 = 0.59040553564 y_3 = 0.590405490966 y_4 = 0.590405490966 

Here is the Python script that produced the above...

from math import *  # initial values... x = 1/sqrt(2.0)+0.1 y = 1/sqrt(2.0)-0.1  # update y using Newton's method... for k in range(1, 5):     y = y - (pow(x, 2.0)+pow(y, 2.0)-1)/(2.0*y)     print "y_%s = %s" % (k, y,) 
  • 0
    I see. I had a big misconception here. For some reason my intuition was telling me that I have to find the tangents to the curve each time, but as soon as I fix the $x$, I have a lower dimensional curve, which these new tangents are to that new curve, not the circle. I drew the points given by the above script and it all made sense. Thanks for clearing this issue for me.2012-09-11
1

The IFT tells you that you can solve for $y$ as a function of $x$ in a neighborhood of $a$ in such a way that $y(a)=b$. To approximate $y(a+\delta)$ you can use the Taylor expansion of $y$ around $x=a$. For this you need to know the derivatives of $y$ with respect to $x$ at $x=a$, which can be computed by implicit differentiation.

In your example you want $ y\Bigl(\frac{\sqrt2}{2}+0.1\Bigr)\approx y\Bigl(\frac{\sqrt2}{2}\Bigr)+\frac{dy}{dx}\Bigl(\frac{\sqrt2}{2}\Bigr)\times0.1=\frac{\sqrt2}{2}+\frac{dy}{dx}\Bigl(\frac{\sqrt2}{2}\Bigr)\times0.1 $ To compute the derivative we differentiate the equation $f(x,y)=0$: $ 2\,x+2\,y\frac{dy}{dx}=0\implies\frac{dy}{dx}=-\frac{x}{y}\implies\frac{dy}{dx}\Bigl(\frac{\sqrt2}{2}\Bigr)=-1. $

  • 0
    Here is what I don't understand, while using the Newton's method, after the first iteration what shall I use as the initial point in the second iteration? http://i.stack.imgur.com/6lNHE.jpg2012-09-10