3
$\begingroup$

Could anyone suggest any good (perhaps online ref papers) reference material on numerical analysis focusing on determining accuracy/estimated errors, rates/orders of convergence especially when applied to ODEs? Thank you very much.

  • 1
    [Both](http://books.google.com/books?id=F93u7VcSRyYC) [of](http://books.google.com/books?id=m7c8nNLPwaIC) the books by Hairer and Wanner should be a good start.2011-08-21
  • 0
    I think this should be converted to community wiki.2011-08-21
  • 1
    I like [this book](http://books.google.com/books?id=YHXU4W3Ez2MC&printsec=frontcover&dq=numerical+methods&hl=en&ei=sIZRTo_cCM6N4gS6sNXEBw&sa=X&oi=book_result&ct=result&resnum=4&ved=0CDcQ6AEwAzge#v=onepage&q&f=false). It has two chapters on ODEs.2011-08-21
  • 0
    I would insert "with practical advice" in between "chapters" and "on" in @joriki's comment.2011-08-21
  • 1
    @Dimitri: I disagree. As far as I know there aren't that many people here who could provide sound advice on numerical analysis, so I think it would be better to leave the question non-CW even if it might not have an objective correct answer. Reputation might serve as a little incitement to contribute a good answer.2011-08-22
  • 0
    @Theo, oh I'm sorry, I was just under the impression that these kind of questions should be converted to community wiki. However, you do provide a very reason why it shouldn't be converted.2011-08-22
  • 0
    @Dimitri: This is really just *my* opinion. I think many would disagree with that, but there is no consensus on CW questions that I'm aware of. Two meta discussions: http://meta.math.stackexchange.com/questions/2790/ and http://meta.math.stackexchange.com/questions/1700/2011-08-22
  • 0
    Thanks for the suggestions!2011-08-22

3 Answers 3

4

Modern ODE solvers do (or are supposed to) perform error monitoring and control in the course of evaluating a differential equation system given to it; what is done under the hood depends on which algorithm is being used. Here, I'll talk about nonstiff solvers (stiff solvers use similar ideas, but with some complications to account for the methods being more involved).

For Runge-Kutta solvers, it is now customary to use embedded (a.k.a. Fehlberg-type) Runge-Kutta formulae; briefly, an embedded RK method is any method that allows for the construction of at least two RK formulae of different orders of convergence from the same set of function evaluations; the difference between the results of the different estimates can then be taken to be the error of the approximation. These two technical reports be Fehlberg explain the idea, but Dormand and Prince and Bogacki and Shampine are two of the versions of embedded RK with better error control than Fehlberg's original methods.

For extrapolative (Bulirsch-Stoer) methods, you have in fact a sequence of estimates that (hopefully!) tend to the correct solution; Deuflhard's article demonstrates a practical way to estimate the error of a solution from an extrapolative scheme.

For multistep/multivalue methods, the situation is even more complicated, and highly depends on the particular implementation. I personally don't have much experience with tweaking a multistep code, so I can't say anything more.

Those are only for local estimates of the error; for global estimates, the situation is slightly more complicated. See this for instance.


You can probably tell after a casual glance of the papers I linked to above that this is a complicated business, and it is. So: read the Hairer/Wanner books I linked to in the comments for a start, and then have a look at these papers after.

3

I have two preferred references: Atkinson's Introduction to Numerical Analysis and the excellent Numerical Recipes (freely available online - the section on ODE starts on page 899). I first learned from Atkinson, so I recall it very warmly. But it does, perhaps, leave much to be discovered in the exercises. Numerical Recipes is free, and does not.

In the comments, Numerical Methods that Work was mentioned, and I think this is a great book, too.

1

Look through www.geometrictools.com in the numerical methods documentation, and under physics samples.