3
$\begingroup$
  1. For functions $f,g,h$ that are defined over $\mathbb{R}$, suppose we have a convolution equation: $$ f = g * h. $$

    I would like to convert it into a differential equation. Is it correct that $$ \frac{df}{dt} = \frac{dg}{dt} * h $$ under some conditions (unclear to me yet, differential under integral sign?)?

    Why when the Laplace transform G of g is a rational function, the convolution is generally converted to a higher order differential equation, instead of first order one like above?

    Why when the Laplace transform G of g is not a rational function, the convolution is generally converted to a infinite order differential equation?

  2. Similarly, for functions $f,g,h$ that are defined over $\mathbb{Z}$, suppose we have a convolution equation: $$ f = g * h. $$

    I would like to convert it into a difference equation. Is it correct that $$ df = dg * h $$ where $$ df(n) := f(n+1) - f(n), $$ $$ dg(n) := g(n+1) - g(n) $$ under some conditions (unclear to me yet)?

    Why when the Z-transform G of g is a rational function, the convolution is generally converted to a higher order difference equation, instead of first order one like above?

    Why when the Z-transform G of g is not a rational function, the convolution is generally converted to a infinite order difference equation?

The above questions arose from my difficulty understanding a reply by leonbloy. Thanks and regards!

1 Answers 1

1

You wrote

Why when the Laplace transform $G$ of $g$ is a rational function, the convolution is generally converted to a higher order differential equation, instead of first order one like above?

The equation you wrote, namely,

$$f' = g' * h$$

is the convolution of the derivative of $g$ with $h$. Yes, there is a derivative involved, but there is the convolution integral, too. Not exactly a typical ODE, is it? It would be instructive to write the actual convolution integral, which is the following

$$\displaystyle f' (x) = \int_{\mathbb{R}} h (y) \, g' (x - y) \, dy$$

You want a 1st order ODE for all convolutions, which would be too good to be true. Note that:

  • If $g$ has "low descriptive complexity", i.e., if $g$ is the superposition of a "few" exponential functions of the form $e^{s x}$, where $s \in \mathbb{C}$, then the Laplace transform of $g$, which we denote by $G$, will be a rational function in which the degrees of the numerator and denominator will be "small". In other words, there will be "few" poles and zeros in $G$.

  • If $g$ has "high descriptive complexity", i.e., it the superposition of "many" exponential functions of the form $e^{s x}$, where $s \in \mathbb{C}$, then $G$ will have "many" poles and zeros.

The number of poles and zeros in $G$ is thus a measure of how hard it is to describe the signal $g$. It is a measure of the Kolmogorov complexity of the signal, so to speak. The poles and zeros in $G$ give you an ODE, which is a "blueprint" for you to build a system that can generate the signal $g$. For example, a sinusoid is of very low complexity, and a single sinusoidal signal generator can generate it. By contrast, a square wave is impossible to replicate exactly using a finite number of sinusoidal signal generators, but one can get close to the ideal square wave using "many" sinusoidal signal generators.

  • 0
    Thanks! Maybe it is not the first order ODE for $g$, but it is the first order ODE for output function $f$?2012-09-30
  • 0
    @Tim: You can always obtain a 1st order ODE, but it may not be a *scalar* one. What I am alluding to is that any $n$-th order scalar ODE can be written as a 1st order vector ODE in $x \in \mathbb{R}^n$. I know this is not the answer you had in mind. Since I am an engineer, I view poles as elements that store energy (like capacitors or springs). Obtaining a 1st order scalar ODE is equivalent to saying that the impulse response can be replicated by a physical system with one single energy-storage element. This is a very restrictive requirement.2012-09-30
  • 0
    Thanks! (1) In my previous comment, I meant that I thought differentiation of convolution as 1st order scalar ODE of output function $f$, while you thought it as ODE for input function $g$ not necessarily 1st order. Is it what you think? (2) Why is the number of poles and zeros in G is a measure of the Kolmogorov complexity of g? Is the Kolmogorov complexity of something defined as the length of the description of the thing with minimum length?2012-09-30
  • 0
    Added to (1), usually when using ODE(s) to describe a LTI system, is the ODE(s) for input or output signals?2012-09-30