I got confused with a seemingly simple problem.
Consider a system of linear ODEs $\dot{x}=Ax+bu$, $u(\cdot)\in R$, $x(0)=0$. I want to solve this system for an exponential input $u=e^{st}$, $s\in R$.
The solution is given by $x(t)=\int^t_0 e^{A(t-\tau)}be^{s\tau}d\tau$. I solve this integral using integration by parts to get $x(t)=(sI-A)^{-1}(I e^{st}-e^{At})b$.
It appears that the solution becomes singular when $s$ is an eigenvalue of $A$. How can it be?