No (for the original question, with equality to zero): $\exists n, \sum_{k=n+1}^\infty \frac{1}{(2k-1)^2} = 0$.
You are summing non-negative terms. Having the sum equal to $0$ would imply every single term is zero. But every term is positive.
With more symbols (but the same argument): assume by contradiction such a $n\geq 1$ exists. Then
$$
0 = \frac{1}{(2n-1^2} + \sum_{k=n+1}^\infty \underbrace{\frac{1}{(2k-1^2}}_{\geq 0}
\geq \frac{1}{(2n-1^2} > 0
$$
leading to a contradiction.
No, for the new question with the quantifiers: $\exists n, \forall \varepsilon > 0,\ \sum_{k=n+1}^\infty \frac{1}{(2k-1)^2} < \varepsilon$.
Indeed, this is then the same question as before, as this implies equality to $0$ (just take the limits on both sides as $\varepsilon \to 0$).
Yes, for the different question inverting the quantifiers: $\forall \varepsilon > 0, \exists n,\ \sum_{k=n+1}^\infty \frac{1}{(2k-1)^2} < \varepsilon$.
Your series converges, so the remainder tends to zero by definition. That is, as in addition the terms of the series are all non-negative,
$$
0 \leq \sum_{k=n}^\infty \frac{1}{(2k-1)^2} \xrightarrow[n\to\infty]{} 0
$$
which will give you what you want (by recalling the definition of a limit).