You just need to understand which number $N\in\mathbb{N}$ ensures
$$ 2\sum_{n\geq N}\frac{1}{n!(2n+1)}\leq \frac{1}{10^3} $$
and since $\frac{1}{n!(2n+1)}\leq \frac{1}{n!}-\frac{1}{(n+1)!}$ it is enough to take $N=7$.
I will provide an alternative solution, just for fun. The recurrence relation fulfilled by the moments $a_n = \int_{0}^{1}x^n e^{-x^2}\,dx $ implies that our integral has a nice representation as a continued fraction:
$$ I = 2\int_{0}^{1}e^{-x^2}\,dx = \sqrt{\pi}\,\text{Erf}(1)=\sqrt{\pi}-\frac{1}{e}\cdot\cfrac{1}{1+\cfrac{1/2}{1+\cfrac{1}{1+\cfrac{3/2}{1+\cfrac{2}{1+\ldots}}}}}\tag{1}$$
Unfortunately, it is slowly convergent, so we switch to a Beuker-like approach.
On the interval $(0,1)$, the function $f(x)=x^4(1-x)^4 e^{-x^2}$ is positive and bounded by $\frac{1}{300}$.
Since
$$ \int_{0}^{1} f(x)\,dx = -16+\frac{93}{16 e}+\frac{297}{32} I \tag{2}$$
it follows that $\frac{32}{297}\left(16-\frac{93}{16e}\right)=\color{green}{1.493}51\ldots$ is an accurate approximation of $I$, with the correct green digits. If we replace the polynomial $x^4(1-x)^4$ with the shifted Legendre polynomial $P_4(2x-1)$, we get the even better and simpler approximation:
$$ I \approx \frac{10}{197}\left(32-\frac{7}{e}\right)=\color{green}{1.49364}6899\ldots\tag{3}$$