The answer really depends entirely on what you mean by "the sum $\sum_{n=-\infty}^{n=\infty}x$".
The standard definition for the sum of an infinite series given in most books only holds when the sum is done from $n=0$ to $n=\infty$. (A "one-tailed" series). However, your series is two-tailed and the definition doesn't apply.
So you need to extend your definition first, and that alone will dictate what your answer is.
That being said, a common situation where two-tailed series comes up is in Laurant series (compare with Taylor series). In this case, a Laurant series will have an annulus of convergence (compare to the radius of convergence). Inside the annulus of convergence, the natural way to define the sum is the naive way: add up partial sums starting at $0$ and going out, interleaving positive and negative values of $n$. The sum will converge to a finite value and rearrangement is immaterial.