You can even show more. Suppose $A$ is infinite. Then there exists $x \in X$ such that
$$\forall U \in \mathscr{V}_x: U \cap A \text{ is infinite}$$
Such an $x$ is called an accmulation point of the set $A$,and it's certainly an accumulation point in your sense as well (although your definition is usually called a limit point of $A$). (See the final paragraph as well)
In fact if you covered cardinalities (denoted by $||$) and know some set theory, you can also show the generally stronger statement that there exists $x \in X$ such that
$$\forall U \in \mathscr{V}_x: \left|U \cap A\right| = \left|A\right|$$
which is called a point of total accumulation. As $A$ is infinite this is at least as strong as the previous notion of accumulation point, but stronger for uncountable $A$, in general.
To prove this final statement: suppose no such $x$ exists, this means by logical negation of the definition:
$$\forall x\in X: \exists U_x \in \mathscr{V}_x: |A \cap U| < |A|$$
(As $A\cap U \subset A$, it's cardinaility is either smaller or equal to that o $A$, and being a non-"point of total accumulation" gives us at least one where it's smaller).
Then $\{U_x: x \in X\}$ is by definition an open cover of $X$ (each $x$ covered at least by its "own" $U_x$) so there is a finite subset $I \subseteq X$ such that $X = \cup\{U_x: x \in I\}$ by compactness.
But then $$|A| = A \cap X| = |A \cap (\cup\{U_x: x \in I\})| = |\cup\{U_x \cap A: x \in I\}| \le \sum_{i \in I} |A \cap U_i| < |A|$$
The last part uses that for infinite cardinalities, a finite sum is just the maximum, etc. This final contradiction shows us that at least one such $x$ must exist.
And this is certainly an accumulation point in your sense, because for any $V \in \mathscr{V}_x$, $(V \cap A) \setminus \{x\}$ is non-empty, even infinite, as we remove a single point from an intersection $A \cap U$ which has the same size as $A$, so is infinite. The basic trivial observation is that
$$(V\setminus \{x\})\cap A = V \cap (A \setminus \{x\} = (V \cap A) \setminus \{x\}$$
Possibly interesting final fact: $X$ is compact iff every infinite subset $A$ of $X$ has a point of complete accumulation. This is the way Aleksandrov and Urysohn proved Tikhonov's theorem, I believe.