It is well-known, at least amongst topos theorists, that the pseudofunctor $\textbf{Sh} : \textbf{Top} \to \mathfrak{BTop}$ factors through the category of locales $\textbf{Loc}$, and the pseudofunctor $\textbf{Sh} : \textbf{Loc} \to \mathfrak{BTop}$ is essentially full and faithful.
Indeed, first, suppose $\mathcal{E} = \textbf{Sh}(X)$, where $X$ is a topological space. Then, the frame of subobjects of the terminal object of $\mathcal{E}$ is exactly the frame of open subsets of $X$. On the other hand, it is clear from the definition that $\textbf{Sh}(X)$ only depends on the frame of open subsets of $X$ and not on the points, so two topological spaces which have isomorphic frames will have isomorphic toposes – and two spaces with equivalent toposes will have isomorphic frames.
Now, suppose $\mathcal{E}$ and $\mathcal{F}$ are localic toposes, meaning of the form $\textbf{Sh}(X)$ for some locale $X$. A geometric morphism $f : \mathcal{E} \to \mathcal{F}$ is completely determined by its inverse image part $f^* : \mathcal{F} \to \mathcal{E}$, which is by definition left exact and cocontinuous. But this means that $f^*$ restricts to a frame homomorphism from the frame of subterminals of $\mathcal{F}$ to the frame of subterminals of $\mathcal{E}$ – which is precisely the data of a locale morphism $\operatorname{Sub}_\mathcal{E} 1 \to \operatorname{Sub}_\mathcal{F} 1$ – and because a localic topos is generated by its subterminals, this completely determines $f$ as a geometric morphism.
Finally, since you say you are reading Hartshorne, I'll mention this: the underlying topological space of a scheme is a sober topological space, so two schemes are homeomorphic if and only if their frames of open sets are isomorphic. Moreover, given only the frame of open sets, one can recover the topological space by looking at frame homomorphisms $O \to \{ 0, 1 \}$.
What I said above is really about sheaves of sets. But I'm sure that something similar can be said about the sheaves of abelian groups, albeit with more effort: after all, one can apply the free group functor to the subterminals to obtain a family of abelian sheaves. The trouble is figuring out what is special about these sheaves... but here is one possibility: we take $\textbf{Ab}(\textbf{Sh}(X))$ as a symmetric monoidal closed category. The free group functor $\textbf{Sh}(X) \to \textbf{Ab}(\textbf{Sh}(X))$ is strong monoidal (if I'm not mistaken), preserves monomorphisms and is cocontinuous, so we expect to see the frame of open sets reflected in some way in $\textbf{Ab}(\textbf{Sh}(X))$. I believe it is precisely the frame of subobjects $A$ of the constant sheaf $\mathbb{Z}$ such that $A \otimes_\mathbb{Z} A \cong A$.