This should really be a comment as opposed to an answer - see the end for why - but it's far too long for that. Hopefully it is not too disappointing!
This is a great question - but, of course, it's difficult to make things precise here. (In particular: what would be a convincing argument that there is no such proof?) I want to say a bit about a weaker, but related and perfectly precise, question; besides being interesting in its own right (in my opinion), I think it gives a good example of how we can go about making questions like this rigorous, and some of the difficulties we run into in trying to do so.
Specifically, here's the version of the question I want to consider; I'll then try to justify why I'm asking the question in this way, below.
Is there a model of open induction satisfying "There are infinitely many primes" but not satisfying "Every number $>1$ has a prime divisor"?
Here, a "model of open induction" is equivalently (i) the positive elements of an integer part of a real closed field, or (ii) an ordered semiring satisfying induction for quantifier-free ("open") formulas. Basically, the natural numbers $(\mathbb{N}; +, \times, <)$ satisfy the extremely strong axiom system of (first-order) Peano arithmetic (PA); but when we're interested in what is necessary to prove what, we can "stratify" PA into smaller subtheories, and look at what these subtheories prove or don't prove - the latter being studied by looking for weird models. (Like, for instance, a positive answer to the highlighted question above.) This general process is part of Reverse Mathematics.
Now, why did I focus specifically on open induction? Well, PA breaks into two pieces: the ordered semiring axioms, $P^-$, and the induction axioms: for each formula $\varphi(x,\overline{y})$, we have the axiom $I_\varphi$ stating that induction holds for $\varphi$: $$\forall\overline{a}[(\varphi(0,\overline{a})\mbox{ and }\forall n(\varphi(n, \overline{a})\implies\varphi(n+1,\overline{a})))\implies\forall x\varphi(x,\overline{a})].$$ Taking the basic algebraic structure provided by $P^-$ for granted, the natural place to start pruning is the induction axioms. That is, we look at systems of the form $$I\Gamma=P^-\cup\{I_\varphi: \varphi\in\Gamma\},$$ for $\Gamma$ a natural class of formulas - usually a layer in the arithmetical hierarchy, in fact most often $\Sigma_1$.
. . . Except that $I\Sigma_1$ already proves both statements we're interested in! So it's too strong to tell the difference. So we need to go weaker.
A natural candidate is $I\Delta_0$ - induction is restricted to formulas with only bounded quantifiers. It is currently open whether $I\Delta_0$ proves the infinitude of primes; however, it does very easily prove that every number $>1$ has a prime factor! So it's still too strong to address the question.
Open induction is, to my knowledge, the next "natural" theory weaker than $I\Delta_0$. There are certainly things in between, but - to the best of my knowledge - they are fairly technical, whereas open induction both has a nice characterization in terms of what formulas it proves induction for, and a nice algebraic characterization of its models. In particular, even if we later decide that it's the wrong base theory for your specific question, the highlighted question above is still of general interest.
See this paper by Macintyre and Marker for some examples of weird things you can do with models of open induction.
Having just plugged Reverse Mathematics, let me cover my bases: how is this approach inadequate? Let me point out something that the reverse math-style approach will not detect. Let's say I have a proof of the infinitude of primes which uses all the pieces necessary to get a proof of "Every number $>1$ has a prime factor," but "rearranged" so that we never actually use that statement itself. From a reverse math point of view - paying attention only to the axiomatic overhead - this still counts as a proof using "Every number $>1$ has a prime factor"! Even though you might very reasonably accept it as a proof which does not.
My point is that - as in any case - there are limitations to how this formal approach can faithfully capture your intuitive question. That said, I hope you find this interesting.
So what's the answer?
This is the really awkward bit.
I recall having seen a construction of a model of open induction with infinitely many primes, but not satisfying weak FTA. However, looking through my notes, I can't find the argument, or a source, so I'm no longer sure. However, my memory is that such a structure can be constructed using the same kinds of techniques as in the Macintyre/Marker paper.
So that's why this shouldn't be an answer - it's addressing an ultraweak version of your question, and it's not even answering that version! But hopefully you found some of the preceding stuff interesting, and I hope that someone more knowledgeable in fragments of arithmetic can set me straight re: these models of open induction.