The argument is mainly a counting argument involving just a little algebra on the functions themselves.
The functions $f(x)$ and $f^{-1}(x)$ intersect either at a finite number of points, or an infinite number of points.
If the number of intersections is infinite, it is neither odd nor even.
So we only need to consider a finite number of intersections.
If $(p,q)$ is one of the intersection points, that means
$q = f(p) = f^{-1}(p).$
But from $q=f(p)$ we can deduce that $f^{-1}(q) = p,$
and from $q = f^{-1}(p)$ we can deduce that $f(q) = p,$
therefore $p = f(q) = f^{-1}(q),$ that is,
and the two functions also intersect at $(q,p).$
So consider the set of intersection points that are above the line $y=x.$
Suppose there are $n$ of these points, where $n \geq 0.$
For each point $(p,q)$ above the line $y=x$
(that is, where $q>p$), there is a corresponding point $(q,p)$ below the line $y=x,$ and vice versa.
Hence there are $n$ points below the line $y=x.$
Let the number of intersection points on the line $y=x$ be $m.$
Then the total number of intersection points is $n$ above the line, $n$ below the line, and $m$ on the line (where $m\geq 0$), for a total of
$$
2n + m.
$$
Now, $m$ has the same parity as $2n+m.$
If the total number of intersections $2n+m$ is odd,
it follows that $m$ is odd.
But zero is not odd; all non-negative odd numbers are positive.
So the total number of intersections on the line $y=x$ in that case
is an odd positive number.
In particular, it is at least $1.$
In this proof, we never assume there are any intersection points above the line $y=x,$ nor that there are any below the line or on the line.
But we show that if there are an odd number of intersection points altogether, the number of intersection points on the line is positive.