Hint $\rm\ mod\ p\!:\: -1 \equiv (p-1)! = (p-1)(p-2)(p-3)(p-4)! \equiv (-1)(-2)(-3)(p-4)!$
But for $\rm\:p \ne 2,3,\: \ \ 2\cdot 3 = 6\:$ will be invertible mod $\rm\:p,\:$ so $\rm\:(p-4)! \equiv 1/6\pmod p$
Furthermore: $\rm\ \ p = 6\:k\pm 1\:\Rightarrow\:(p-4)! \equiv 1/6 \equiv (1\mp p)/6$
Note $\:$ The signed-equation denotes two equations: the top sign case, and bottom sign case. $\begin{eqnarray}\rm\:p = 6\:\!k{\color{red}{+1}}\: &\Rightarrow& \rm\:(p-4)!\equiv 1/6\equiv (1+{\color{red}{(-1)}} p)/6&\rm\quad top\ signs \\ \rm\:p = 6\:\!k{\color{red}{-1}}\: &\Rightarrow &\rm\:(p-4)!\equiv 1/6\equiv (1+{\color{red}{(+1)}} p)/6&\rm\quad bottom\ signs \end{eqnarray}$ Indeed, we seek $\rm\:x\:$ so $\rm\:6\:|\:1+x\:\!p,\:$ or $\rm\:mod\ 6\!:\: -1\equiv x\:\!p \equiv x\!\:s,\:$ where $\rm\:\color{red}s = (p\ mod\ 6).\:$ Therefore $\rm\:x \equiv -1/s.\:$ Here $\rm\:s\equiv \pm1\:\Rightarrow\:s^2 = 1\:\Rightarrow\: -1/s = -s/s^2 = -s.\:$ Therefore $\rm\:p = 6\:\!k+{\color{red}{s}}\: \Rightarrow\: (p-4)!\equiv 1/6\equiv (1+{\color{red}{(-s)}}\:\! p)/6\quad abstract\ sign$ Hence the equation that I wrote above involving the signs $\pm$ and $\mp,$ denotes two equations, the case $\rm\:s = 1\:$ of above (choose all the top signs) and case $\rm\:s = -1\:$ (choose all the bottom signs). Indeed, if we substitute $\rm\: s = \pm 1\:$ then $\rm -s = \mp 1,\:$ so we obtain said equation with signs.
Such expressions can be given a rigorous algebraic interpretation by working in certain quotient rings,$\:\!$ i.e. modulo $\rm\:s^2 = 1.\:$ Namely $\rm\:R[s]/(s^2-1) \cong R[s]/(s-1) + R[s]/(s+1)\cong R^2.\:$ Hence arithmetic in $\rm\:R\:$ with adjoined sign $\rm\:s\:$ is isomorphic to arithmetic of pairs of elements of $\rm\:R,\:$ where the first component denotes the universe where $\rm\:s = 1\:$ and the second where $\rm\:s = -1.\:$
Beware, however, that sometimes such signed expressions denote the set of equations resulting from all possible combinations of signs. In this case one adjoins multiple sign indeterminates $\rm\:s_i\:$ such that $\rm\:s_i^2 = 1.\:$ One often needs to infer from the context which denotation is intended.