As you probably know, this is an example of a Clifford algebra attached to the quadratic form which gives two orthogonal basis elements $c,x$ respective "norms" $1$ and $0$, and $c,x$ anti-commute, etc.
The standard trick to show that the dimension is as large as possible begins with the case of the Clifford algebra of a one-dimensional vector space with bilinear form, and in that case we know that $k[x]/(x^2-a)$ is two-dimensional, in any case, because we have simpler control in the commutative case.
It is perhaps over-kill for the two-dimensional vectorspace case, but the induction step in proving that a Clifford algebra on an $n$-dimensional v.s. $V$ has dimension $2^n$ (rather than accidentally smaller) is to express $V$ as an orthogonal sum $V_1\oplus V_2$ where $V_1$ is one-dimensional. There is the parity grading into odd and even elements, inherited from the universal associative (tensor) algebra, and for monomials define a twisted multiplication $(x\otimes y)\cdot (x'\otimes y') = xx'\otimes yy' \cdot (-1)^{\deg x'\cdot \deg y}$ on $Cl(V_1)\otimes CL(V_2)$. One checks directly that this gives the Clifford multiplication, and we know the dimension of a tensor product (whether or not the multiplication is defined with $-1$'s in it).
(So this is not as serious a result as Poincare-Birkhoff-Witt for universal enveloping algebras, but it's not completely trivial.)
Edit: Actually, knowing the above, one can pretend to have the epiphany that this algebra is inside the $4\times 4$ matrix algebra over the ground-field (it has some degeneracy) so prove the four-dimensionality by mapping this (universal) object surjectively to a four-dimensional subalgebra of the matrix algebra. But this is a bit of a prank... :)