There are two ways of writing these groups, although both of them will be ambiguous (since without any further indication it owuld be unclear which one is referring to).
The first one, as suggested by Arnaud D., is writing it as a semidirect product of cyclic groups. Recall that given groups $G$ and $H$ and a group homomorphism $\varphi:H\rightarrow G$, the semidirect product of $G$ and $H$ with respect to $\varphi$ is the group $G\rtimes_{\varphi}H$ whose underlying set is $G\times H$ and its product is given by
$$(g_0,h_0)(g_1,h_1)=(g_0\varphi(h_0)(g_1),h_0h_1)\text{.}$$
Note that this generalizes the direct product in the sense that those are just the semidirect product where $\varphi$ is the trivial map (which sends every element to the identity). In this way, in sloppy notation, both of your groups would be $(C_p \times C_p) \rtimes C_2$. Note that $\rtimes$ is $\times$ together with $\triangleleft$, used to say that something is a normal subgroup, so that's why the order is reversed.
The second one I have seen is that of (sub)holomorph groups. Given a group $G$ and a subgroup $N$ of its automorphism group $\mathrm{Aut}(G)$, the $N$-holomorph group of $G$ is the group
$$\mathrm{Hol}(G,N):=G\rtimes_{\iota} N$$
where $\iota$ is the inclusion map. This is less general and less common, as the holomorph group of $G$ refers usually to $\mathrm{Hol}(G):=\mathrm{Hol}(G,\mathrm{Aut}\,G)$. Using sloppy notation, your groups would be written as $\mathrm{Hol}(C_p\times C_p,C_2)$.