I think i got the case where $c=1$ covered:
For some number $u$ we have $x=y+u$, where $\epsilon \leq |u| \leq max(|a-y|,|b-y|)$.
We then have
\begin{align*} f(x,y,|x−y|^c)−&0.5f(x,y−ϵ,|x−y+ϵ|^c)−0.5f(x,y+ϵ,|x−y−ϵ|^c)\\
&=
f(y+u,y,|u|^c)−0.5f(y+u,y−ϵ,|u+ϵ|^c)−0.5f(y+u,y+ϵ,|u−ϵ|^c)\\
\end{align*}
and it follows from Taylor-Expansions that:
\begin{align*}
f(y+u,y,|u|^c)&−0.5f(y+u,y−ϵ,|u+ϵ|^c)−0.5f(y+u,y+ϵ,|u−ϵ|^c)\\
&= f(y+u,y,|u|^c)\\
&-0.5(f(y+u,y,|u|^c)-\epsilon f_2(y+u,y,|u|^c)+(|u+\epsilon|^c-|u|^c)f_3(y+u,y,|u|^c) + R_1)\\
&-0.5(f(y+u,y,|u|^c)+\epsilon f_2(y+u,y,|u|^c) +(|u-\epsilon|^c-|u|^c)f_3(y+u,y,|u|^c) + R_2)\\
&= -0.5f_3(y+u,y,|u|^c)(|u+\epsilon|^c-|u|^c +|u-\epsilon|^c-|u|^c) - 0.5(R_1 + R_2)
\end{align*}
Now, for the case $c=1$ we have for $|u|\geq \epsilon$: $|u+\epsilon|^c-|u|^c +|u-\epsilon|^c-|u|^c=
|u+\epsilon|-|u| +|u-\epsilon|-|u|=0$
and hence
$$|-0.5f_3(y+u,y,|u|^c)(|u+\epsilon|^c-|u|^c +|u-\epsilon|^c-|u|^c) - 0.5(R_1 + R_2)| = 0.5 |(R_1+R_2)| \leq 0.5 (|R_1| +|R_2|).
$$
But for some $\tilde{M}<\infty$ we have by the triangle inequality $$|R_1| \leq \tilde{M}(|\epsilon|^2 + ||u+\epsilon|-|u||^2) \leq \tilde{M}2 \epsilon^2,$$
while $$
|R_2| \leq \tilde{M}(|\epsilon|^2 + ||u-\epsilon|-|u||^2) \leq \tilde{M}2 \epsilon^2$$
and hence there exists a constant $M<\infty$ such that
$$0.5 (|R_1| +|R_2|) \leq M\epsilon^2$$ which proves the statement for the case $c=1$.
However I am still having a hard time showing the assertion for the case $c\neq 1$ and any help is greatly appreciated.