An "equality by definition" is a directed mental operation, so it is nonsymmetric to begin with. It's only natural to express such an equality by a nonsymmetric symbol such as $:=\, .\ $ Seeing a formula like $e=\lim_{n\to\infty}\left(1+{1\over n}\right)^n$ for the first time a naive reader would look for an $e$ on the foregoing pages in the hope that it would then become immediately clear why such a formula should be true.
On the other hand, symbols like $=$, $\equiv$, $\sim$ and the like stand for symmetric relations between predeclared mathematical objects or variables. The symbol $\equiv$ is used , e.g., in elementary number theory for a "weakened" equality (equality modulo some given $m$), and in analysis for a "universally valid" equality: An "identity" like $\cos^2 x+\sin^2 x\equiv1$ is not meant to define a solution set (like $x^2-5x+6=0$); instead, it is expressing the idea of "equal for all $x$ under discussion".