(In the following I'm only talking about discrete space, variables etc.)
The definition of independence is such that when two events are dependent we don't exactly know, how the dependence is.
Let me specify this: Suppose we have two dependent random variables $X,Y$ on or space $\Omega$; that means, that there exists $A,B\subseteq\mathbb{R}$ such that the events $X^{-1}(A)\subseteq\Omega$ and $Y^{-1}(B)\subseteq\Omega$ are dependent. But how does this translate to what we can say about the distribution of, say, $Y$, if we know the distribution of $X$ ? What is the connection between their distributions ?
I'm asking this since here, right at the beginning, it says that "two random variables are independent if they convey no information about each other and, as a consequence, receiving information about one of the two does not change our assessment of the probability distribution of the other", so if the variables are dependent there would have to be a connection between their distributions.