1
$\begingroup$

I know that the maximum possible Shannon Entropy for an alphabet $X$ is $\log|X|$, where Shannon Entropy is:

$H(X) = - \sum_{x \in X} \; p(x) \log p(x)$

but how is this upper limit computed?

  • 0
    Good point, stupid fingers - will update the question to fix the $log|X|$ issue. I was trying to differentiate and set to zero, I think I see how this approach works, thank you2012-07-09

0 Answers 0