First page
Back
Continue
Last page
Graphics
Information Theory
Amount of information
in a message is formally measured by the
entropy
of the message
Entropy
is a function of the probability distribution over the set of all possible messages