Information Theory

• The entropy of a message measures its uncertainty. The number of bits that must be learned when the message is hidden in ciphertext

• English is a highly redundant

• occurring frequently => ocrng frq