Claude Shannon

• Concept of entropy - equivalent to a shortage in the information content in a message
• Second law of thermodynamics – entropy is the degree of randomness in any system
• Many sentences can be significantly shortened without losing their meaning
• Shannon proved that in a noisy conversation, signal could always be send without distortion