moinsen / Software historyDE ↗
← 1948

Event

Eine mathematische Theorie der Kommunikation

Context and research status
  • Kennung: 1948-shannon-information
  • Zeitraum: 1948
  • Datumsgenauigkeit: Jahr / year
  • Art: historische Entwicklung / historical development
  • Kategorien: Sprachen und Techniken, Ereignisse
  • Akteure und Rollen: Claude E. Shannon: Autor
  • Region: USA

In 1948 Claude Shannon published A Mathematical Theory of Communication in two parts. Among other things, he studied transmitting messages over communication channels. For a noisy-channel model he described how suitable coding can make the error rate very small under stated conditions. One later application of error correction was Voyager data in 1986. Original and context Source

Shannon limits his engineering question: for transmission he considers which message was selected from a set of possible messages; its meaning is not the measure used in this model. For noisy channels his result on arbitrarily small error frequency depends, among other conditions, on the information rate not exceeding channel capacity. This is a mathematical result under model assumptions, not a guarantee for every real connection. Original text and limitations

One example illustrates lossless coding: when four symbols have different frequencies, more frequent ones can receive shorter bit sequences. For his particular probability distribution Shannon obtains an average of 1.75 bits per symbol, compared with two for fixed-length codes. In his introduction he credits J. W. Tukey with suggesting the word “bit”. Original text

Sources

Offen

Weitere konkrete Verbindungen zu späteren Kodierungsverfahren gesondert anhand ihrer Entwicklungsgeschichte prüfen.