✨ New Arrivals Just Dropped!Explore
Mathematical Foundations of Information Theory
HomeStore

Mathematical Foundations of Information Theory

Mathematical Foundations of Information Theory

$3.83

Original: $10.95

-65%
Mathematical Foundations of Information Theory

$10.95

$3.83

The Story

The first comprehensive introduction to information theory, this book places the work begun by Shannon and continued by McMillan, Feinstein, and Khinchin on a rigorous mathematical basis. For the first time, mathematicians, statisticians, physicists, cyberneticists, and communications engineers are offered a lucid, comprehensive introduction to this rapidly growing field.
In his first paper, Dr. Khinchin develops the concept of entropy in probability theory as a measure of uncertainty of a finite “scheme,” and discusses a simple application to coding theory. The second paper investigates the restrictions previously placed on the study of sources, channels, and codes and attempts “to give a complete, detailed proof of both … Shannon theorems, assuming any ergodic source and any stationary channel with a finite memory.”
Partial Contents: I. The Entropy Concept in Probability Theory — Entropy of Finite Schemes. The Uniqueness Theorem. Entropy of Markov chains. Application to Coding Theory. II. On the Fundamental Theorems of Information Theory — Two generalizations of Shannon’s inequality. Three inequalities of Feinstein. Concept of a source. Stationarity. Entropy. Ergodic sources. The E property. The martingale concept. Noise. Anticipation and memory. Connection of the channel to the source. Feinstein’s Fundamental Lemma. Coding. The first Shannon theorem. The second Shannon theorem.

Reprint of the first English translation, 1957.

Description

The first comprehensive introduction to information theory, this book places the work begun by Shannon and continued by McMillan, Feinstein, and Khinchin on a rigorous mathematical basis. For the first time, mathematicians, statisticians, physicists, cyberneticists, and communications engineers are offered a lucid, comprehensive introduction to this rapidly growing field.
In his first paper, Dr. Khinchin develops the concept of entropy in probability theory as a measure of uncertainty of a finite “scheme,” and discusses a simple application to coding theory. The second paper investigates the restrictions previously placed on the study of sources, channels, and codes and attempts “to give a complete, detailed proof of both … Shannon theorems, assuming any ergodic source and any stationary channel with a finite memory.”
Partial Contents: I. The Entropy Concept in Probability Theory — Entropy of Finite Schemes. The Uniqueness Theorem. Entropy of Markov chains. Application to Coding Theory. II. On the Fundamental Theorems of Information Theory — Two generalizations of Shannon’s inequality. Three inequalities of Feinstein. Concept of a source. Stationarity. Entropy. Ergodic sources. The E property. The martingale concept. Noise. Anticipation and memory. Connection of the channel to the source. Feinstein’s Fundamental Lemma. Coding. The first Shannon theorem. The second Shannon theorem.

Reprint of the first English translation, 1957.

You may also like

-65%NEW
Thumbnail 1

1300 Real and Fanciful Animals

$15.95

$5.58

NEW
Thumbnail 1

100 Great American Short Stories

$14.00

-65%NEW
Thumbnail 1

1001 Palabras Inglesas Mas Utiles para Hispanoparlantes

$1.99

$0.70

-65%NEW
Thumbnail 1

1001 Easy French Phrases

$4.95

$1.73

NEW
Thumbnail 1

"Easter 1916" and Other Poems

$3.00

NEW
Thumbnail 1

101 Great American Poems

$3.00

NEW
Thumbnail 1

103 Great Poems

$12.95

NEW
Thumbnail 1

1001 Most Useful Spanish Words

$2.25

-65%NEW
Thumbnail 1

1000 Poems from the Manyoshu

$19.95

$6.98

NEW
Thumbnail 1

100 Favorite English and Irish Poems

$3.00

NEW
Thumbnail 1

100 Best-Loved Poems

$3.00

-65%NEW
Thumbnail 1

"To His Coy Mistress" and Other Poems

$3.00

$1.05