Coding And Information Theory

The logarithmic connection between entropy and probability was first enun- ciated by L.E. Boltzmann (1844-1906) in his kinetic theory of gases. His famous formula for entropy S is S = k log W (as engraved on his tombstone in Vienna) where k is a constant and W is the number of possible microstates corresponding to the macroscopic state of a system of particles in agas.

This book contains a thorough discussion of the classical topics in information theory together with the first comprehensive treatment of network coding, a subject first emerged under information theory in the mid 1990's that has now diffused into coding theory, computer networks, wireless communications, complexity theory, cryptography, graph theory, etc.