Information Theory

This book deals with information processing; so it is far from being a book on information theory (which would be built on description and estimation). The reader will be shown the horse, but not the saddle. At any rate, at the very beginning, there was a series of lectures on “Information theory, through the looking-glass of an algebraist”, and, as years went on, a steady process of teaching and learning made the material evolve into the present form. There still remains an algebraic main theme: algorithms intertwining polynomial algebra and matrix algebra, in the shelter of signal theory…

Reliability Criteria in Information Theory and Statistical Hypothesis Testing is devoted to one of the central problems of Information Theory; the problem of determination of interdependence of coding rate and of error probability exponent for different information transmission systems. The overview deals with memoryless systems of finite alphabet setting.