A First Course in Information Theory (Information Technology: Transmission, Processing and Storage) Book

Incepted half a century ago, information theory is a classical yet modern field which is more vibrant than ever before. In particular, there have been a number of major research results on the foundation of the theory during the last ten years. These results enable information theory to be understood and explored in a way which has not been possible before, and they open new dimensions in the theory. In short, the depth of information theory is far beyond what we used to know. This book is an integration of the most fundamental topics in information theory plus a few selected advanced topics. All concepts and technicalities are explained with clarity. Except for a few classical results, all the results included here are not found elsewhere in book form. These include the theory of I-Measure, Shannon-type and non-Shannon-type information inequalities, and network coding theory. Some important implications of information theory in probability theory and group theory are also explained in this book. ITIP, the software package that comes with the book, is the only software package of its kind which can prove all Shannon-type information inequalities. It is an essential tool for all information theorists. This book is suitable for use as a textbook, or as a reference book with any other textbook in a course on information theory. It is also an essential reference for researchers working in areas related to this subject matter.Read More