Information Theory

Table of Contents

1. What Is Information?
2. Entropy of Discrete Variables
3. The Source Coding Theorem
4. The Noisy Channel Coding Theorem
5. Entropy of Continuous Variables
6. Mutual Information: Continuous
7. Channel Capacity: Continuous
8. Rate Distortion Theory
9. Transfer Entropy
10. Thermodynamic Entropy and Information
11. Information As Nature's Currency