TP42: Information Theory

1. What is information? How do we store information? Source coding theorem CT 5.1-5.5, 2.1, 2.3, 2.6: HW1, HW1sol

2. Huffman coding, entropy, CT 5.6, 2.2: HW2, HW2sol

3. Entropy, mutual information, channel coding theorem, CT 2-2.7, 2.10, 7-7.5:  HW3, HW3sol   

4. DPI, Fano's inequality, proof of the converse of the channel coding theorem (2.8, 2.10, 7.9): HW4, HW4sol

5. Gambling (beautiful minds at play), Samuelson's paperThorp and Shannon (and Kelly)