top of page
TP42: Information Theory
1. What is information? How do we store information? Source coding theorem CT 5.1-5.5, 2.1, 2.3, 2.6: HW1, HW1sol
2. Huffman coding, entropy, CT 5.6, 2.2: HW2, HW2sol,
3. Entropy, mutual information, channel coding theorem, CT 2-2.7, 2.10, 7-7.5: HW3, HW3sol
4. DPI, Fano's inequality, proof of the converse of the channel coding theorem (2.8, 2.10, 7.9): HW4, HW4sol
5. Gambling (beautiful minds at play), Samuelson's paper, Thorp and Shannon (and Kelly)
bottom of page