Ÿ  Information Quantity: Entropy, Joint Entropy, Conditional Entropy, Mutual Information, Differential Entropy

Ÿ  Data Compression: Kraft Inequality, Optimal Codes and Bounds on Code Length, Huffman Codes, Lossy Quantization, Rate Distortion Function

Channel Capacity: Channel, Symmetric Channels, Channel Capacity, Channel Coding Theorem