Theory of Information and Coding

Textbook

Slides, Pt. 1 – Theory of Information

Slides, Pt. 2 – Introduction to Coding Theory
Slides, Pt. 3 – Error Control Codes

Screencasts:

Pt. 1

Memoryless Source of Information
Source of Information with Memory (Markov Source)
Information Channel
Binary Symmetric Channel, Channel Capacity
Pt. 2
Information Codes, Huffman coding
Fixed length binary codes
Block Codes, Hamming distance
Linear Codes Pt 1, properties and Generator matrix
Linear Codes Pt 2, Parity check matrix
Pt. 3
Simple error control codes
Hamming codes Pt 1, regular code
Hamming codes Pt 2, shortened code
Hamming codes Pt 3, extended code
Cyclic codes Pt 1, properties, generator polynomial
Cyclic codes Pt 2, encoding and decoding
Reed-Miller codes