EE 6341: Information Theory

Fall 2006

Instructor Aria Nosratinia,
EC 4.208, Tel: 972-883-2894
Time Mon-Wed. 2-3:15pm
Place ECSN 2.126
Textbooks Cover and Thomas, Elements of Information Theory, John Wiley
Gallager, Information Theory and Reliable Communication, John Wiley
Grading Midterms (20%+20%), Class Project (40%), Homeworks (10%), class participation (10%)
Co-requisite EE6349 - Stochastic Processes
Office Hours Mon-Wed 10:30-11:30am

Course Notes (1) Probability Overview
(2) Information and Entropy
(3) Entropy Rates, AEP
(4) Data Compression
(5) Channel Capacity
(6) Differential Entropy
(7) Gaussian Channels
(8) Network Information Theory
(9) Rate-Distortion Theory

Information theory has been responsible for the key ideas behind cell phones, music CD's, portable music palyers like ipod, HDTV cable and sattelite television, as well as high-capacity hard disks on computers and laptops. The data compression, communication, and storage that is key to the operation of all these devices started from ideas developed in infomration theory.

This course is designed for the beginning graduate student in the areas of communications or signal processing. It will illuminate the underlying reasons for many of the topics learned in other courses, and prepare the student for high-quality research. The background needed for this course is limited to basic calculus and the ability to calculate simple probabilities.

The grading is based on homeworks, midterms, and a course project. For the course project, the students will choose, with the instructor's assistance, paper or papers to read, understand, and analyze, which they will eventually present to the entire class.

Contents:

Aria Nosratinia
Last modified: August 2006