Information Theory ELEG630 (Spring of 2007)


Instructor:

Dr. Xiang-Gen Xia

Office:

311 Evans Hall

Email/Phone:

xxia@ee.udel.edu, (302)831-8038

Time:

Tu. Th. 3:40pm-4:55pm

Place:

Sharp Lab, Room 107

Office Hours:

Tu: 5:00-6:00pm

Grading Policy:

  1. Homeworks: 20%
  2. Midterm: 30%
  3. Final: 50%

Textbook:

R. W. Yeung, A First Course in Information Theory, Springer, New York, 2002

References:

  1. T. M. Cover and J. A. Thomas, Elements of Information Theory, Wiley, New York, 1991.
  2. R. G. Gallager, Information Theory and Reliable Communication, Wiley, New York, 1968.


Course Contents:

  1. Information measures

  2. Lossless Data Compression

  3. Weak and Strong Typicalities

  4. I-measure

  5. Markov structures

  6. Channel capacity and channel coding theorem

  7. Rate-distortion theory

  8. Blahut-Arimoto algorithm