EE 6743 - Information Theory

Introduction to information theory. Overview of field, entropy as a measure of uncertainty. Relative entropy, mutual information. Characteristics of sequences and entropy rate. Lossless data compression and source coding. Bounds and relations for channel capacity, differential entropy, the Gaussian channel. Rate distortion theory, and selected topics of current interest.

Requisites
EE 5713
Credit Hours: 3.0
Repeat/Retake Information: May not be retaken.

Lecture/Lab Hours: 3.0 lecture

Eligible grades: A-F,WP,WF,FN,FS,AU,I