| |
Jan 17, 2025
|
|
|
|
|
EE 6743 - Information Theory
Introduction to information theory. Overview of field, entropy as a measure of uncertainty. Relative entropy, mutual information. Characteristics of sequences and entropy rate. Lossless data compression and source coding. Bounds and relations for channel capacity, differential entropy, the Gaussian channel. Rate distortion theory, and selected topics of current interest.
Requisites: EE 5713
Credit Hours: 3
Repeat/Retake Information: May not be retaken.
Lecture/Lab Hours: 3.0 lecture
Grades: Eligible Grades: A-F,WP,WF,WN,FN,AU,I
Learning Outcomes:
- Ability to compute and describe channel capacity for the Gaussian channel.
- Ability to compute and describe entropy.
- Ability to compute and describe mutual information.
- Ability to compute differential entropy for continuous sources.
- Ability to evaluate lossless compression codes.
- Ability to evaluate loss compression codes with a distortion measure.
Add to Portfolio (opens a new window)
|
|
