Feb 05, 2025  
OHIO University Graduate Catalog 2021-22 
    
Catalog Navigation
  Catalog Home
  Vision, Mission, & History
  Diversity and Inclusion Commitment
  Application and Admission
  Academic Policies and Procedures
  Degree and Certificate Requirements
  Fees & Ohio Residency
  Graduate Funding and Financial Assistance
  Services and Resources
  General Information
  Academic Units
  Programs of Study by Academic Unit
  Programs
  Course Information
  Courses
  Faculty
  Graduate College Information
  Notice of Non-Discrimination and Title IX Coordinator Information
  Copyright and Disclaimer
  My Portfolio
HELP
OHIO University Graduate Catalog 2021-22 [Archived Catalog]

Facebook this Page (opens a new window)
Tweet this Page (opens a new window)
Add to Portfolio (opens a new window)

EE 6743 - Information Theory

Introduction to information theory. Overview of field, entropy as a measure of uncertainty. Relative entropy, mutual information. Characteristics of sequences and entropy rate. Lossless data compression and source coding. Bounds and relations for channel capacity, differential entropy, the Gaussian channel. Rate distortion theory, and selected topics of current interest.

Requisites: EE 5713
Credit Hours: 3
Repeat/Retake Information: May not be retaken.
Lecture/Lab Hours: 3.0 lecture
Grades: Eligible Grades: A-F,WP,WF,WN,FN,AU,I
Learning Outcomes:
  • Students will be able to solve for and describe channel capacity for the Gaussian channel.
  • Students will be able to solve for and describe entropy.
  • Students will be able to solve for and describe mutual information.
  • Students will be able to solve for differential entropy for continuous sources.
  • Students will be able to evaluate lossless compression codes.
  • Students will be able to evaluate lossy compression codes with a distortion measure.


Facebook this Page (opens a new window)
Tweet this Page (opens a new window)
Add to Portfolio (opens a new window)