Learning Outcomes:
At the end of this module the students will have acquired a deep knowledge of the fundamental concepts of information theory and will be able to apply such concepts to advanced applications in multiuser communication networks, channel coding, and source coding. The students will be able to analyze simple information theoretic problems by computing the entropy of a discrete source, the rate-distortion function for a continuous source with a given fidelity criterion, and the channel capacity of memoryless discrete and continuous channels. Through the lecture and the exercises, the students will apply the learned fundamental concepts to advanced problems, with applications to source coding and channel coding in a multiuser/network scenario, and will be able to implement in software and verify by computer simulation state of the art algorithms in source coding and channel coding.
Credits: 6
Office: HFT 6
Display language: English
Responsible person: Caire, Giuseppe
Content
- Definition and main properties of entropy, cross-entropy (information divergence) and mutual information
- Fundamental Limits of data compression;
- Fundamental Limits of Data Transmission and Channel capacity;
- Fundamental limits of source compression (rate-distortion theory);
- Multiple Access Channel and Broadcast Channels as models for the uplink and downlink of wireless networks
- Coping with interference
- Relaying networks
- Project work
- Trainer/in: Giuseppe Caire
- Trainer/in: Tom Szollmann
- Trainer/in: Cagkan Yapar