Information Theory and Coding

After the lectures students are familar with the basic concepts of information theory. By understanding quantities such as entropy, joint entropy or mutual information, they can evaluate the theoretical limits for data compression and data transmission for simple but particularly important cases. They are also able to apply concrete schemes for source and channel coding in practice. By knowing the theoretical limits, they can assess the efficiency of these methods. With regard to channel coding, the students are familiar with both common block coding and convolutional coding schemes and can use these error correction schemes after the Exercises in Matlab. The students are also familiar with the principles of Turbo codes and LDPC codes.