Lecturer(s)
|
-
Foltasová Eliška, Mgr.
-
Konečný Jan, doc. RNDr. Ph.D.
-
Bělohlávek Radim, prof. RNDr. Ph.D., DSc.
|
Course content
|
The course provides introduction to information theory and its applications, and coding. " Entropy, conditional and joint entropy, mutual information. " Basic inequalities of information theory. " AEP (asymptotic equipartition property) and its applications. " Selected applications of information theory. " Basic concepts of coding. " Optimal codes. " Error correcting codes (basic concepts, block codes, linear codes).
|
Learning activities and teaching methods
|
Lecture, Demonstration
|
Learning outcomes
|
The students become familiar with basic concepts of information theory and coding.
2. Comprehension: Classify basic types of error-correcting codes.
|
Prerequisites
|
unspecified
|
Assessment methods and criteria
|
Oral exam, Written exam
Active participation in class. Completion of assigned homeworks. Passing the oral (or written) exam.
|
Recommended literature
|
-
Adámek J. (1991). Foundations of Coding. Wiley-Interscience.
-
Adámek J. (1989). Kódování. SNTL Praha.
-
Ash R. (1965). Information Theory. Dover, New York.
-
Cover T. M. (2006). Elements of Information Theory. J. Wiley.
-
West, R. L., Turner, L. H. (2017). Introducing Communication Theory. McGraw-Hill.
-
Yeung, R. W. (2002). A First Course in Information Theory. Springer, New York, USA.
|