Course: Information Theory and Coding

» List of faculties » PRF » KMI
Course title Information Theory and Coding
Course code KMI/TINF
Organizational form of instruction Lecture + Exercise
Level of course Master
Year of study not specified
Semester Winter
Number of ECTS credits 4
Language of instruction Czech, English
Status of course Compulsory, Compulsory-optional
Form of instruction Face-to-face
Work placements This is not an internship
Recommended optional programme components None
Course availability The course is available to visiting students
Lecturer(s)
  • Konečný Jan, doc. RNDr. Ph.D.
  • Bělohlávek Radim, prof. RNDr. Ph.D., DSc.
  • Foltasová Eliška, Mgr.
Course content
The course provides introduction to information theory and its applications, and coding. " Entropy, conditional and joint entropy, mutual information. " Basic inequalities of information theory. " AEP (asymptotic equipartition property) and its applications. " Selected applications of information theory. " Basic concepts of coding. " Optimal codes. " Error correcting codes (basic concepts, block codes, linear codes).

Learning activities and teaching methods
Lecture, Demonstration
Learning outcomes
The students become familiar with basic concepts of information theory and coding.
2. Comprehension: Classify basic types of error-correcting codes.
Prerequisites
unspecified

Assessment methods and criteria
Oral exam, Written exam

Active participation in class. Completion of assigned homeworks. Passing the oral (or written) exam.
Recommended literature
  • Adámek J. (1991). Foundations of Coding. Wiley-Interscience.
  • Adámek J. (1989). Kódování. SNTL Praha.
  • Ash R. (1965). Information Theory. Dover, New York.
  • Cover T. M. (2006). Elements of Information Theory. J. Wiley.
  • West, R. L., Turner, L. H. (2017). Introducing Communication Theory. McGraw-Hill.
  • Yeung, R. W. (2002). A First Course in Information Theory. Springer, New York, USA.


Study plans that include the course
Faculty Study plan (Version) Category of Branch/Specialization Recommended year of study Recommended semester
Faculty: Faculty of Science Study plan (Version): Bioinformatics (2021) Category: Informatics courses 2 Recommended year of study:2, Recommended semester: Winter
Faculty: Faculty of Science Study plan (Version): Applied Computer Science - Specialization in Software Development (2024) Category: Informatics courses 1 Recommended year of study:1, Recommended semester: Winter
Faculty: Faculty of Science Study plan (Version): Teaching Training in Computer Science for Secondary Schools (2019) Category: Pedagogy, teacher training and social care 1 Recommended year of study:1, Recommended semester: Winter
Faculty: Faculty of Science Study plan (Version): Computer Science - Specialization in Artificial Intelligence (2020) Category: Informatics courses 1 Recommended year of study:1, Recommended semester: Winter
Faculty: Faculty of Science Study plan (Version): Applied Computer Science - Specialization in Computer Systems and Technologies (2024) Category: Informatics courses 1 Recommended year of study:1, Recommended semester: Winter
Faculty: Faculty of Science Study plan (Version): Computer Science - Specialization in General Computer Science (2020) Category: Informatics courses 1 Recommended year of study:1, Recommended semester: Winter