finish 2 projects during the course (50% of the grade) prepare a poster presentation for the joint poster session during
the course (25% of the grade) write a "term paper" at the end of the course
(25% of the grade)This course belongs to the "Three concepts" series, and provides an introduction to information theory for computer science students. In fact much of the course can be viewed as consequences of Shannon's central result known as the Noiseless Source Coding Theorem. The theoretical results will be illustrated by various descriptions of practical data compression systems from Huffman coding to Rissanen's arithmetic coding. In order to demonstrate the wide applicability of information-theoretic concepts in intelligent systems, we discuss information-theoretic principles to (statistical) modeling, i.e., the Minimum Description Length (MDL) principle.
Anyone interested in such topics as data compression, learning, data mining or artificial intelligence. This course is intended to give you new ideas, approaches or tools for your problems. The course is aimed at senior undergraduates and graduate students and is required for students pursuing in M.Sc. or Ph.D. in the field of Adaptive and Intelligent Systems.
Note that the maximum number of participants is about 20. You can registrate by following the instructions found here.
The course is an introductory course, and no prior knowledge on information theory is required. Different parts of the course, have different requirements with respect to the mathematical machinery needed to apply the concepts in question. Elementary calculus (integrals, derivatives, convergence, ...) and probability theory (joint and conditional distributions, expectations, law of large numbers, ...) are needed. The course projects involve programming, thus programming skills are necessary.
The course does not have regular weekly assignments, but beware - this does not mean that there is no work involved! In addition to participating to the classes, the students are expected to
finish 2 projects during the course (50% of the grade)
prepare a poster presentation for the joint poster session during
the course (25% of the grade)
write a "term paper" at the end of the course
(25% of the grade)
Much of the project work is performed in groups (size of these groups depends on the number of participants). Participation to the classes is not enforced, but strongly encouraged, as many of the preliminaries for the projects will be discussed during the classes.
During the first three classes of the course anybody can drop out by just sending email to the instructor. After this introductory period the project work starts, poster topics will be assigned etc. and the students are expected to be committed to the course. Also at this point the vacant slots will be filled from the pool of students on the waiting list.
 |
|
|
|
|
|
| Three Concepts: Information | |