Machine Learning II – Advanced Learning and Inference

Machine Learning II - Advanced Learning and Inference - SS23

Instructor: J. Lücke
Exercises: H. Mousavi, D. Velychko, F. Panagiotou and Till Kahlke
Language: English
Time and place:

Tuesday: 10:15 - 11:45 (Exercise Ü1, W03 1-154), and 14:15 - 15:45 (Exercise Ü2, W01 0-011)
Thursday: 10:15 - 11:45, W32 1-113 (Lectures)

Further Reading

  • Pattern Recognition and Machine Learning, C. M. Bishop, ISBN: 978-0-387-31073-2, Springer, 2006.
  • Machine Learning: A Probabilistic Perspective, K. P. Murphy, MIT Press, 2012.
  • Theoretical Neuroscience – Computational and Mathematical Modeling of Neural Systems, P. Dayan and L. F. Abbott, ISBN: 0-262-04199-5, MIT Press, 2001.
  • Information Theory, Inference, and Learning Algorithms, D. MacKay, ISBN-10: 0521642981, Cambridge University Press, 2003. (online available)
  • Computational Cognitive Neuroscience, RC O’Reilly and Y Munakata, ISBN-10: 0262650541, MIT Press, 2000.
  • The Matrix Cookbook, K. Petersen, M. Pederson (free online)


This course builds up on the basic models and methods introduced in introductory Machine Learning lectures. Advanced Machine Learning models will be introduced alongside methods for efficient parameter optimization. Analytical approximations for computationally intractable models will be defined and discussed as well as stochastic (Monte Carlo) approximations. Advantages of different approximations will be contrasted with their potential disadvantages. Advanced models in the lecture will include models for clustering, classification, recognition, denoising, compression, dimensionality  reduction, deep learning, tracking etc. Typical application domains will be general pattern recognition, computational neuroscience and sensory data models including computer hearing and computer vision.


The students will deepen their knowledge on mathematical models of data and sensory signals. Building up on the previously acquired Machine Learning models and methods, the students will be lead closer to current research topics and will learn about models that currently represent the state-of-the-art. Based on these models, the students will be exposed to the typical theoretical and  practical challenges in the development of current Machine Learning algorithms. Typical such challenges are analytical and computational intractabilities, or local optima problems. Based on concrete examples, the students will learn how to address such problems. Applications to different data will teach skills to use the appropriate model for a desired task and the ability to interpret an algorithm’s result as well as ways for further improvements. Furthermore, the students will learn interpretations of biological and artificial intelligence based on state-of-the-art Machine Learning models.


Currently, no video is available for this course.

(Changed: 19 Jan 2024)  | 
Zum Seitananfang scrollen Scroll to the top of the page