Semi-Supervised Learning

Contact

Head of lab

Prof. Dr. Jörg Lücke

+49 441 798 5486

+49 441 798-3902

W30 2-201

Lab Administration

Nicole Kulbach

+49 441 798-3326

+49 441 798-3903

W30 2-206

Postal Address

Prof. Dr. Jörg Lücke
Arbeitsgruppe Machine Learning
Exzellenzcluster Hearing4all und
Department für Medizinische Physik und Akustik
Fakultät für Medizin und Gesundheitswissenschaften
Carl von Ossietzky Universität Oldenburg
D-26111 Oldenburg

Office Address

Room 201 (2nd floor)
Building W30 (NeSSy)  
Küpkersweg 74
26129 Oldenburg

Semi-Supervised Learning

 

 

Description

Our aim is to learn as high quality classifiers from as few labels in total as possible, for the whole tuning and training procedure. To achieve this goal, we use generative networks of three layers based on normalized hierarchical Poisson mixture models: The first layer performing input data normalization, the second learning data clusters based on Poisson noise assumptions, and the third learning the cluster classes. The result are compact hebbian update rules which do not require labeled data for parameter optimization in the clustering layer and only a minimal amount of labels in the classification layer. We use self-labeling mechanisms and truncated approximations to further enhance the semi-supervised performance of the network. With only a handful of free parameters, small validation set sizes can be used for their optimization, reducing the total number of neccessary labels far below the standard sizes for deep networks. Typical application domains of the approach are hand-written symbols (MNIST, EMNIST etc.) and text document classification. Please see the papers listed below for more details.

Source code is available on GitHub.

References (own publications)

D. Forster, A.-S. Sheikh and J. Lücke (2018)
Neural Simpletrons - Learning in the Limit of Few Labels with Directed Generative Networks
Neural Computation, 30:2113–2174 (online access, bibtex)

D. Forster and J. Lücke (2017)
Truncated Variational EM for Semi-Supervised Neural Simpletrons
International Joint Conference for Neural Networks (IJCNN), 3769-3776 (online access, bibtex)

(Changed: 20 Jun 2024)  | 
Zum Seitananfang scrollen Scroll to the top of the page