Deep Embedded Non-Redundant Clustering

Author(s)
Lukas Miklautz, Dominik Mautz, Muzaffer Can Altinigneli, Christian Böhm, Claudia Plant
Abstract

Complex data types like images can be clustered in multiple valid ways. Non-redundant clustering aims at extracting those meaningful groupings by discouraging redundancy between clusterings. Unfortunately, clustering images in pixel space directly has been shown to work unsatisfactory. This has increased interest in combining the high representational power of deep learning with clustering, termed deep clustering. Algorithms of this type combine the non-linear embedding of an autoencoder with a clustering objective and optimize both simultaneously. None of these algorithms try to find multiple non-redundant clusterings. In this paper, we propose the novel Embedded Non-Redundant Clustering algorithm (ENRC). It is the first algorithm that combines neural-network-based representation learning with non-redundant clustering. ENRC can find multiple highly non-redundant clusterings of different dimensionalities within a data set. This is achieved by (softly) assigning each dimension of the embedded space to the different clusterings. For instance, in image data sets it can group the objects by color, material and shape, without the need for explicit feature engineering. We show the viability of ENRC in extensive experiments and empirically demonstrate the advantage of combining non-linear representation learning with non-redundant clustering.

Organisation(s)
Research Group Data Mining and Machine Learning, Research Network Data Science
External organisation(s)
Ludwig-Maximilians-Universität München
Journal
Proceedings of the ... National Conference on Artificial Intelligence
Volume
34
Pages
5174-5181
ISSN
2159-5399
DOI
https://doi.org/10.1609/aaai.v34i04.5961
Publication date
11-2019
Peer reviewed
Yes
Austrian Fields of Science 2012
102033 Data mining, 102019 Machine learning
Portal url
https://ucris.univie.ac.at/portal/en/publications/deep-embedded-nonredundant-clustering(52fa29ac-c865-47ae-8f29-dc092a4aef81).html