Semi-Supervised Manifold Alignment Using Parallel Deep Autoencoders

• Main Authors: Fayeem Aziz, Aaron S. W. Wong, Stephan Chalup
• Format: Article
• Language: English
• Published: MDPI AG 2019-09-01
• Series: Algorithms
• Subjects: deep autoencoder; dimensionality reduction; manifold learning; 3-manifold; machine learning; manifold alignment; autoencoder; deep neural network; deep learning; double pendulum
• Online Access: https://www.mdpi.com/1999-4893/12/9/186
• ISSN: 1999-4893

The aim of manifold learning is to extract low-dimensional manifolds from high-dimensional data. Manifold alignment is a variant of manifold learning that uses two or more datasets that are assumed to represent different high-dimensional representations of the same underlying manifold. Manifold alignment can be successful in detecting latent manifolds in cases where one version of the data alone is not sufficient to extract and establish a stable low-dimensional representation. The present study proposes a parallel deep autoencoder neural network architecture for manifold alignment and conducts a series of experiments using a protein-folding benchmark dataset and a suite of new datasets generated by simulating double-pendulum dynamics with underlying manifolds of dimensions 2, 3 and 4. The dimensionality and topological complexity of these latent manifolds are above those occurring in most previous studies. Our experimental results demonstrate that the parallel deep autoencoder performs in most cases better than the tested traditional methods of semi-supervised manifold alignment. We also show that the parallel deep autoencoder can process datasets of different input domains by aligning the manifolds extracted from kinematics parameters with those obtained from corresponding image data.