AutoEncoder Models

A collection of autoencoder models, e.g. Vanilla, Stacked, Sparse in Tensorflow.

How to use?

• Command 1: python train.py ae_name train
• Command 2: python train.py ae_name generate
• Command 3: python train.py ae_name generate path/to/image

Note: Generated samples will be stored in images/{ae_model}/ directory during training.

Autoencoders

Traditional Autoencoders

The following papers are just examples on how to use the implemented autoencoders.
We did not mean to implement what have been described in each paper in details.

• Vanilla AutoEncoder
  • Learning Internal Representations by Error Propagation, 1986
  • Modular learning in neural networks, 1987
• Stacked AutoEncoder
  • Stacked autoencoders based machine learning for noise reduction and signal reconstruction in geophysical data, 2019
• Convolutional AE
  • Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction, 2011
  • Deep Clustering with Convolutional Autoencoders, 2017
  • Deep Convolutional AutoEncoder-based Lossy Image Compression, 2018
  • A Better AutoEncoder for Image: Convolutional AutoEncoder, 2018
• Regularized Sparse AE
  • Sparse autoencoder, 2011
  • k-Sparse Autoencoders, 2014
  • Why Regularized Auto-Encoders Learn Sparse Representation?, 2015
• Regularized Denoising AE
  • Stacked Denoising Autoencoders, 2010
  • Collaborative Filtering with Stacked Denoising AutoEncoders and Sparse Inputs, 2016
  • Deep Learning with Stacked Denoising Auto-Encoder, 2019

AutoEncoder	Loss Function
Vanilla_AE
Stacked_AE
Conv_AE
Denoising_AE
Sparse_AE

Results for MNIST

The following results can be reproduced with command:

python train.py ae_name train

Note: 1st and 3rd rows represent the ground truth whereas the 2nd and 4th rows are the generated ones.

Name	Epoch 1	Epoch 15	Epoch 30
Vanilla_AE
Stacked_AE
Conv_AE
Sparse_AE
Denoising_AE

Dependencies

1. Install miniconda https://docs.conda.io/en/latest/miniconda.html
2. Create an environment conda create --name autoencoder
3. Activate the environment source activate autoencoder
4. Install [Tensorflow] conda install -c conda-forge tensorflow
5. Install [Opencv] conda install -c conda-forge opencv
6. Install [sklearn] conda install -c anaconda scikit-learn
7. Install [matplotlib] conda install -c conda-forge matplotlib

Datasets

If you wanna try new dataset, please make sure you make it in the following way:

• Dataset_main_directory
  • train_data
    • category_1: (image1, image2, ...)
    • category_2: (image1, image2, ...)
    • ...
  • test_data
    • category_1: (image1, image2, ...)
    • category_2: (image1, image2, ...)
    • ... The loader.py file will automatically upload all images and their labels (category_i folders)

Acknowledgements

This implementation has been based on the work of the following great repositories:

• https://github.com/hwalsuklee/tensorflow-generative-model-collections
• https://github.com/wiseodd/generative-models
• https://github.com/eriklindernoren/Keras-GAN