Implementation of Sparse Variational Dropout in Tensorflow2!
Original paper: Variational Dropout Sparsifies Deep Neural Networks(ICML 2017) https://arxiv.org/pdf/1701.05369.pdf
Official repo: https://github.com/bayesgroup/variational-dropout-sparsifies-dnn
- TensorFlow >= 2.0
pip install tensorflowrun LeNet.py to test training of LeNet5 by MNIST dataset.
96% accuracy & 95% sparsity after 20 epochs of training.