This pdf shows some methods to fine tune the hyperparameters of a Neural Network to increase it's performance. It also puts light on some of the common problems related to Neural Networks along with their solutions.

First public project written in Python i guess, anyway this is a repository for my class CS115.N12.KHCL

The vanishing gradient problem is a well-known issue in training recurrent neural networks (RNNs). It occurs when gradients (derivatives of the loss with respect to the network's parameters) become too small as they are backpropagated through the network during training.

Machine Learning Glossary

Machine Learning Practical - Coursework 2: Analysing problems with the VGG deep neural network architectures (with 8 and 38 hidden layers) on the CIFAR100 dataset by monitoring gradient flow during training. And exploring solutions using batch normalization and residual connections.

Machine Learning Practical - Coursework 2 Report: Analysing problems with the VGG deep neural network architectures (with 8 and 38 hidden layers) on the CIFAR100 dataset by monitoring gradient flow during training. And exploring solutions using batch normalization and residual connections.