This repository stores the codes for my IB EE (Math) project. The project aims to visualize the performances of different adaptive learning rate gradient descent methods such as ADAM, Adagrad, RMSprop, etc.