This repo contains notes, experiments and projects on Deep Learning carried out as part of the Udacity Deep Learning Nanodegree and personal reasearch.

• Neural network to predict daily bike rental ridership

• CNN for image classification trained on the CIFAR-10 dataset

• Sequence to sequence model to translate from English to French

• Neural network for handwritten number recognition

• Sentiment Analysis example with TfLearn

Reading material

A list of reading/watching resources on Deep Learning.

Training

Pricing and hedging derivative securities with neural networks: Bayesian regularization, early stopping, and bagging

Backpropagation

• Yes you should understand backprop

• Neural Networks Demystified [Part 4: Backpropagation]

• How to Make a Neural Network - Intro to Deep Learning #2

Hidden nodes

• How do I decide the number of nodes in a hidden layer of a neural network?

Learning rates

• CS231n Convolutional Neural Networks for Visual Recognition

Bias

• Role of Bias in Neural Networks

Math

• Linear combination

• Big Picture of Calculus

• Partial derivatives, introduction

-Gradient

• Chain Rule introduction

RNNs and LSTMs

• Understanding LSTM Networks

• Deep Learning Book chapter on RNNs

• Andrej Karpathy's lecture on Recurrent Neural Networks

• Recurrent Neural Networks in Tensorflow I

NLP

• Bag-of-words model - Wikipedia

• Word Embedding - Wikipedia

• Word2vec - Wikipedia

• Character encoding - Wikipedia

• LSTM Networks for Sentiment Analysis

• How is deep learning used in sentiment analysis?

• Deep Learning Sentiment One Character at a T-i-m-e

• LSTM Networks for Sentiment Analysis on Tweets

• Bag of Words Meets Bags of Popcorn

Lexical Based Approach (predicting using a prebuilt Lexicon

• Lexicon-Based Methods for Sentiment Analysis
• A comparison of Lexicon-based approaches for Sentiment Analysis of microblog posts