Deep Learning

Resources | 05 January 2017

This page contains resources, blogs, projects, papers, codes, links and other materials needed to get exposure in Deep Learning. Feel free to share it to people interested in this domain.

Blogs

Classes

Technical Presentations

Libraries

  • Keras, is a Deep Learning library for Python, that is simple, modular, and extensible. Created by Franchois Chollet, Artificial Intelligence Researcher, Google.
  • Caffe, created by Yangqing Jia and developed by the Berkeley Vision and Learning Center (BVLC) and by community contributors.
  • Theano, primarily developed by a machine learning group at the Université de Montréal.
  • TensorFlow, originally developed by the Google Brain team for internal Google use before being released under the Apache 2.0 open source license on November 9, 2015.
  • MXNet, an open-source deep learning framework that allows you to define, train, and deploy deep neural networks on a wide array of devices, from cloud infrastructure to mobile devices.
  • Torch, a scientific computing framework with wide support for machine learning algorithms that puts GPUs first.
  • sklearn-theano, OverFeat and GoogleNet feature extractor for Python.

Books

Surveys

Must read papers

  • Deep Sparse Rectifier Neural Networks - [Paper], Xavier Glorot, Antoine Bordes, Yoshua Bengio.
  • Efficient Backprop - [Paper], Yaan LeCun et al.

Architectures

Deep Learning for Computer Vision

Deep Learning for Face Recognition

  • DeepID - Deep Learning Face Representation from Predicting 10,000 Classes - [Paper], [GitHub]
  • DeepID2 - Deep Learning Face Representation by Joint Identification-Verification - [arXiv]
  • DeepID3 - Face Recognition with Very Deep Neural Networks - [arXiv]
  • Learning Face Representation from Scratch - [arXiv]
  • Face Search at Scale: 80 Million Gallery - [arXiv]
  • A Discriminative Feature Learning Approach for Deep Face Recognition - [arXiv]
  • One Millisecond Face Alignment with an Ensemble of Regression Trees - [arXiv]
  • DeepFace - Closing the Gap to Human-Level Performance in Face Verification - [Paper], [Slides], [GitHub]
  • Deep Face Recognition - Closing the Gap to Human-Level Performance in Face Verification - [Paper], [Home], [Keras]
  • FaceNet - A Unified Embedding for Face Recognition and Clustering - [Paper], [TensorFlow], [GitHub]
  • Targeting Ultimate Accuracy - Face Recognition via Deep Embedding - [Paper]

Deep Learning for Robotics

  • A Survey of Machine Learning Approaches to Robotic Path-Planning - [Paper]
  • Deep Learning Driven Visual Path Prediction from a Single Image - [arXiv]
  • A Novel Path Planning Method for Biomimetic Robot based on Deep Learning - [Link]
  • DeepVO: A Deep Learning approach for Monocular Visual Odometry - [arXiv]
  • An Improved Q-learning Algorithm for Path-Planning of a Mobile Robot - [Paper]
  • Optical Flow and Deep Learning Based Approach to Visual Odometry - [Thesis]
  • Learning Visual Odometry with a Convolutional Network - [Paper]
  • Learning to See by Moving - [arXiv]

Deep Learning for Music

  • Music Generation with Deep Learning - [Paper]
  • Deep Learning for Music - [Paper]
  • GRUV: Algorithmic Music Generation using Recurrent Neural Networks - [Paper], [GitHub]
  • A Recurrent Neural Network Music Generation Tutorial - [Tutorial]
  • Composing Music With Recurrent Neural Networks - [Tutorial]
  • Modeling and generating sequences of polyphonic music with the RNN-RBM - [Tutorial]
  • Deep learning for assisting the process of music composition - [Tuturial]
  • Using machine learning to generate music - [Blog]
  • WaveNet: A Generative Model for Raw Audio - [Blog]
  • Deep Learning for Music - [Blog]
  • Generating sound with recurrent neural networks - [Blog]
  • Generating Multi-track Music with Deep Learning - [Blog]

Deep Learning for Fine Grained Recognition

Plant/Flower Recognition

  • Fine-Grained Plant Classification Using Convolutional Neural Networks for Feature Extraction - [Paper]
  • Fine-tuning Deep Convolutional Networks for Plant Recognition - [Paper]
  • Plant species classification using deep convolutional neural network - [Paper]
  • Plant classification using convolutional neural networks - [Paper]
  • Deep-plant: Plant identification with convolutional neural networks - [Paper]
  • Deep Neural Networks Based Recognition of Plant Diseases by Leaf Image Classification - [Paper]
  • Plant Leaf Identification via A Growing Convolution Neural Network with Progressive Sample Learning - [Paper]

Food Recognition

  • DeepFood - Deep Learning-Based Food Image Recognition for Computer-Aided Dietary Assessment - [arXiv]
  • Im2Calories - towards an automated mobile vision food diary - [Paper]
  • Food Image Recognition by Using Convolutional Neural Networks (CNNs) - [arXiv]
  • Food Classification with Deep Learning in Keras / Tensorflow - [Blog], [GitHub]

Instrument Recognition

  • Automatic Instrument Recognition in Polyphonic Music Using Convolutional Neural Networks - [arXiv], [GitHub]

Musical Instrument Recognition

  • Deep Convolutional Networks on the Pitch Spiral for Musical Instrument Recognition - [Paper], [GitHub]

Star-galaxy Classification

  • Star-galaxy Classification Using Deep Convolutional Neural Networks - [arXiv], [GitHub]

Logo Recognition

  • Deep Learning for Logo Recognition - [arXiv]

In case if you found something useful to add to this article or you found a bug in the code or would like to improve some points mentioned, feel free to write it down in the comments. Hope you found something useful here.