Deep Learning Syllabus
Objectives of the course
1. This course introduces the basic models, learning algorithms, and some applications
of neural networks.
2. After this course, we should be able to know how to use neural networks for solving
different problems related to pattern recognition, function approximation, data
visualization, and so on.
Detailed contents
UNIT 1:
Introduction to Deep Learning, Bayesian Learning, Decision Surfaces, Linear Classifiers,
Linear Machines with Hinge Loss, Optimization Techniques, Gradient Descent, Batch
Optimization
UNIT 2:
Introduction to Neural Network, Multilayer Perceptron, Back Propagation Learning,
Unsupervised Learning with Deep Network, Autoencoders, Convolutional Neural Network,
Building blocks of CNN, Transfer Learning
UNIT 3:
Revisiting Gradient Descent, Momentum Optimizer, RMSProp, Adam, Effective training in
Deep Net- early stopping, Dropout, Batch Normalization, Instance Normalization, Group
Normalization, Recent Trends in Deep Learning Architectures, Residual Network, Skip
Connection Network, Fully Connected CNN etc.
UNIT 4:
Classical Supervised Tasks with Deep Learning, Image Denoising, Semanticd Segmentation,
Object Detection etc., LSTM Networks, Generative Modeling with DL, Variational
Autoencoder, Generative Adversarial Network
Suggested books
1. Deep Learning- Ian Goodfelllow, Yoshua Benjio, Aaron Courville, The MIT Press
2. Pattern Classification- Richard O. Duda, Peter E. Hart, David G. Stork, John Wiley & Sons
Inc.
