DR. A.P.J.
ABDUL KALAM TECHNICAL UNIVERSITY, LUCKNOW, UTTAR PRADESH
B. TECH (COMPUTER SCIENCE & ENGINEERING-DATA SCIENCE)
SEVENTH SEMESTER (DETAILED SYLLABUS)
BAI701 Deep Learning
Bloom’s
Course Outcome (CO) Knowledge
Level (KL)
At the end of course, the student will be able:
To present the mathematical, statistical and computational challenges of building neural K2
CO 1
networks
CO 2 To study the concepts of deep learning K2
CO 3 To introduce dimensionality reduction techniques K2
CO 4 To enable the students to know deep learning techniques to support real-time applications K3
CO 5 To examine the case studies of deep learning techniques K6
DETAILED SYLLABUS 3-0-0
Proposed
Unit Topic
Lecture
INTRODUCTION : Introduction to machine learning- Linear models (SVMs and Perceptrons,
logistic regression)- Intro to Neural Nets: What a shallow network computes- Training a network:
I 08
loss functions, back propagation and stochastic gradient descent- Neural networks as universal
function approximates
DEEP NETWORKS : History of Deep Learning- A Probabilistic Theory of Deep Learning-
Backpropagation and regularization, batch normalization- VC Dimension and Neural Nets-Deep Vs
II 08
Shallow Networks-Convolutional Networks- Generative Adversarial Networks (GAN), Semi-
supervised Learning
DIMENTIONALITY REDUCTION 9 Linear (PCA, LDA) and manifolds, metric learning - Auto
encoders and dimensionality reduction in networks - Introduction to Convnet - Architectures – AlexNet,
III 08
VGG, Inception, ResNet - Training a Convnet: weights initialization, batch normalization, hyper
parameter optimization
OPTIMIZATION AND GENERALIZATION : Optimization in deep learning– Non-convex
optimization for deep networks- Stochastic Optimization Generalization in neural networks- Spatial
IV Transformer Networks- Recurrent networks, LSTM - Recurrent Neural Network Language Models- 08
Word-Level RNNs & Deep Reinforcement Learning - Computational & Artificial
Neuroscience
CASE STUDY AND APPLICATIONS : Image net- Detection-Audio Wave Net-Natural Language
V Processing Word2Vec - Joint Detection-Bioinformatics- Face Recognition- Scene Understanding- 08
Gathering Image Captions
Text books:
1. Cosma Rohilla Shalizi, Advanced Data Analysis from an Elementary Point of View, 2015.
2. Deng & Yu, Deep Learning: Methods and Applications, Now Publishers, 2013.
3. Ian Goodfellow, Yoshua Bengio, Aaron Courville, Deep Learning, MIT Press, 2016.
4. Michael Nielsen, Neural Networks and Deep Learning, Determination Press, 2015.
SWAYAM/NPTEL/MOOCs Certification: https://onlinecourses.nptel.ac.in/noc18_cs41/preview
Curriculum & Evaluation Scheme: Computer Science & Engineering-Data Science