DEEP LEARNING
UNIT I: Introduction: Various paradigms of learning problems, Perspectives
and Issues in deep learning framework, review of fundamental learning
techniques. Feed forward neural network: Artificial Neural Network, activation
function, multi-layer neural network.
UNIT II: Training Neural Network: Risk minimization, loss function, back
propagation, regularization, model selection, and optimization.
Conditional Random Fields: Linear chain, partition function, Markov network,
Belief propagation, Training CRFs, Hidden Markov Model, Entropy.
UNIT III: Deep Learning: Deep Feed Forward network, regularizations, training
deep models, dropouts, Convolution Neural Network, Recurrent Neural Network,
and Deep Belief Network.
UNIT IV: Probabilistic Neural Network: Hopfield Net, Boltzmann machine,
RBMs, Sigmoid net, Auto encoders.
UNIT V: Applications: Object recognition, sparse coding, computer vision,
natural language processing. Introduction to Deep Learning Tools: Caffe, Theano,
Torch.