National Institute of Technology Rourkela

राष्ट्रीय प्रौद्योगिकी संस्थान राउरकेला

ଜାତୀୟ ପ୍ରଯୁକ୍ତି ପ୍ରତିଷ୍ଠାନ ରାଉରକେଲା

An Institute of National Importance
NIT Rourkela Inside Page Banner

Syllabus

Course Details

Subject {L-T-P / C} : EC3608 : Neural Networks and Deep Learning { 3-0-0 / 3}

Subject Nature : Theory

Coordinator : Ajit Kumar Sahoo

Syllabus

Module 1 :

Neuron Model, Single-Input Neuron, Transfer Functions, Multiple-Input Neuron, Network Architectures: A Layer of Neurons, Multiple Layers of Neurons, Recurrent Networks, Learning Techniques.

Module 2 :

Perceptron Learning: Theory and Examples; Learning Rules; Perceptron Architecture; Single-Neuron Perceptron; Multiple-Neuron Perceptron; Perceptron Learning Rule; Constructing Learning Rules; Unified Learning Rule; Training Multiple-Neuron Perceptron

Module 3 :

Multilayer Perceptron: Back propagation algorithm, Covers theorem, Radial-basis function Networks, Support Vector Machines

Module 4 :

Introduction to Deep learning, Convolutional Neural Networks, LeNet, ResNet, Deep auto-encoders, Deep generative models (GAN)

Module 5 :

Introduction to Recursive Neural network (RNN), LSTM, Attention mechanism, Transformer

Course Objective

1 .

To design and development of neural networks and deep learning algorithms

2 .

To analyze the real time problem and find solution to the same using Neural Networks and Deep Learning techniques

Course Outcome

1 .

To understand the fundamentals of neural networks.

2 .

To design and develop perceptron learning algorithms for pattern classification.

3 .

To develop learning algorithms for different neural networks.

4 .

To understand and develop different discriminative and generative deep learning models.

5 .

To understand and develop recurrent networks and attention mechanisms.

Essential Reading

1 .

Martin T. Hagan, Howard B. Demuth, Mark H. Beale, , Neural Network Design, Thomson , 1996

2 .

Christopher M. Bishop, , Deep Learning: Foundations and Concepts, Springer , 2023

Supplementary Reading

1 .

S. Haykin, Neural Networks and Learning Machines, Prentice Hall of India , 2010

2 .

lan Goodfellow, Yoshua Bengio, and Aaron Courville, Deep Learning, MIT Press , 2016

Journal and Conferences

1 .