National Institute of Technology Rourkela

राष्ट्रीय प्रौद्योगिकी संस्थान राउरकेला

ଜାତୀୟ ପ୍ରଯୁକ୍ତି ପ୍ରତିଷ୍ଠାନ ରାଉରକେଲା

An Institute of National Importance
NIT Rourkela Inside Page Banner

Syllabus

Course Details

Subject {L-T-P / C} : MA5405 : Fundamentals of Machine Learning { 3-0-0 / 3}

Subject Nature : Theory

Coordinator : Bivas Bhaumik

Syllabus

Module 1 :

Introduction to Machine Learning: Supervised vs. Unsupervised Learning, Regression and Classification problems, Generalization, Underfitting, and Overfitting, Model evaluation: Bias-Variance trade-off, Cross-validation, Metrics (Accuracy, Precision, Recall, F1-score, RMSE, Coefficient of Determination, MAPE etc.

Module 2 :

Supervised Learning Algorithms: Linear Regression, Polynomial Regression, Logistic Regression, k-Nearest Neighbors (k-NN), Decision Trees and Random Forests, Support Vector Machines (SVMs).

Module 3 :

Neural Networks and Deep Learning Basics: Biological inspiration and Perceptrons, Multilayer Perceptrons (MLP), Activation functions, Loss functions, Backpropagation and Gradient Descent, Deep Learning Architectures: Deep Neural Networks, Convolutional Neural Networks (CNNs) Training Deep Neural Networks: Optimization techniques: SGD, Adam, RMSProp. Batch Normalization, Dropout, Weight Initialization, Overfitting and regularization techniques.

Module 4 :

Unsupervised Learning: Clustering: k-Means, Dimensionality Reduction: PCA. Specialized Topics and Applications: Introduction to Physics-Informed Neural Networks (PINNs) and Transfer Learning, Applications in Healthcare, Finance, Scientific Computing etc.

Course Objective

1 .

To introduce the fundamental concepts and mathematical foundations of machine learning and deep learning.

2 .

To understand and implement classical ML algorithms and deep learning architectures.

3 .

To explore applications in areas such as Solving Partial Differential Equations, Biomedical Applications, Finance and Economics, and scientific computing.

4 .

To introduce the working procedure of the tools and frameworks like Scikit- learn, Pandas, Numpy, TensorFlow, and PyTorch.

Course Outcome

1 .

Understand fundamental concepts of machine learning, including types of learning, hypothesis space, inductive bias, and model evaluation.

2 .

Apply and evaluate regression and classification algorithms to predict outputs from input data.

3 .

Analyze dimensionality reduction and feature extraction techniques to improve model performance.

4 .

Design specialized neural network models for solving partial differential equations (PDEs), as well as problems in finance, economics, and scientific computing.

Essential Reading

1 .

Zhi-Hua Zhou, Machine Learning, Springer Singapore , https://doi.org/10.1007/978-981-15-1967-3

2 .

Kevin P. Murphy, Machine Learning: A Probabilistic Perspective, The MIT Press

3 .

Christopher M. Bishop, Pattern Recognition and Machine Learning, Springer New York, NY , ISBN 978-0-387-31073-2

4 .

Snehashish Chakraverty, Arup Kumar Sahoo, Dhabaleswar Mohapatra, Artificial Neural Networks and Type-2 Fuzzy Set, Elsevier

Supplementary Reading

1 .

Ian Goodfellow, Yoshua Bengio, Aaron Courville, Deep Learning, MIT Press

Journal and Conferences

1 .

IEEE Transaction on Neural Networks & Learning Systems

2 .

Applications of Physics-Informed Neural Networks in Power Systems - A Review