Course Details
Subject {L-T-P / C} : MA5405 : Fundamentals of Machine Learning { 3-0-0 / 3}
Subject Nature : Theory
Coordinator : Bivas Bhaumik
Syllabus
| Module 1 : |
Introduction to Machine Learning: Supervised vs. Unsupervised Learning, Regression and Classification problems, Generalization, Underfitting, and Overfitting, Model evaluation: Bias-Variance trade-off, Cross-validation, Metrics (Accuracy, Precision, Recall, F1-score, RMSE, Coefficient of Determination, MAPE etc. |
| Module 2 : |
Supervised Learning Algorithms: Linear Regression, Polynomial Regression, Logistic Regression, k-Nearest Neighbors (k-NN), Decision Trees and Random Forests, Support Vector Machines (SVMs). |
| Module 3 : |
Neural Networks and Deep Learning Basics: Biological inspiration and Perceptrons, Multilayer Perceptrons (MLP), Activation functions, Loss functions, Backpropagation and Gradient Descent, Deep Learning Architectures: Deep Neural Networks, Convolutional Neural Networks (CNNs) Training Deep Neural Networks: Optimization techniques: SGD, Adam, RMSProp. Batch Normalization, Dropout, Weight Initialization, Overfitting and regularization techniques. |
| Module 4 : |
Unsupervised Learning: Clustering: k-Means, Dimensionality Reduction: PCA. Specialized Topics and Applications: Introduction to Physics-Informed Neural Networks (PINNs) and Transfer Learning, Applications in Healthcare, Finance, Scientific Computing etc. |
Course Objective
| 1 . |
To introduce the fundamental concepts and mathematical foundations of machine learning and deep learning. |
| 2 . |
To understand and implement classical ML algorithms and deep learning architectures. |
| 3 . |
To explore applications in areas such as Solving Partial Differential Equations, Biomedical Applications, Finance and Economics, and scientific computing. |
| 4 . |
To introduce the working procedure of the tools and frameworks like Scikit- learn, Pandas, Numpy, TensorFlow, and PyTorch. |
Course Outcome
| 1 . |
Understand fundamental concepts of machine learning, including types of learning, hypothesis space, inductive bias, and model evaluation. |
| 2 . |
Apply and evaluate regression and classification algorithms to predict outputs from input data. |
| 3 . |
Analyze dimensionality reduction and feature extraction techniques to improve model performance. |
| 4 . |
Design specialized neural network models for solving partial differential equations (PDEs), as well as problems in finance, economics, and scientific computing. |
Essential Reading
| 1 . |
Zhi-Hua Zhou, Machine Learning, Springer Singapore , https://doi.org/10.1007/978-981-15-1967-3 |
| 2 . |
Kevin P. Murphy, Machine Learning: A Probabilistic Perspective, The MIT Press |
| 3 . |
Christopher M. Bishop, Pattern Recognition and Machine Learning, Springer New York, NY , ISBN 978-0-387-31073-2 |
| 4 . |
Snehashish Chakraverty, Arup Kumar Sahoo, Dhabaleswar Mohapatra, Artificial Neural Networks and Type-2 Fuzzy Set, Elsevier |
Supplementary Reading
| 1 . |
Ian Goodfellow, Yoshua Bengio, Aaron Courville, Deep Learning, MIT Press |
Journal and Conferences
| 1 . |
IEEE Transaction on Neural Networks & Learning Systems |
| 2 . |
Applications of Physics-Informed Neural Networks in Power Systems - A Review |



