Machine Learning
Instructor: Mahdieh Soleymani | Certificate: Official |
Term: Summer 2025 | Prerequisite: Mathematics for AI & Data Science |
Schedule: Monday 16:00-19:00 | Online Class: Online Class |
General Objective
This course aims to introduce machine learning methods and their application to real-world problems. Supervised and unsupervised methods will be introduced, along with best practices for model evaluation and tuning. A data-centric approach to improving performance will also be discussed. The course focuses on implementing various machine learning models in Python and solving practical problems using ML libraries.
Syllabus
- Introduction to Machine Learning (1 session)
- Regression (4 sessions)
- Linear regression
- Gradient descent optimization
- Nonlinear regression
- Regularization
- Overfitting
- Validation and model selection
- Classification (4 sessions)
- Decision trees
- Support Vector Machines (SVM)
- Probabilistic classification: Naïve Bayes and Logistic regression
- Instance-based learning methods such as kNN
- Evaluation Metrics for Classification and Regression (1 session)
- Ensemble Learning (2 sessions)
- Bagging approach: Random Forest
- Boosting approach: Boosted trees methods like xgBoost
- Dimensionality Reduction (2 sessions)
- PCA method
- SVD method
- Clustering (2 sessions)
- K-means method
- Hierarchical clustering
- Clustering evaluation
- Practical Problem-Solving Techniques (2 sessions)
- Presentation of applied problems and solution pipelines
Evaluation
- Quiz: 20%
- Assignments: 40%
- Final Exam: 40%
- Pop Quizzes: 10%
References
- C. Bishop. Pattern Recognition and Machine Learning. Springer, 2006.
- A. Ng. Machine Learning Yearning. 2018.
- T. Mitchell. Machine Learning. MIT Press, 1998.
- K. Murphy. Machine Learning: A Probabilistic Perspective. MIT Press, 2012.
- T. Hastie, R. Tibshirani, and J. Friedman. The elements of statistical learning. 2nd Edition, 2008.