Machine Learning

Instructor: Mahdieh Soleymani Certificate: Official
Term: Summer 2025 Prerequisite: Mathematics for AI & Data Science
Schedule: Monday 16:00-19:00 Online Class: Online Class

General Objective

This course aims to introduce machine learning methods and their application to real-world problems. Supervised and unsupervised methods will be introduced, along with best practices for model evaluation and tuning. A data-centric approach to improving performance will also be discussed. The course focuses on implementing various machine learning models in Python and solving practical problems using ML libraries.

Syllabus

  1. Introduction to Machine Learning (1 session)
  2. Regression (4 sessions)
    • Linear regression
    • Gradient descent optimization
    • Nonlinear regression
    • Regularization
    • Overfitting
    • Validation and model selection
  3. Classification (4 sessions)
    • Decision trees
    • Support Vector Machines (SVM)
    • Probabilistic classification: Naïve Bayes and Logistic regression
    • Instance-based learning methods such as kNN
  4. Evaluation Metrics for Classification and Regression (1 session)
  5. Ensemble Learning (2 sessions)
    • Bagging approach: Random Forest
    • Boosting approach: Boosted trees methods like xgBoost
  6. Dimensionality Reduction (2 sessions)
    • PCA method
    • SVD method
  7. Clustering (2 sessions)
    • K-means method
    • Hierarchical clustering
    • Clustering evaluation
  8. Practical Problem-Solving Techniques (2 sessions)
    • Presentation of applied problems and solution pipelines

Evaluation

  • Quiz: 20%
  • Assignments: 40%
  • Final Exam: 40%
  • Pop Quizzes: 10%

References

  1. C. Bishop. Pattern Recognition and Machine Learning. Springer, 2006.
  2. A. Ng. Machine Learning Yearning. 2018.
  3. T. Mitchell. Machine Learning. MIT Press, 1998.
  4. K. Murphy. Machine Learning: A Probabilistic Perspective. MIT Press, 2012.
  5. T. Hastie, R. Tibshirani, and J. Friedman. The elements of statistical learning. 2nd Edition, 2008.