Natural Language Processing
Instructor: Mohammad Hossein Rohban | Certificate: Official (bilingual) |
Term: Summer 2025 | Prerequisite: Deep Learning |
Schedule: Tuesday and Thursday 17:00-18:30 | Online Class: Online Class |
General Objective
Natural Language Processing is one of the most important branches of artificial intelligence. Its goal is to create an interaction channel between humans and machines through natural human language. This course introduces fundamental NLP concepts and basic methods for solving related problems, while also covering some state-of-the-art approaches.
Topics
- Course Introduction and Objectives (1 session)
- Overview of course content and syllabus
- Introduction to Natural Language Processing (1 session)
- NLP overview, brief history, key problems and challenges
- Text Preprocessing Methods (2 sessions)
- Regular expressions, tokenization, normalization, stemming/lemmatization, sentence boundary detection, MED distance calculation
- Language Models (2 sessions)
- Basic language modeling, n-grams, perplexity, smoothing techniques
- Basic Text Classification Methods (3 sessions)
- Classification concepts, feature extraction, simple classifiers, logistic regression for classification, extending logistic regression to neural networks
- Basic Text Clustering Methods (2 sessions)
- Clustering concepts, k-means and mixture models
- Word Representations (4 sessions)
- Word representation methods: basic approaches, linear algebra-based methods, neural network-based methods, challenges and solutions, context-based representations (basic introduction)
- Machine Translation (4 sessions)
- Traditional machine translation models, IBM models, phrase-based models
- Recurrent Neural Networks and Attention Models (3 sessions)
- Simple RNNs and popular architectures (LSTM, GRU), modern machine translation models, attention mechanisms
- Parsing in NLP (3 sessions)
- Semantic and syntactic parsing types
- Basic parsing models
- Other NLP Applications (3 sessions)
- Additional NLP tasks: information extraction, summarization, POS tagging, etc.
Assessment
- Practical Assignments and Final Seminar: 30%
- Midterm Exam: 20%
- Final Exam: 30%
- Final Project: 20%
References
- Dan Jurafsky and James H. Martin. Speech and Language Processing (3rd ed. Draft), 2023.
- Manning and Schuetze, Foundations of Statistical Natural Language Processing, 1999.
- Yoav Goldberg. A Primer on Neural Network Models for Natural Language Processing, 2015.
- Ian Goodfellow, Yoshua Bengio, and Aaron Courville. Deep Learning, 2016.