Below are the links to all slides covered in class. Slides will be posted as soon as they are available.
Lecture # | Date | Topic | Slides | Recording | Quiz | Reading |
---|---|---|---|---|---|---|
0 | 7 Sept | Intro Lecture | Slides | Recording | Quiz 0 | |
1 | 12 Sept | Tasks, Benchmarks, and Metrics | Slides | Recording | Quiz 1 | |
2 | 14 Sept | Text Classifiers, BOW Models | Slides | Recording | Quiz 2 | |
3 | 19 Sept | Distributional Hypothesis & Word Embeddings | Slides | Recording | Quiz 3 | |
4 | 21 Sept | Topic Modeling | Slides | Recording | Quiz 4 | |
5 | 26 Sept | Statistical Machine Translation | Slides | Recording | Quiz 5 | |
6 | 28 Sept | Ngram Language Models | Slides | Recording | Quiz 6 | |
7 | 3 Oct | Neural Architectures for NLP Part 1: MLPs, RNNs | Slides | Recording | Quiz 7 | |
8 | 5 Oct | Neural Architectures for NLP Part 2: Transformers and NMT | Slides | Recording | Quiz 8 | |
9 | 10 Oct | Pretraining | Slides | Recording | Quiz 9 | |
10 | 12 Oct | Finetuning | Slides | Recording | Quiz 10 | |
11 | 17 Oct | Morphology, Tokenization | Slides | Recording | Quiz 11 | |
12 | 19 Oct | Lexicon (Part of Speech, Word Sense) | Slides | Recording | Quiz 12 | |
13 | 24 Oct | Syntax: Grammars and Parsing | Slides | Recording | Quiz 13 | |
14 | 26 Oct | Semantics: Semantic Representations and Parsing | Slides | Recording | Quiz 14 | |
15 | 31 Oct | Interpretability Part 1: What happened to CoreNLP? | Slides | Recording | Quiz 15 | |
16 | 2 Nov | Interpretability Part 2: Mechanistic Interpretability (Guest Lecture, Jack Merullo) | Slides | Recording | No Quiz | |
17 | 7 Nov | Instruction Tuning | Slides | Recording | Quiz 16 | |
18 | 9 Nov | A Brief History of Pretraining and Post-training Language Models (Guest Lecture, Albert Webson) | Slides | Recording | No Quiz | |
19 | 14 Nov | RLHF/RLAIF: Reinforcement Learning from Human (and AI) Feedback | Slides | Recording | Quiz 17 | |
20 | 16 Nov | Tasks and Benchmarking Revisited | Slides | Recording | Quiz 18 | |
21 Nov | No Class: Thanksgiving | |||||
23 Nov | No Class: Thanksgiving | |||||
21 | 28 Nov | Compositionality in Neural Network Representations (Guest Lecture, Michael Lepori) | Slides | Recording | No Quiz | |
22 | 30 Nov | Language Grounding (Guest Lecture, Roma Patel) | Slides | Recording | No Quiz | |
5 Dec | No Class | |||||
7 Dec | No Class |