| Week | Topic and Papers | Slides, Videos; Review Forms, Deadlines |
| | |
|
1 | Introduction, ML Lifecycle Overview, and Basics | Slides: PDF PPTX |
| Readings: SIGMOD tutorial 1, SIGMOD tutorial 2, Berkeley report | |
| | |
|
1-3 | Topic 1: Classical ML Training at Scale | Slides: PDF PPTX |
| For review: Parameter Server | Review 1 Form; due Jan 18 |
| For review: XGBoost | Review 2 Form; due Jan 23 |
| Readings: MADlib, MLlib, Mahout, GraphLab, AWS Sagemaker | - |
| | |
|
3-6 | Topic 2: DL Systems (incl. LLM and DLRM Systems) | Slides:
1-PDF 1-PPTX
2-PDF 2-PPTX
3-PDF 3-PPTX
4-PDF 4-PPTX
5-PDF 5-PPTX |
| For review: Distributed PyTorch | Review 3 Form; due Jan 30 |
| For review: Alpa | Review 4 Form; due Feb 6 |
| For review: TVM | Review 5 Form; due Feb 13 |
| Readings: TensorFlow, Horovod, FSDP, Pathways, Monolith | - |
| | |
|
5 | Quiz on Tue, Feb 6 | |
| | |
|
5 | Guest Lectures by Hao Zhang and Kabir Nagrecha on Thu, Feb 8 | Hao's slides; Kabir's slides |
| | |
|
6 | Guest Lecture by Sumanth Hegde on Tue, Feb 13 | Sumanth's slides |
| | |
|
6 | Review Discussion 1 on Fri, Feb 16 | Slides: PDF |
| | |
|
7 | Midterm Exam on Tue, Feb 20 | - |
| | |
|
7-8 | Topic 3: ML Deployment and MLOps (incl. LLMOps) | Slides: PDF PPTX |
| | For review: VLLM | Review 6 Form; due Feb 22 |
| Readings: Interviews, Clipper, Federated ML, LLMOps, LangChain, LlamaIndex | - |
| | |
|
8-9 | Topic 4: Model Selection Systems | Slides: PDF PPTX |
| For review: Cerebro | Review 7 Form; due Feb 27 |
| Readings: MSMS, Hyperband, ASHA, Columbus, Saturn | - |
| | |
|
9-10 | Topic 5: Data-Centric Issues in ML/AI | Slides: PDF PPTX |
| For review: Deequ | Review 8 Form; due Mar 7 |
| Readings: TFDV, SortingHat, Hamlet, Snorkel | - |
| | |
|
10 | Topic 6: ML Platforms and Feature Stores | Slides: PDF PPTX |
| For review: TensorFlow Extended | Review 9 Form; due Mar 12 |
| Readings: ML systems tech. debt, Rules of ML Eng., MLFlow, Feature Stores | - |
| | |
|
10 | Review Discussion 2 on Fri, Mar 15 | Slides: PDF |
| | |
|
11 | Final Exam on Thu, Mar 21 | -
|