| Week | Topic and Papers | Slides, Videos; Review Forms, Deadlines |
| | |
|
0 | Introduction, ML Lifecycle Overview, and Basics | Slides: PDF PPTX
Video 1; Video 2; Video 3 |
| Readings: SIGMOD tutorial 1, SIGMOD tutorial 2, Berkeley report | |
| | |
|
1-2 | Topic 1: Classical ML Training at Scale | Slides: PDF PPTX
Video 1; Video 2 |
| For review: Parameter Server | Review 1 Form; due 10/6 |
| For review: XGBoost | Review 2 Form; due 10/13 |
| More readings: MADlib, MLlib, Mahout, GraphLab, AWS Sagemaker | - |
| | |
|
1 | No class on 10/8 | - |
| | |
|
3 | Topic 2: Deep Learning Systems | Slides: PDF PPTX
Video 1; Video 2; Video 3 |
| For review: TensorFlow (Talk slides) | Review 3 Form; due 10/20 |
| More readings: Horovod, Distributed PyTorch, TVM | - |
| | |
|
4-5 | Topic 3: Feature Engineering and Model Selection Systems | Slides: PDF PPTX
Video 1 Video 2 |
| For review: Cerebro | Review 4 Form; due 10/27 |
| More readings: MSMS, Hyperband, ASHA, Vizier, Columbus, Vista | - |
| | |
|
5 | Review Session 1 on 11/3 (tentative) | Slides: PDF |
| | |
|
5 | Exam 1 on 11/5 | - |
| | |
|
6 | Topic 4: Data Sourcing and Organization for ML | Slides: PDF PPTX
Video 1; Video 2; Video 3 |
| For review: TFDV | Review 5 Form; due 11/3 |
| More readings: Deequ, Snorkel, Ground, SortingHat, Hamlet | - |
| | |
|
7 | Guest Lecture by Matei Zaharia (Databricks and Stanford) on MLFlow on 11/17 | Video; Slides PDF |
| | |
|
7-9 | Topic 5: ML Deployment | Slides: PDF PPTX
Video 1; Video 2 |
| For review: Clipper | Review 6 Form; due 11/12 |
| More readings: TF Serving, Uber PyML, Hummingbird, Federated ML | - |
| | |
|
8 | Guest Lecture by Angela Jiang (Determined AI) on Determined DL Platform on 11/24 | Video; Slides PDF |
| | |
|
8 | Thanksgiving Holiday on 11/26 | - |
| | |
|
9 | Guest Lecture by Joshua Patterson (NVIDIA) on RAPIDS on 12/1 | Video; Slides PDF |
| | |
|
9-10 | Topic 6: ML Platforms and Feature Stores | Slides: PDF PPTX
Video1; Video 2 |
| For review: ML systems technical debt | Review 7 Form; due 11/17 |
| For review: TensorFlow Extended | Review 8 Form; due 12/3 |
| More readings: MLFlow, Michelangelo | - |
| | |
|
10 | (Skipped) Topic 7: Hardware Accelerators for ML | - |
| For review: TPUs | Review 9 Form; due 12/8 |
| Check out CSE 240C if you are interested in this topic: Winter 2018 and Winter 2019 | - |
| | |
|
10 | Review Session 2 on 12/10 | Slides: PDF |
| | |
|
11 | Exam 2 on 12/19 (Saturday) | - |
| |
|