Schedule

  • This course schedule and reading list are tentative and might change as the quarter progresses.

  • The review forms and deadlines for submitting them are listed alongside each paper; the deadline time is 9:59am PT on the deadline date.

  • If no review forms is provided for some papers, you need not submit reviews for the corresponding papers but they are recommended reading for that lecture.

Week Topic and Papers Slides, Videos; Review Forms, Deadlines
0 Introduction, ML Lifecycle Overview, and Basics Slides: PDF PPTX
Video 1; Video 2; Video 3
Readings: SIGMOD tutorial 1, SIGMOD tutorial 2, Berkeley report
1-2 Topic 1: Classical ML Training at Scale Slides: PDF PPTX
Video 1; Video 2
For review: Parameter Server Review 1 Form; due 10/6
For review: XGBoost Review 2 Form; due 10/13
More readings: MADlib, MLlib, Mahout, GraphLab, AWS Sagemaker -
1 No class on 10/8 -
3 Topic 2: Deep Learning Systems Slides: PDF PPTX
Video 1; Video 2; Video 3
For review: TensorFlow (Talk slides) Review 3 Form; due 10/20
More readings: Horovod, Distributed PyTorch, TVM -
4-5 Topic 3: Feature Engineering and Model Selection Systems Slides: PDF PPTX
Video 1 Video 2
For review: Cerebro Review 4 Form; due 10/27
More readings: MSMS, Hyperband, ASHA, Vizier, Columbus, Vista -
5 Review Session 1 on 11/3 (tentative) Slides: PDF
5 Exam 1 on 11/5 -
6 Topic 4: Data Sourcing and Organization for ML Slides: PDF PPTX
Video 1; Video 2; Video 3
For review: TFDV Review 5 Form; due 11/3
More readings: Deequ, Snorkel, Ground, SortingHat, Hamlet -
7 Guest Lecture by Matei Zaharia (Databricks and Stanford) on MLFlow on 11/17 Video; Slides PDF
7-9 Topic 5: ML Deployment Slides: PDF PPTX
Video 1
For review: Clipper Review 6 Form; due 11/12
More readings: TF Serving, Uber PyML, Hummingbird, Federated ML -
8 Guest Lecture by Angela Jiang (Determined AI) on Determined DL Platform on 11/24 Video; Slides PDF
8 Thanksgiving Holiday on 11/26 -
9 Guest Lecture by Joshua Patterson (NVIDIA) on RAPIDS on 12/1 Video
9-10 Topic 6: ML Platforms and Feature Stores Slides: PDF PPTX
Video
For review: ML systems technical debt Review 7 Form; due 11/17
For review: TensorFlow Extended Review 8 Form; due 12/3
More readings: MLFlow, Michelangelo -
10 Topic 7: Hardware Accelerators for ML Slides: PDF PPTX
Video
For review: TPUs Review 9 Form; due 12/8
Readings: RAPIDS, DNN Weaver, Facebook ML hardware -
10 Review Session 2 on 12/10 (tentative) Slides: PDF PPTX
Video
10 Exam 2 on 12/12 -