Supplementary references are to the following textbook:
Trevor Hastie, Robert Tibshirani, and Jerome Friedman, The Elements of Statistical Learning (2nd edition)
It is available online and is referred to below as HTF.
[Tentative schedule / subject to change]
| Sept 26 | A host of prediction problems [HTF 2.1, 2.2]
Probability review I [annotated] Probability review II [annotated] |
| Oct 1 | Nearest neighbor classification [annotated] [HTF 2.3, 7.10, 13.3] |
| Oct 3 | Continuation of probability review (see slides above) |
| Oct 8 | The generative approach to classification [annotated] [Handout (credit: Mark Gales, Cambdridge Univ.)] |
| Oct 10 | Linear algebra primer [annotated]
HW0 due before midnight Friday Oct 10 |
| Oct 15 | Multivariate generative modeling [annotated]
Quiz0 today in class, covering prerequisite probability and everything discussed in class before "The generative approach to classification" |
| Oct 17 | Multivariate generative modeling [annotated] |
| Oct 22 | Linear regression [annotated] [HTF 2.3.1, 3.2, 3.4] |
| Oct 24 | Continuation of linear regression (see slides above) |
| Oct 29 | Logistic regression [annotated] [HTF 4.4]
HW1 due before midnight Monday Oct 28 Quiz 1 today in class, covering everything after the last quiz, up to but not including "Logistic Regression" |
| Oct 31 | Convexity [annotated]
Unconstrained optimization [annotated] |
| Nov 5 | Linear classification [annotated] [HTF 4.5, 12.1, 12.2] |
| Nov 7 | Multiclass linear prediction [annotated] [annotated-old] |
| Nov 12 | Max-margin [annotated] / Duality [annotated] / Kernel methods [annotated]
Quiz 2 today in class, covering everything after the last quiz, up to but not including "Max-margin / Duality / Kernel methods" |
| Nov 14 | Continuation (see slides above) |
| Nov 19 | Continuation (see slides above) |
| Nov 21 | Feedforward neural nets [annotated]
Quiz 3 today in class, covering everything after the last quiz, up to but not including "Feedforward neural nets" |
| Nov 26 | Convolutional nets [annotated] |
| Dec 3 | Continuation (see slides above) |
| Dec 5 | Unsupervised learning / PCA / Autoencoders [annotated]
Quiz 4 today in class, covering everything after the last quiz, up to but not including "Unsupervised learning / PCA / Autoencoders"" |