| Week (Subject to change) |
Topics |
Homework |
Reading |
Special Events and Due Dates |
Slides & Lecture Notes |
| 1 (1/12+14+16) |
Introduction, class logistics, Review: linear algebra |
|
DL Ch. 1 & Ch. 2 |
|
Slides (1), (2) |
2 (1/21+23) |
Linear algebra; basics of optimization (hill-climbing) |
|
DL Ch. 3, TEoSL Ch. 1
| |
Slides (1), (2) |
3 (1/26+28+30) |
Optimization; differential calculus |
|
DL Ch. 4 & Ch. 5 |
|
Slides (1),
(2)
|
| 4 (2/2+4+6) |
Probability theory, statistics (Guest lec; Viet Nguyen) |
|
DL Ch. 5 |
HW #0 due 2/17 |
Slides (1),
(2),
(3)
|
5 (2/9+11+13) |
Distributions, learning theory, non-parametrics/parametrics, K-NN |
|
TEoSL Ch. 2.3, 3.1 |
|
Slides (1),
(2),
(3)
|
6 (2/16+18+20) |
Learning theory, supervised learning: linear regression |
|
TEoSL Ch. 4.4 |
|
Slides (1),
(2),
(3)
|
7 (2/23+25+27) |
Linear regression |
|
|
|
Slides (1),
(2),
(3)
|
8 (3/2+4+6) |
Dimensionality reduction: PCA (Guest lec; Will Gebhardt) |
|
|
HW #1 due 3/17 |
Slides (1),
(2),
(3)
|
| 9 (3/9+11+13) |
Spring Break (3/8 through 3/15) |
|
|
|
|
10 (3/16+18+20) |
Unsupervised learning, generative models, clustering |
|
| |
Slides (1), (2), (3) |
11 (3/23+25+27) |
Mixtures of Gaussians, decision trees |
|
Random Forests (Breiman '01) |
|
Slides (1), (2), (3) |
12 (3/30, 4/1+3) |
Trees/ensembles, artificial neural networks (ANNs) |
|
DL Ch. 6 |
|
Slides (1), (2), (3) |
13 (4/6+8+10) |
ANNs: reverse-mode differentiation, tricks of the trade |
|
|
|
Slides (1), (2), (3) |
14 (4/13+15+17) |
Violating i.i.d.: RNNs & time-series |
|
DL Ch. 10 |
|
Slides (1) |
15 (4/20+22+24) |
ANNs: Generative modeling |
|
|
Final Exam/Project |
Slides (1), (2) |
16 (4/27, Final: 5/XX, XX:XXam-XX:XXpm) |
Outlook, Final Project Presentations |
|
|
| Slides due X/XX, 10:40am |
| (Papers due X/XX, 8am) |
|
|
