Course Information

Syllabus

Reference

Datasets

Tuesday	Thursday
.	Aug. 23 - Introduction (ppt, pdf) Chengcheng's presentation on GCP (pdf) Reading: [Goodfellow] Part I Project 1: MNIST Digit Recognition Using Multi-Layer Neural Networks (Due 09/07)
Aug. 28 - Background - Mathematics, ML, and NN (pdf, ppt) Reading: [Goodfellow] Part I; [Nielsen] Ch1,Ch2 [RumelhartHintonWilliams:1986] (original paper on BP) [Snyder&Qi:2017] (pdf) on SVD vs. eigendecomposition [Duda&Hart:2001] (pdf) on NN converging to MAP with infinite samples	Aug. 30 - Background - Neural Network GCP Get Started Guide by Chengcheng (pdf) Reading [GCP] and [GCP-Engine] [TensorFlow] and [Python]
Sept. 4 - CNN (Core Ideas) (pdf, ppt) Reading: [LMRL:1998] (biological rationale) [LeCun:1989] [LeCun:1998] (LeNet) [GNN:2018] [Neilsen] Ch6 BP derivation in CNN (pdf) by Zhifei Zhang	Sept. 6 - CNN (Practical Issues in Training) (pdf, ppt) Reading: [Google-DL] [Nielsen] Ch3 Project 2 - How to Better Train a Neural network (Due 09/28)
Sept. 11 - CNN (Practical Issues in Training) Reading: [Nielsen] Ch3	Sept. 13 - CNN (The Representative Power) (ppt, pdf) Reading: [Nielsen] Ch4, Ch5
Sept. 18 - CNN (Different Structures) (ppt, pdf) Reading: [LeCun:1989][LeCun:1998] [AlexNet:2012] [GoogLeNet:2014][VGGNet:2014] [ResNet:2015]	Sept. 20 - CNN (Implementation - Face Recognition and VGG Face Network) (ppt, pdf)
Sept. 25 - CNN (Random Thoughts) (ppt, pdf) Reading [GNN:2018][Capsule:2017] [SENet:cvpr:2018]	Sept. 27 - AE (Introduction) (ppt, pdf) Reading [Hinton:2006a][Hinton:2006b] Project 3 - Training VGGNet (Due 10/12)
Oct. 2 - AE (Regularized AE and Case Studies) (ppt, pdf) Reading [Bengio:2014][DAE:2008] Project 4 - Autoencoder (Due 10/26)	Oct. 4 - Fall Break
Oct. 9 - GAN (Theoretic Reasoning) (ppt, pdf) Reading [Goodfellow:2014][Goodfellow:2016]	Oct. 11 - GAN (Design Ideas) (ppt, pdf)
Oct. 16 - Class Cancelled Reading [Arjovsky:2017]	Oct. 18 - GAN (Implementations) by Zhifei Zhang (ppt, pdf) Project 5 - Generative Adversarial Network (Due 11/09)
Oct. 23 - GAN (Design Ideas - Cont')	Oct. 25 - Engineer's Day - Class Cancelled
Oct. 30 - Final Project Discussion	Nov. 1 - Final Project Pitch Final Project - Milestone 1 Due (3-slide pitch)
Nov. 6 - RNN - Intro (pdf, ppt) Project 6 - Recurrent Neural Network (Due 11/20)	Nov. 8 - RNN - LSTM vs. GRU Final Project - Milestone 2 Due (Literature Survey)
Nov. 13 - RNN - Introduction to RNNs for NLP (by Shang Gao) (pdf, ppt)	Nov. 15 - What's beyond CNN? (ppt) Final Project - Milestone 3 Due (Baseline Implementation)
Nov. 20 - Canceled	Nov. 22 - Thanksgiving
Nov. 27 - Canceled	Nov. 29 - Attention! (pdf, ppt) Nov. 29 - How to Design? (pdf, ppt)
Dec. 4 - Deep Reinforcement Learning by William Whiteley
Dec. 12 (2:45-4:45pm) - Final Project Presentation Final Project - Presentation Due (Due by noon 12/12) Final Project - Project Report Due (Due midnight 12/13)