Week 3

Automatic Differentiation, Distributed Representation

Week 3 Overview

GloVe embedding demo 

Video on autodiff

Slides & Recordings

In-class Exercise & Solutions

Prof. Roger Grosse’s notes on autodiff and word embeddings

Notes on Backpropagation https://cs231n.github.io/optimization-2/

Automatic Differentiation in Machine Learning: a Survey (2018) https://arxiv.org/pdf/1502.05767.pdf

In-person lab session: numerical gradients / word embeddings lab02

Lec3 pre-recorded videos with quizzes