Week 10

Attention and Transformers

Week 10 Overview

Slides & Recordings

Transformer video: https://www.youtube.com/watch?v=XSSTuhyAmnI

https://nlp.seas.harvard.edu/2018/04/03/attention.html

http://peterbloem.nl/blog/transformers

Last year’s A3 (a seq2seq autoencoder) http://modelai.gettysburg.edu/2021/headlines/

In-class Exercise & Solutions

In-person lab session: gradcam and input gradients lab09

Final Project - Deadline to form project groups on Markus, and submit a project proposal