Workshop Learning Objectives (Transformers)

1. Discuss the limits of RNNs
2. Operationally define transformers.
3. Discuss the concept of attention.
4. Describe the purpose of transformers.
5. Implement an illustrated transformer (Jay Alamaar).
6. Discuss the results and interesting outcomes or surprises.
7. Describe skip connections.
8. Describe layer norm.
9. Describe positional encodings.
10. Summarize transformer building blocks.
11. Implement the emotion detector text classification.
12. Discuss the results and interesting outcomes or surprises.