Skip to content

Latest commit

 

History

History
15 lines (13 loc) · 565 Bytes

README.md

File metadata and controls

15 lines (13 loc) · 565 Bytes
Raw

Workshop Learning Objectives (Transformers)

  1. Discuss the limits of RNNs
  2. Operationally define transformers.
  3. Discuss the concept of attention.
  4. Describe the purpose of transformers.
  5. Implement an illustrated transformer (Jay Alamaar).
  6. Discuss the results and interesting outcomes or surprises.
  7. Describe skip connections.
  8. Describe layer norm.
  9. Describe positional encodings.
  10. Summarize transformer building blocks.
  11. Implement the emotion detector text classification.
  12. Discuss the results and interesting outcomes or surprises.