flash attention pdf

CSHCY · Jul 5, 2022 · e4747de · e4747de
1 parent 6feb054
commit e4747de
Show file tree

Hide file tree

Showing 2 changed files with 1 addition and 0 deletions.
diff --git a/papers/2205.14135.pdf b/papers/2205.14135.pdf
diff --git a/readme.md b/readme.md
@@ -122,6 +122,7 @@ Solving games with incomplete information such as poker with CFR.
 
 ## Highlighted Research Paper PDFs
 
+* [FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness](https://github.com/labmlai/annotated_deep_learning_paper_implementations/blob/master/papers/2205.14135.pdf)
 * [Autoregressive Search Engines: Generating Substrings as Document Identifiers](https://github.com/labmlai/annotated_deep_learning_paper_implementations/blob/master/papers/2204.10628.pdf)
 * [Training Compute-Optimal Large Language Models](https://github.com/labmlai/annotated_deep_learning_paper_implementations/blob/master/papers/2203.15556.pdf)
 * [ZeRO: Memory Optimizations Toward Training Trillion Parameter Models](https://github.com/labmlai/annotated_deep_learning_paper_implementations/blob/master/papers/1910.02054.pdf)