Help me pls

[aritralegndery]

Traceback (most recent call last): File "e:\llm\TinyLlama\pretrain\tinyllama.py", line 17, in <module> from lit_gpt.model import GPT, Block, Config, CausalSelfAttention File "E:\llm\TinyLlama\lit_gpt\__init__.py", line 1, in <module> from lit_gpt.model import GPT File "E:\llm\TinyLlama\lit_gpt\model.py", line 13, in <module> from flash_attn import flash_attn_func ModuleNotFoundError: No module named 'flash_attn'

[jzhang38]

Follow the instructions at https://github.com/Dao-AILab/flash-attention to install flash attn.

[aritralegndery]

Follow the instructions at https://github.com/Dao-AILab/flash-attention to install flash attn.

Thank You Sir.

[lixali]

This is taking me a very long time to install. 6 hours now and it is still not finished. Is it normal?