You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am really enjoying using your quantization framework. It gives great flexibility with really good performance. However, while I recently noticed that a lot of features around LLM quantization have been added, I find it harder and harder to keep up with all of these methods due to a lack of documentation. For now, my entire quantization stack is based on the TVMCon 2021 tutorial and the 'Anatomy of a Quantizer' tutorial. More recently, I have even been copying ideas from Hugging Face's wrapper around Brevitas as part of their Optimum workflow, which is very well documented: https://huggingface.co/docs/optimum/main/en/amd/brevitas/usage_guide
Therefore, I am wondering: would it be possible to reserve time in Brevitas development to write docstrings and extend the tutorials list with all the new, really cool things that are possible with Brevitas? I can also help with in areas of Brevitas that I used.
Best,
Douwe
The text was updated successfully, but these errors were encountered:
Dear Brevitas team,
I am really enjoying using your quantization framework. It gives great flexibility with really good performance. However, while I recently noticed that a lot of features around LLM quantization have been added, I find it harder and harder to keep up with all of these methods due to a lack of documentation. For now, my entire quantization stack is based on the TVMCon 2021 tutorial and the 'Anatomy of a Quantizer' tutorial. More recently, I have even been copying ideas from Hugging Face's wrapper around Brevitas as part of their Optimum workflow, which is very well documented: https://huggingface.co/docs/optimum/main/en/amd/brevitas/usage_guide
Therefore, I am wondering: would it be possible to reserve time in Brevitas development to write docstrings and extend the tutorials list with all the new, really cool things that are possible with Brevitas? I can also help with in areas of Brevitas that I used.
Best,
Douwe
The text was updated successfully, but these errors were encountered: