[Misc] Support quantization of MllamaForCausalLM (#8822) #58
Job | Run time |
---|---|
5s | |
9m 42s | |
8m 58s | |
9m 34s | |
9m 52s | |
9m 57s | |
9m 23s | |
9m 27s | |
9m 7s | |
9m 57s | |
9m 57s | |
1h 35m 59s |
Job | Run time |
---|---|
5s | |
9m 42s | |
8m 58s | |
9m 34s | |
9m 52s | |
9m 57s | |
9m 23s | |
9m 27s | |
9m 7s | |
9m 57s | |
9m 57s | |
1h 35m 59s |