Skip to content

0.1.0
Compare
Choose a tag to compare
@github-actions github-actions released this 25 May 20:56
· 451 commits to master since this release
v0.1.0
e6f230b
  • Paged attention support (requries flash-attn>=2.5.7)
  • New generator with dynamic batching support (requires paged attn)
  • Examples updated for dynamic generator
  • Faster draft model SD
  • Various optimizations, bugfixes and QoL improvements

Full Changelog: v0.0.21...v0.1.0

Assets 39
Loading