Skip to content

PyTriton 0.5.0

Compare
Choose a tag to compare
@pziecina-nv pziecina-nv released this 10 Jan 09:35
· 66 commits to main since this release
  • New: Decoupled models support
  • New: AsyncioDecoupledModelClient, which works in async frameworks and decoupled Triton models like some Large Language Models.
  • Fix: Fixed a bug that prevented getting the log level when HTTP endpoint was disabled. Thanks @catwell