Skip to content

PyTriton 0.4.2

Compare
Choose a tag to compare
@piotrm-nvidia piotrm-nvidia released this 06 Dec 19:04
· 91 commits to main since this release
  • New: You can create a client from an existing client instance or model configuration to avoid loading model configuration from the server.
  • New: Introduced warning system using the warnings module.
  • Fix: Experimental client for decoupled models prevents sending another request, when responses from previous request are not consumed, blocks close until stream is stopped.
  • Fix: Leak of ModelClient during Triton creation
  • Fix: Fixed non-declared project dependencies (removed from use in code or added to package dependencies)
  • Fix: Remote model is being unloaded from Triton when RemoteTriton is closed.