Skip to content

PyTriton v0.1.1

Compare
Choose a tag to compare
@pziecina-nv pziecina-nv released this 01 Feb 09:50
· 276 commits to main since this release
  • Change: The @first_value decorator has been updated with new features:
    • Renamed from @first_values to @first_value
    • Added a strict flag to toggle the checking of equality of values on a single selected input of the request. Default is True
    • Added a squeeze_single_values flag to toggle the squeezing of single value ND arrays to scalars. Default is True
  • Fix: @fill_optionals now supports non-batching models
  • Fix: @first_value fixed to work with optional inputs
  • Fix: @group_by_values fixed to work with string inputs
  • Fix: @group_by_values fixed to work per sample-wise
  • Version of external components used during testing:
    • Triton Inference Server: 2.29.0
    • Other component versions depend on the used framework and Triton Inference Server containers versions.
      Refer to its support matrix
      for a detailed summary.