Skip to content

v0.5.3: Bug fixes for truncation

Pre-release
Pre-release
Compare
Choose a tag to compare
@adrianeboyd adrianeboyd released this 18 Jun 14:29
· 709 commits to master since this release

Bug fixes related to alignment and truncation:

  • #191: Reset max_len in case of alignment error
  • #196: Fix wordpiecer truncation to be per sentence

Enhancement:

  • #162: Let nlp.update handle Doc type inputs

Thanks to @ZhuoruLin for the pull requests and helping us debug issues related to batching and truncation!