Skip to content

Commit

Permalink
Bump version to 1.37.0
Browse files Browse the repository at this point in the history
  • Loading branch information
guillaumekln committed Feb 28, 2023
1 parent d5c1908 commit 5a6c087
Show file tree
Hide file tree
Showing 2 changed files with 13 additions and 1 deletion.
12 changes: 12 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,18 @@ The project follows [semantic versioning 2.0.0](https://semver.org/). The API co

### Fixes and improvements

## [v1.37.0](https://github.com/OpenNMT/Tokenizer/releases/tag/v1.37.0) (2023-02-28)

### New features

* Add tokenization option `allow_isolated_marks` to allow combining marks to appear isolated in the tokenization output in specific conditions

### Fixes and improvements

* Fix infinite loop when the text contains an invalid Unicode character
* Fix segmentation fault when the `BPELearner` does not not find any pairs of characters in the tokenized data
* [Python] Update ICU to 72.1

## [v1.36.0](https://github.com/OpenNMT/Tokenizer/releases/tag/v1.36.0) (2023-01-11)

### New features
Expand Down
2 changes: 1 addition & 1 deletion bindings/python/pyonmttok/version.py
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
"""Version information."""

__version__ = "1.36.0"
__version__ = "1.37.0"

0 comments on commit 5a6c087

Please sign in to comment.