v0.5.0
BytePairEncoding v0.5.0
Merged pull requests:
- support tiktoken (#7) (@chengchingwen)
Closed issues:
- Support for
cl100k_base
encoding, used by new OpenAI models? (#6)
Merged pull requests:
Closed issues:
cl100k_base
encoding, used by new OpenAI models? (#6)