Skip to content

Commit

Permalink
rename fast_forward -> jump_forward (#60)
Browse files Browse the repository at this point in the history
  • Loading branch information
hnyls2002 authored Feb 5, 2024
1 parent 05bb359 commit 0f23dc0
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion blog/2024-02-05-compressed-fsm.md
Original file line number Diff line number Diff line change
Expand Up @@ -134,5 +134,5 @@ We have been testing this feature with [Boson.ai](https://boson.ai/) for two wee

## Link
- You can try this feature now in [SGLang](https://github.com/sgl-project/sglang/tree/main?tab=readme-ov-file#json-decoding).
- Benchmark code is available [here](https://github.com/sgl-project/sglang/tree/main/benchmark/json_fast_forward).
- Benchmark code is available [here](https://github.com/sgl-project/sglang/tree/main/benchmark/json_jump_forward).
- We thank [outlines](https://github.com/outlines-dev/outlines) for open-sourcing its FSM implementation. We built our compressed FSM based on it.

0 comments on commit 0f23dc0

Please sign in to comment.