BenchmarkDotNet=v0.13.5, OS=macOS Ventura 13.3.1 (a) (22E772610a) [Darwin 22.4.0]
Apple M1 Pro, 1 CPU, 10 logical and 10 physical cores
.NET SDK=7.0.203
[Host] : .NET 7.0.5 (7.0.523.17405), Arm64 RyuJIT AdvSIMD
Job-YQCEPS : .NET 7.0.5 (7.0.523.17405), Arm64 RyuJIT AdvSIMD DEBUG
BuildConfiguration=Debug
Method |
Data |
Mean |
Error |
StdDev |
Ratio |
RatioSD |
Gen0 |
Gen1 |
Allocated |
Alloc Ratio |
SharpTokenV1_0_28 |
Hello, World! |
3.335 μs |
0.0589 μs |
0.0522 μs |
1.00 |
0.00 |
0.6752 |
0.0038 |
4.14 KB |
1.00 |
TiktokenSharpV1_0_5 |
Hello, World! |
6.733 μs |
0.0506 μs |
0.0449 μs |
2.02 |
0.04 |
2.1820 |
0.0458 |
13.41 KB |
3.24 |
Tiktoken |
Hello, World! |
6.742 μs |
0.0410 μs |
0.0364 μs |
2.02 |
0.03 |
2.1820 |
0.0458 |
13.41 KB |
3.24 |
|
|
|
|
|
|
|
|
|
|
|
SharpTokenV1_0_28 |
King(...)edy. [275] |
63.037 μs |
0.4089 μs |
0.3624 μs |
1.00 |
0.00 |
8.5449 |
0.4883 |
52.89 KB |
1.00 |
TiktokenSharpV1_0_5 |
King(...)edy. [275] |
21.937 μs |
0.0518 μs |
0.0404 μs |
0.35 |
0.00 |
5.0964 |
0.3052 |
31.34 KB |
0.59 |
Tiktoken |
King(...)edy. [275] |
23.910 μs |
0.1035 μs |
0.0808 μs |
0.38 |
0.00 |
5.7678 |
0.3357 |
35.38 KB |
0.67 |