Skip to content

Latest commit

 

History

History
213 lines (190 loc) · 41.1 KB

bm-20250117-vultr-x86_64-python-d4544cb232dee5f836a6-3.14.0a4+-d4544cb-vs-base.md

File metadata and controls

213 lines (190 loc) · 41.1 KB

Results vs. base

  • fork: python
  • ref: d4544cb232dee5f836a6
  • machine: linux-x86_64
  • commit hash: d4544cb
  • commit date: 2025-01-17
  • overall geometric mean: 1.135x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.13x slower
  • Memory change: 1.21x

Benchmarks with tag 'apps':

Benchmark results/bm-20250117-3.14.0a4+-d4544cb/bm-20250117-vultr-x86_64-python-d4544cb232dee5f836a6-3.14.0a4+-d4544cb.json results/bm-20250117-3.14.0a4+-d4544cb-NOGIL/bm-20250117-vultr-x86_64-python-d4544cb232dee5f836a6-3.14.0a4+-d4544cb.json
2to3 253 ms 303 ms: 1.20x slower
docutils 2.58 sec 2.81 sec: 1.09x slower
sphinx 988 ms 1.12 sec: 1.14x slower
Geometric mean (ref) 1.14x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20250117-3.14.0a4+-d4544cb/bm-20250117-vultr-x86_64-python-d4544cb232dee5f836a6-3.14.0a4+-d4544cb.json results/bm-20250117-3.14.0a4+-d4544cb-NOGIL/bm-20250117-vultr-x86_64-python-d4544cb232dee5f836a6-3.14.0a4+-d4544cb.json
async_tree_io_tg 613 ms 576 ms: 1.06x faster
async_tree_none_tg 256 ms 241 ms: 1.06x faster
asyncio_websockets 522 ms 516 ms: 1.01x faster
async_tree_memoization_tg 303 ms 310 ms: 1.02x slower
async_tree_none 271 ms 287 ms: 1.06x slower
coroutines 22.4 ms 24.0 ms: 1.07x slower
async_tree_memoization 327 ms 353 ms: 1.08x slower
async_generators 322 ms 373 ms: 1.16x slower
async_tree_cpu_io_mixed_tg 477 ms 583 ms: 1.22x slower
async_tree_cpu_io_mixed 495 ms 625 ms: 1.26x slower
Geometric mean (ref) 1.06x slower

Benchmark hidden because not significant (1): async_tree_io

Benchmarks with tag 'math':

Benchmark results/bm-20250117-3.14.0a4+-d4544cb/bm-20250117-vultr-x86_64-python-d4544cb232dee5f836a6-3.14.0a4+-d4544cb.json results/bm-20250117-3.14.0a4+-d4544cb-NOGIL/bm-20250117-vultr-x86_64-python-d4544cb232dee5f836a6-3.14.0a4+-d4544cb.json
float 72.3 ms 78.0 ms: 1.08x slower
pidigits 191 ms 228 ms: 1.19x slower
nbody 86.6 ms 134 ms: 1.55x slower
Geometric mean (ref) 1.26x slower

Benchmarks with tag 'regex':

Benchmark results/bm-20250117-3.14.0a4+-d4544cb/bm-20250117-vultr-x86_64-python-d4544cb232dee5f836a6-3.14.0a4+-d4544cb.json results/bm-20250117-3.14.0a4+-d4544cb-NOGIL/bm-20250117-vultr-x86_64-python-d4544cb232dee5f836a6-3.14.0a4+-d4544cb.json
regex_v8 24.2 ms 23.8 ms: 1.02x faster
regex_effbot 2.80 ms 2.88 ms: 1.03x slower
regex_dna 173 ms 186 ms: 1.08x slower
regex_compile 128 ms 150 ms: 1.18x slower
Geometric mean (ref) 1.06x slower

Benchmarks with tag 'serialize':

Benchmark results/bm-20250117-3.14.0a4+-d4544cb/bm-20250117-vultr-x86_64-python-d4544cb232dee5f836a6-3.14.0a4+-d4544cb.json results/bm-20250117-3.14.0a4+-d4544cb-NOGIL/bm-20250117-vultr-x86_64-python-d4544cb232dee5f836a6-3.14.0a4+-d4544cb.json
xml_etree_iterparse 91.5 ms 87.2 ms: 1.05x faster
xml_etree_parse 129 ms 128 ms: 1.00x faster
json_loads 27.8 us 30.3 us: 1.09x slower
json_dumps 11.4 ms 13.0 ms: 1.13x slower
xml_etree_generate 84.7 ms 96.6 ms: 1.14x slower
unpickle_pure_python 216 us 249 us: 1.16x slower
xml_etree_process 59.8 ms 69.2 ms: 1.16x slower
tomli_loads 1.92 sec 2.31 sec: 1.20x slower
pickle_pure_python 312 us 378 us: 1.21x slower
Geometric mean (ref) 1.11x slower

Benchmarks with tag 'startup':

Benchmark results/bm-20250117-3.14.0a4+-d4544cb/bm-20250117-vultr-x86_64-python-d4544cb232dee5f836a6-3.14.0a4+-d4544cb.json results/bm-20250117-3.14.0a4+-d4544cb-NOGIL/bm-20250117-vultr-x86_64-python-d4544cb232dee5f836a6-3.14.0a4+-d4544cb.json
python_startup 14.7 ms 15.2 ms: 1.03x slower
python_startup_no_site 7.50 ms 9.56 ms: 1.27x slower
Geometric mean (ref) 1.15x slower

Benchmarks with tag 'template':

Benchmark results/bm-20250117-3.14.0a4+-d4544cb/bm-20250117-vultr-x86_64-python-d4544cb232dee5f836a6-3.14.0a4+-d4544cb.json results/bm-20250117-3.14.0a4+-d4544cb-NOGIL/bm-20250117-vultr-x86_64-python-d4544cb232dee5f836a6-3.14.0a4+-d4544cb.json
django_template 35.4 ms 42.9 ms: 1.21x slower
genshi_xml 48.3 ms 60.0 ms: 1.24x slower
genshi_text 21.3 ms 27.7 ms: 1.30x slower
mako 11.9 ms 15.8 ms: 1.33x slower
Geometric mean (ref) 1.27x slower

All benchmarks:

Benchmark results/bm-20250117-3.14.0a4+-d4544cb/bm-20250117-vultr-x86_64-python-d4544cb232dee5f836a6-3.14.0a4+-d4544cb.json results/bm-20250117-3.14.0a4+-d4544cb-NOGIL/bm-20250117-vultr-x86_64-python-d4544cb232dee5f836a6-3.14.0a4+-d4544cb.json
gc_traversal 4.57 ms 3.14 ms: 1.46x faster
create_gc_cycles 1.85 ms 1.34 ms: 1.38x faster
sqlite_synth 2.20 us 2.01 us: 1.09x faster
async_tree_io_tg 613 ms 576 ms: 1.06x faster
async_tree_none_tg 256 ms 241 ms: 1.06x faster
xml_etree_iterparse 91.5 ms 87.2 ms: 1.05x faster
regex_v8 24.2 ms 23.8 ms: 1.02x faster
asyncio_websockets 522 ms 516 ms: 1.01x faster
xml_etree_parse 129 ms 128 ms: 1.00x faster
async_tree_memoization_tg 303 ms 310 ms: 1.02x slower
regex_effbot 2.80 ms 2.88 ms: 1.03x slower
python_startup 14.7 ms 15.2 ms: 1.03x slower
pathlib 18.1 ms 18.9 ms: 1.05x slower
json 5.07 ms 5.33 ms: 1.05x slower
bench_mp_pool 89.3 ms 94.3 ms: 1.06x slower
async_tree_none 271 ms 287 ms: 1.06x slower
pycparser 1.11 sec 1.19 sec: 1.07x slower
coroutines 22.4 ms 24.0 ms: 1.07x slower
regex_dna 173 ms 186 ms: 1.08x slower
async_tree_memoization 327 ms 353 ms: 1.08x slower
float 72.3 ms 78.0 ms: 1.08x slower
dulwich_log 75.8 ms 82.3 ms: 1.09x slower
json_loads 27.8 us 30.3 us: 1.09x slower
docutils 2.58 sec 2.81 sec: 1.09x slower
logging_silent 105 ns 115 ns: 1.10x slower
bpe_tokeniser 4.23 sec 4.66 sec: 1.10x slower
spectral_norm 93.9 ms 105 ms: 1.12x slower
k_core 2.05 sec 2.31 sec: 1.13x slower
pylint 282 ms 318 ms: 1.13x slower
generators 28.2 ms 31.8 ms: 1.13x slower
mdp 2.45 sec 2.78 sec: 1.13x slower
json_dumps 11.4 ms 13.0 ms: 1.13x slower
sphinx 988 ms 1.12 sec: 1.14x slower
many_optionals 1.02 ms 1.16 ms: 1.14x slower
xml_etree_generate 84.7 ms 96.6 ms: 1.14x slower
scimark_sor 116 ms 133 ms: 1.14x slower
subparsers 22.4 ms 25.6 ms: 1.15x slower
unpickle_pure_python 216 us 249 us: 1.16x slower
sqlglot_normalize 105 ms 121 ms: 1.16x slower
xml_etree_process 59.8 ms 69.2 ms: 1.16x slower
async_generators 322 ms 373 ms: 1.16x slower
pprint_safe_repr 706 ms 822 ms: 1.16x slower
regex_compile 128 ms 150 ms: 1.18x slower
sqlglot_optimize 52.5 ms 61.8 ms: 1.18x slower
pprint_pformat 1.44 sec 1.70 sec: 1.18x slower
logging_simple 6.17 us 7.31 us: 1.18x slower
go 116 ms 138 ms: 1.19x slower
pidigits 191 ms 228 ms: 1.19x slower
deepcopy 261 us 311 us: 1.19x slower
sympy_expand 459 ms 547 ms: 1.19x slower
pyflate 421 ms 503 ms: 1.20x slower
telco 7.18 ms 8.60 ms: 1.20x slower
tomli_loads 1.92 sec 2.31 sec: 1.20x slower
2to3 253 ms 303 ms: 1.20x slower
django_template 35.4 ms 42.9 ms: 1.21x slower
logging_format 6.91 us 8.38 us: 1.21x slower
scimark_fft 316 ms 383 ms: 1.21x slower
pickle_pure_python 312 us 378 us: 1.21x slower
sympy_sum 153 ms 186 ms: 1.22x slower
scimark_lu 114 ms 139 ms: 1.22x slower
deepcopy_reduce 2.67 us 3.26 us: 1.22x slower
sympy_integrate 19.8 ms 24.2 ms: 1.22x slower
sympy_str 273 ms 334 ms: 1.22x slower
async_tree_cpu_io_mixed_tg 477 ms 583 ms: 1.22x slower
thrift 747 us 915 us: 1.23x slower
chaos 55.3 ms 68.1 ms: 1.23x slower
sqlglot_transpile 1.56 ms 1.92 ms: 1.23x slower
coverage 79.8 ms 98.4 ms: 1.23x slower
comprehensions 16.8 us 20.7 us: 1.23x slower
nqueens 78.1 ms 96.5 ms: 1.24x slower
sqlalchemy_imperative 19.3 ms 23.8 ms: 1.24x slower
scimark_sparse_mat_mult 4.48 ms 5.56 ms: 1.24x slower
genshi_xml 48.3 ms 60.0 ms: 1.24x slower
connected_components 391 ms 487 ms: 1.25x slower
shortest_path 433 ms 539 ms: 1.25x slower
hexiom 5.83 ms 7.32 ms: 1.26x slower
raytrace 260 ms 328 ms: 1.26x slower
async_tree_cpu_io_mixed 495 ms 625 ms: 1.26x slower
sqlalchemy_declarative 129 ms 163 ms: 1.27x slower
sqlglot_parse 1.26 ms 1.60 ms: 1.27x slower
python_startup_no_site 7.50 ms 9.56 ms: 1.27x slower
scimark_monte_carlo 63.9 ms 81.4 ms: 1.27x slower
fannkuch 371 ms 475 ms: 1.28x slower
crypto_pyaes 67.5 ms 87.5 ms: 1.30x slower
deepcopy_memo 29.6 us 38.5 us: 1.30x slower
genshi_text 21.3 ms 27.7 ms: 1.30x slower
typing_runtime_protocols 156 us 203 us: 1.30x slower
meteor_contest 99.6 ms 130 ms: 1.31x slower
mako 11.9 ms 15.8 ms: 1.33x slower
richards 42.1 ms 56.3 ms: 1.34x slower
richards_super 48.3 ms 64.8 ms: 1.34x slower
deltablue 3.15 ms 4.61 ms: 1.46x slower
nbody 86.6 ms 134 ms: 1.55x slower
bench_thread_pool 1.03 ms 3.32 ms: 3.21x slower
Geometric mean (ref) 1.17x slower

Benchmark hidden because not significant (1): async_tree_io Ignored benchmarks (1) of results/bm-20250117-3.14.0a4+-d4544cb-NOGIL/bm-20250117-vultr-x86_64-python-d4544cb232dee5f836a6-3.14.0a4+-d4544cb.json: html5lib

  • Geometric mean (including insignificant results): 1.135x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.14x
  • 95% likely to have a slowdown of 1.14x
  • 99% likely to have a slowdown of 1.13x

Memory

  • memory change: 1.21x