fork: python
ref: 61b35f74aa4a6ac60663
machine: linux-x86_64
commit hash: 61b35f7
commit date: 2025-01-18
overall geometric mean: 1.004x slower
HPT reliability: 100.00%
HPT 99th percentile: 1.00x slower
Memory change: 1.00x
Benchmarks with tag 'apps':
Benchmark
bm-20250118-vultr-x86_64-python-e8092e5cdcd6707ac0b1-3.14.0a4+-e8092e5
bm-20250118-vultr-x86_64-python-61b35f74aa4a6ac60663-3.14.0a4+-61b35f7
2to3
251 ms
253 ms: 1.01x slower
docutils
2.55 sec
2.56 sec: 1.01x slower
Geometric mean
(ref)
1.01x slower
Benchmark hidden because not significant (1): sphinx
Benchmarks with tag 'asyncio':
Benchmark
bm-20250118-vultr-x86_64-python-e8092e5cdcd6707ac0b1-3.14.0a4+-e8092e5
bm-20250118-vultr-x86_64-python-61b35f74aa4a6ac60663-3.14.0a4+-61b35f7
async_tree_cpu_io_mixed_tg
557 ms
484 ms: 1.15x faster
async_tree_cpu_io_mixed
577 ms
502 ms: 1.15x faster
async_generators
322 ms
325 ms: 1.01x slower
coroutines
21.8 ms
22.1 ms: 1.01x slower
async_tree_io
607 ms
615 ms: 1.01x slower
Geometric mean
(ref)
1.02x faster
Benchmark hidden because not significant (6): async_tree_none_tg, async_tree_memoization_tg, asyncio_websockets, async_tree_io_tg, async_tree_memoization, async_tree_none
Benchmarks with tag 'math':
Benchmark
bm-20250118-vultr-x86_64-python-e8092e5cdcd6707ac0b1-3.14.0a4+-e8092e5
bm-20250118-vultr-x86_64-python-61b35f74aa4a6ac60663-3.14.0a4+-61b35f7
pidigits
226 ms
192 ms: 1.18x faster
nbody
87.6 ms
85.4 ms: 1.03x faster
Geometric mean
(ref)
1.06x faster
Benchmark hidden because not significant (1): float
Benchmarks with tag 'regex':
Benchmark
bm-20250118-vultr-x86_64-python-e8092e5cdcd6707ac0b1-3.14.0a4+-e8092e5
bm-20250118-vultr-x86_64-python-61b35f74aa4a6ac60663-3.14.0a4+-61b35f7
regex_effbot
2.66 ms
2.68 ms: 1.01x slower
regex_dna
170 ms
174 ms: 1.02x slower
regex_compile
125 ms
127 ms: 1.02x slower
Geometric mean
(ref)
1.01x slower
Benchmark hidden because not significant (1): regex_v8
Benchmarks with tag 'serialize':
Benchmark
bm-20250118-vultr-x86_64-python-e8092e5cdcd6707ac0b1-3.14.0a4+-e8092e5
bm-20250118-vultr-x86_64-python-61b35f74aa4a6ac60663-3.14.0a4+-61b35f7
json_loads
28.3 us
27.4 us: 1.03x faster
xml_etree_parse
128 ms
129 ms: 1.00x slower
xml_etree_iterparse
90.3 ms
91.3 ms: 1.01x slower
json_dumps
11.5 ms
11.7 ms: 1.01x slower
xml_etree_generate
83.6 ms
85.0 ms: 1.02x slower
unpickle_pure_python
209 us
213 us: 1.02x slower
xml_etree_process
58.6 ms
60.3 ms: 1.03x slower
pickle_pure_python
305 us
319 us: 1.04x slower
Geometric mean
(ref)
1.01x slower
Benchmark hidden because not significant (1): tomli_loads
Benchmarks with tag 'startup':
Benchmark
bm-20250118-vultr-x86_64-python-e8092e5cdcd6707ac0b1-3.14.0a4+-e8092e5
bm-20250118-vultr-x86_64-python-61b35f74aa4a6ac60663-3.14.0a4+-61b35f7
python_startup_no_site
7.44 ms
7.48 ms: 1.00x slower
python_startup
14.6 ms
14.7 ms: 1.01x slower
Geometric mean
(ref)
1.00x slower
Benchmarks with tag 'template':
Benchmark
bm-20250118-vultr-x86_64-python-e8092e5cdcd6707ac0b1-3.14.0a4+-e8092e5
bm-20250118-vultr-x86_64-python-61b35f74aa4a6ac60663-3.14.0a4+-61b35f7
genshi_xml
48.1 ms
48.4 ms: 1.01x slower
mako
11.6 ms
11.8 ms: 1.01x slower
genshi_text
20.7 ms
21.1 ms: 1.02x slower
django_template
34.9 ms
35.9 ms: 1.03x slower
Geometric mean
(ref)
1.02x slower
Benchmark
bm-20250118-vultr-x86_64-python-e8092e5cdcd6707ac0b1-3.14.0a4+-e8092e5
bm-20250118-vultr-x86_64-python-61b35f74aa4a6ac60663-3.14.0a4+-61b35f7
pidigits
226 ms
192 ms: 1.18x faster
async_tree_cpu_io_mixed_tg
557 ms
484 ms: 1.15x faster
async_tree_cpu_io_mixed
577 ms
502 ms: 1.15x faster
json_loads
28.3 us
27.4 us: 1.03x faster
nbody
87.6 ms
85.4 ms: 1.03x faster
telco
7.32 ms
7.21 ms: 1.01x faster
scimark_sparse_mat_mult
4.12 ms
4.06 ms: 1.01x faster
pathlib
18.2 ms
18.0 ms: 1.01x faster
sympy_integrate
19.7 ms
19.7 ms: 1.00x slower
nqueens
77.4 ms
77.7 ms: 1.00x slower
raytrace
259 ms
260 ms: 1.00x slower
sqlglot_parse
1.25 ms
1.25 ms: 1.00x slower
python_startup_no_site
7.44 ms
7.48 ms: 1.00x slower
bench_thread_pool
1.03 ms
1.04 ms: 1.00x slower
chaos
54.4 ms
54.7 ms: 1.00x slower
xml_etree_parse
128 ms
129 ms: 1.00x slower
python_startup
14.6 ms
14.7 ms: 1.01x slower
sqlglot_transpile
1.54 ms
1.55 ms: 1.01x slower
subparsers
21.8 ms
21.9 ms: 1.01x slower
sympy_sum
152 ms
153 ms: 1.01x slower
bpe_tokeniser
4.18 sec
4.21 sec: 1.01x slower
2to3
251 ms
253 ms: 1.01x slower
docutils
2.55 sec
2.56 sec: 1.01x slower
genshi_xml
48.1 ms
48.4 ms: 1.01x slower
deepcopy_memo
29.4 us
29.6 us: 1.01x slower
pyflate
419 ms
423 ms: 1.01x slower
sympy_str
270 ms
272 ms: 1.01x slower
sympy_expand
455 ms
458 ms: 1.01x slower
regex_effbot
2.66 ms
2.68 ms: 1.01x slower
async_generators
322 ms
325 ms: 1.01x slower
mako
11.6 ms
11.8 ms: 1.01x slower
pprint_pformat
1.41 sec
1.42 sec: 1.01x slower
fannkuch
366 ms
369 ms: 1.01x slower
meteor_contest
99.5 ms
100 ms: 1.01x slower
dulwich_log
74.6 ms
75.4 ms: 1.01x slower
scimark_lu
110 ms
111 ms: 1.01x slower
pprint_safe_repr
694 ms
702 ms: 1.01x slower
xml_etree_iterparse
90.3 ms
91.3 ms: 1.01x slower
comprehensions
16.6 us
16.8 us: 1.01x slower
json_dumps
11.5 ms
11.7 ms: 1.01x slower
logging_format
6.81 us
6.89 us: 1.01x slower
richards_super
48.3 ms
48.9 ms: 1.01x slower
coroutines
21.8 ms
22.1 ms: 1.01x slower
connected_components
389 ms
394 ms: 1.01x slower
bench_mp_pool
88.1 ms
89.3 ms: 1.01x slower
shortest_path
427 ms
433 ms: 1.01x slower
async_tree_io
607 ms
615 ms: 1.01x slower
deltablue
3.09 ms
3.13 ms: 1.02x slower
sqlglot_optimize
51.8 ms
52.6 ms: 1.02x slower
scimark_monte_carlo
62.5 ms
63.5 ms: 1.02x slower
genshi_text
20.7 ms
21.1 ms: 1.02x slower
sqlglot_normalize
103 ms
105 ms: 1.02x slower
xml_etree_generate
83.6 ms
85.0 ms: 1.02x slower
regex_dna
170 ms
174 ms: 1.02x slower
hexiom
5.68 ms
5.79 ms: 1.02x slower
regex_compile
125 ms
127 ms: 1.02x slower
unpickle_pure_python
209 us
213 us: 1.02x slower
generators
27.4 ms
28.1 ms: 1.02x slower
go
113 ms
116 ms: 1.03x slower
typing_runtime_protocols
155 us
158 us: 1.03x slower
logging_silent
103 ns
106 ns: 1.03x slower
django_template
34.9 ms
35.9 ms: 1.03x slower
thrift
723 us
743 us: 1.03x slower
xml_etree_process
58.6 ms
60.3 ms: 1.03x slower
deepcopy
253 us
260 us: 1.03x slower
deepcopy_reduce
2.59 us
2.70 us: 1.04x slower
pickle_pure_python
305 us
319 us: 1.04x slower
spectral_norm
86.8 ms
92.1 ms: 1.06x slower
mdp
2.34 sec
2.48 sec: 1.06x slower
gc_traversal
4.19 ms
4.56 ms: 1.09x slower
Geometric mean
(ref)
1.01x slower
Benchmark hidden because not significant (25): json, coverage, scimark_fft, richards, sqlalchemy_declarative, async_tree_none_tg, many_optionals, scimark_sor, async_tree_memoization_tg, create_gc_cycles, crypto_pyaes, asyncio_websockets, pycparser, k_core, sqlite_synth, regex_v8, sqlalchemy_imperative, tomli_loads, async_tree_io_tg, logging_simple, float, async_tree_memoization, sphinx, async_tree_none, pylint
Geometric mean (including insignificant results): 1.004x slower
Reliability score: 100.00% likely to be slow
90% likely to have a slowdown of 1.00x
95% likely to have a slowdown of 1.00x
99% likely to have a slowdown of 1.00x