Skip to content
bench

feat(debug): send tasks info #473

Sign in to view logs

feat(debug): send tasks info

feat(debug): send tasks info #473

Triggered via pull request October 8, 2024 23:00
@dqbddqbd
synchronize #2048
dqbd/debug-tasks-state
Status Success
Total duration 43m 17s
Artifacts –

bench.yml

on: pull_request
benchmark
43m 8s
benchmark
Fit to window
Zoom out
Zoom in

Annotations

1 warning and 2 notices
benchmark
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/cache@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Benchmark results: libs/langgraph/langgraph/pregel/__init__.py#L1
......................................... fanout_to_subgraph_10x: Mean +- std dev: 51.1 ms +- 1.3 ms ......................................... fanout_to_subgraph_10x_sync: Mean +- std dev: 44.5 ms +- 1.2 ms ......................................... fanout_to_subgraph_10x_checkpoint: Mean +- std dev: 69.7 ms +- 1.3 ms ......................................... fanout_to_subgraph_10x_checkpoint_sync: Mean +- std dev: 74.0 ms +- 1.0 ms ......................................... fanout_to_subgraph_100x: Mean +- std dev: 479 ms +- 10 ms ......................................... fanout_to_subgraph_100x_sync: Mean +- std dev: 426 ms +- 8 ms ......................................... fanout_to_subgraph_100x_checkpoint: Mean +- std dev: 687 ms +- 22 ms ......................................... fanout_to_subgraph_100x_checkpoint_sync: Mean +- std dev: 708 ms +- 6 ms ......................................... react_agent_10x: Mean +- std dev: 28.5 ms +- 0.7 ms ......................................... react_agent_10x_sync: Mean +- std dev: 20.5 ms +- 0.2 ms ......................................... react_agent_10x_checkpoint: Mean +- std dev: 44.4 ms +- 3.9 ms ......................................... react_agent_10x_checkpoint_sync: Mean +- std dev: 34.5 ms +- 3.3 ms ......................................... react_agent_100x: Mean +- std dev: 314 ms +- 8 ms ......................................... react_agent_100x_sync: Mean +- std dev: 247 ms +- 8 ms ......................................... react_agent_100x_checkpoint: Mean +- std dev: 822 ms +- 14 ms ......................................... react_agent_100x_checkpoint_sync: Mean +- std dev: 736 ms +- 15 ms ......................................... wide_state_25x300: Mean +- std dev: 18.8 ms +- 0.5 ms ......................................... wide_state_25x300_sync: Mean +- std dev: 11.1 ms +- 0.1 ms ......................................... wide_state_25x300_checkpoint: Mean +- std dev: 234 ms +- 7 ms ......................................... wide_state_25x300_checkpoint_sync: Mean +- std dev: 235 ms +- 15 ms ......................................... wide_state_15x600: Mean +- std dev: 21.8 ms +- 0.7 ms ......................................... wide_state_15x600_sync: Mean +- std dev: 12.9 ms +- 0.1 ms ......................................... wide_state_15x600_checkpoint: Mean +- std dev: 414 ms +- 13 ms ......................................... wide_state_15x600_checkpoint_sync: Mean +- std dev: 414 ms +- 19 ms ......................................... wide_state_9x1200: Mean +- std dev: 21.7 ms +- 0.5 ms ......................................... wide_state_9x1200_sync: Mean +- std dev: 12.9 ms +- 0.3 ms ......................................... wide_state_9x1200_checkpoint: Mean +- std dev: 265 ms +- 9 ms ......................................... wide_state_9x1200_checkpoint_sync: Mean +- std dev: 264 ms +- 15 ms
Comparison against main: libs/langgraph/langgraph/pregel/__init__.py#L1
+----------------------------------------+---------+-----------------------+ | Benchmark | main | changes | +========================================+=========+=======================+ | wide_state_25x300_checkpoint | 237 ms | 234 ms: 1.01x faster | +----------------------------------------+---------+-----------------------+ | wide_state_15x600_sync | 12.9 ms | 12.9 ms: 1.00x slower | +----------------------------------------+---------+-----------------------+ | react_agent_100x_sync | 246 ms | 247 ms: 1.01x slower | +----------------------------------------+---------+-----------------------+ | fanout_to_subgraph_10x_checkpoint_sync | 73.4 ms | 74.0 ms: 1.01x slower | +----------------------------------------+---------+-----------------------+ | fanout_to_subgraph_100x | 475 ms | 479 ms: 1.01x slower | +----------------------------------------+---------+-----------------------+ | fanout_to_subgraph_100x_checkpoint | 679 ms | 687 ms: 1.01x slower | +----------------------------------------+---------+-----------------------+ | Geometric mean | (ref) | 1.00x slower | +----------------------------------------+---------+-----------------------+ Benchmark hidden because not significant (22): wide_state_9x1200_checkpoint, react_agent_100x_checkpoint, wide_state_25x300_checkpoint_sync, fanout_to_subgraph_100x_sync, react_agent_100x, fanout_to_subgraph_10x, react_agent_10x_sync, react_agent_100x_checkpoint_sync, wide_state_9x1200_sync, fanout_to_subgraph_10x_sync, wide_state_15x600_checkpoint, wide_state_15x600, fanout_to_subgraph_100x_checkpoint_sync, wide_state_9x1200_checkpoint_sync, wide_state_25x300, wide_state_25x300_sync, react_agent_10x, wide_state_9x1200, wide_state_15x600_checkpoint_sync, react_agent_10x_checkpoint, fanout_to_subgraph_10x_checkpoint, react_agent_10x_checkpoint_sync