diff --git a/.github/workflows/tpcds.yml b/.github/workflows/tpcds.yml index 7c19d1fc3..ae479d10a 100644 --- a/.github/workflows/tpcds.yml +++ b/.github/workflows/tpcds.yml @@ -51,7 +51,7 @@ jobs: uses: actions/upload-artifact@v3 with: name: blaze-engine-spark303 - path: target/blaze-engine-spark303-pre-2.0.6-SNAPSHOT.jar + path: target/blaze-engine-spark303-pre-*-SNAPSHOT.jar - name: Build Spark333 run: mvn package -Ppre -Pspark333 @@ -59,7 +59,7 @@ jobs: uses: actions/upload-artifact@v3 with: name: blaze-engine-spark333 - path: target/blaze-engine-spark333-pre-2.0.6-SNAPSHOT.jar + path: target/blaze-engine-spark333-pre-*-SNAPSHOT.jar setup-spark: name: Setup Spark diff --git a/README.md b/README.md index 3ce90c977..f9a02c166 100644 --- a/README.md +++ b/README.md @@ -114,10 +114,10 @@ comparison with vanilla Spark on TPC-DS 1TB dataset. The benchmark result shows Stay tuned and join us for more upcoming thrilling numbers. Query time: -![20230925-query-time](./benchmark-results/blaze-query-time-comparison-20230925.png) +![20231108-query-time](./benchmark-results/blaze-query-time-comparison-20231108.png) Cluster resources: -![20230925-resources](./benchmark-results/blaze-executor-time-comparison-20230925.png) +![20231108-resources](./benchmark-results/blaze-cluster-resources-cost-comparison-20231108.png) We also encourage you to benchmark Blaze and share the results with us. 🤗 diff --git a/RELEASES.md b/RELEASES.md new file mode 100644 index 000000000..bf96430e5 --- /dev/null +++ b/RELEASES.md @@ -0,0 +1,20 @@ +# blaze-v2.0.7 + +## Features +* Supports native BroadcastNestedLoopJoinExec. +* Supports multithread UDF evaluation. +* Supports spark.files.ignoreCorruptFiles. +* Supports input batch statistics. + +## Performance +* Improves get_json_object() performance by reducing duplicated json parsing. +* Improves parquet reading performance by skipping utf-8 validation. +* Supports cached expression evaluator in native AggExec. +* Supports column pruning during native evaluation. +* Prefer native sort even if child is non-native. + +## Bugfix +* Fix missing outputPartitioning in NativeParquetExec. +* Fix missing native converting checks in parquet scan. +* Fix inconsistency: implement spark-compatible float to int casting. +* Avoid closing hadoop fs for reusing in cache. diff --git a/benchmark-results/20230925.md b/benchmark-results/20230925.md deleted file mode 100644 index 286dcdc03..000000000 --- a/benchmark-results/20230925.md +++ /dev/null @@ -1,260 +0,0 @@ - -# Report 2023-09-25 - -### Versions -- Blaze version: [2.0.6](https://github.com/blaze-init/blaze/tree/v2.0.6) -- Vanilla spark version: spark-3.3.3 - -### Environment -Hadoop 2.6.0 cluster mode running on 4 nodes, See [Kwai server conf](./kwai1-hardware-conf.md). - -### Configuration - -- Blaze -```properties -spark.executor.memory 5g -spark.executor.memoryOverhead 3072 -spark.blaze.memoryFraction 0.7 -spark.blaze.enable.caseconvert.functions true -spark.blaze.enable.smjInequalityJoin false -spark.blaze.enable.bhjFallbacksToSmj false -``` - -- Vanilla Spark -```properties -spark.executor.memory 6g -spark.executor.memoryOverhead 2048 -``` - -- Common configurations -```properties -spark.speculation false -spark.sql.adaptive.coalescePartitions.initialPartitionNum 1000 -spark.sql.adaptive.coalescePartitions.minPartitionNum 20 -spark.sql.adaptive.coalescePartitions.minPartitionSize 65536 -spark.sql.files.maxPartitionBytes 268435456 -spark.sql.autoBroadcastJoinThreshold 20971520 -``` - -### Results -Query time comparison (seconds): -![blaze-query-time-comparison-20230925.png](blaze-query-time-comparison-20230925.png) - -| | Spark | Blaze | Blaze / non-Blaze | -|------|-------|--------|-------------------| -| q01 | 9.1 | 8.9 | 0.978021978 | -| q02 | 9 | 17.9 | 1.988888889 | -| q03 | 5.9 | 6.4 | 1.084745763 | -| q04 | 268 | 89.9 | 0.335447761 | -| q05 | 48.1 | 23.1 | 0.48024948 | -| q06 | 62.5 | 12.4 | 0.1984 | -| q07 | 20.6 | 14.9 | 0.723300971 | -| q08 | 6.9 | 6.7 | 0.971014493 | -| q09 | 28.4 | 26.2 | 0.922535211 | -| q10 | 23.7 | 18.6 | 0.784810127 | -| q11 | 33 | 52.1 | 1.578787879 | -| q12 | 4.6 | 5.7 | 1.239130435 | -| q13 | 14.7 | 13.9 | 0.945578231 | -| q14a | 260.7 | 168.9 | 0.647871116 | -| q14b | 334.2 | 155.1 | 0.464093357 | -| q15 | 6.7 | 8.8 | 1.313432836 | -| q16 | 126.7 | 76.5 | 0.603788477 | -| q17 | 264 | 100.5 | 0.380681818 | -| q18 | 15.8 | 12.3 | 0.778481013 | -| q19 | 13.3 | 9.6 | 0.721804511 | -| q20 | 4.9 | 5.8 | 1.183673469 | -| q21 | 2.7 | 2.1 | 0.777777778 | -| q22 | 5 | 3.4 | 0.68 | -| q23a | 400.4 | 183.5 | 0.458291708 | -| q23b | 368 | 183.9 | 0.499728261 | -| q24a | 243.8 | 106.3 | 0.436013126 | -| q24b | 238.3 | 104.2 | 0.437263953 | -| q25 | 352.9 | 133.7 | 0.378860867 | -| q26 | 14 | 11.2 | 0.8 | -| q27 | 16.1 | 16.5 | 1.02484472 | -| q28 | 50.6 | 42.5 | 0.839920949 | -| q29 | 291.3 | 101.8 | 0.349467903 | -| q30 | 5.3 | 4.6 | 0.867924528 | -| q31 | 25.1 | 22.3 | 0.888446215 | -| q32 | 10.5 | 7.5 | 0.714285714 | -| q33 | 14.9 | 15 | 1.006711409 | -| q34 | 8.4 | 11.4 | 1.357142857 | -| q35 | 51.4 | 23.2 | 0.451361868 | -| q36 | 11.4 | 12.6 | 1.105263158 | -| q37 | 49.4 | 50.5 | 1.022267206 | -| q38 | 25 | 19.1 | 0.764 | -| q39a | 3.1 | 2.9 | 0.935483871 | -| q39b | 2.5 | 2.8 | 1.12 | -| q40 | 98.3 | 41 | 0.417090539 | -| q41 | 0.6 | 0.8 | 1.333333333 | -| q42 | 5 | 5.9 | 1.18 | -| q43 | 6.4 | 8.9 | 1.390625 | -| q44 | 12.7 | 12.4 | 0.976377953 | -| q45 | 4.3 | 4.9 | 1.139534884 | -| q46 | 12.4 | 13.4 | 1.080645161 | -| q47 | 16.4 | 22.3 | 1.359756098 | -| q48 | 19 | 10.7 | 0.563157895 | -| q49 | 75.2 | 45.5 | 0.605053191 | -| q50 | 173.2 | 56.7 | 0.327367206 | -| q51 | 31.8 | 20.8 | 0.65408805 | -| q52 | 8.5 | 6 | 0.705882353 | -| q53 | 9.9 | 7.6 | 0.767676768 | -| q54 | 88.6 | 25.6 | 0.288939052 | -| q55 | 5.3 | 5.5 | 1.037735849 | -| q56 | 13.3 | 13.9 | 1.045112782 | -| q57 | 8.2 | 11.8 | 1.43902439 | -| q58 | 13.8 | 17.1 | 1.239130435 | -| q59 | 11.2 | 21.3 | 1.901785714 | -| q60 | 12.5 | 14.1 | 1.128 | -| q61 | 12.7 | 17.5 | 1.377952756 | -| q62 | 3 | 5 | 1.666666667 | -| q63 | 7.3 | 7.8 | 1.068493151 | -| q64 | 434.8 | 330.6 | 0.760349586 | -| q65 | 17.9 | 16.9 | 0.944134078 | -| q66 | 15.1 | 15.9 | 1.052980132 | -| q67 | 89.2 | 65.5 | 0.734304933 | -| q68 | 29.9 | 17.5 | 0.585284281 | -| q69 | 15.4 | 14 | 0.909090909 | -| q70 | 13.4 | 16 | 1.194029851 | -| q71 | 11.4 | 18.9 | 1.657894737 | -| q72 | 167.8 | 128.2 | 0.764004768 | -| q73 | 6.6 | 9.2 | 1.393939394 | -| q74 | 27.1 | 34.2 | 1.26199262 | -| q75 | 70.9 | 63.6 | 0.897038082 | -| q76 | 10.6 | 11.9 | 1.122641509 | -| q77 | 16.8 | 18.1 | 1.077380952 | -| q78 | 391.7 | 283.6 | 0.724023487 | -| q79 | 12 | 14.3 | 1.191666667 | -| q80 | 345.3 | 268.1 | 0.776426296 | -| q81 | 11.5 | 8.3 | 0.72173913 | -| q82 | 83.1 | 102.8 | 1.237063779 | -| q83 | 4 | 8.2 | 2.05 | -| q84 | 11.3 | 3.5 | 0.309734513 | -| q85 | 21.9 | 12.7 | 0.579908676 | -| q86 | 3.9 | 4.9 | 1.256410256 | -| q87 | 26.4 | 20.5 | 0.776515152 | -| q88 | 22.6 | 23.4 | 1.03539823 | -| q89 | 9.6 | 11.8 | 1.229166667 | -| q90 | 2.7 | 3 | 1.111111111 | -| q91 | 3.3 | 3 | 0.909090909 | -| q92 | 5.7 | 16.2 | 2.842105263 | -| q93 | 184.5 | 73.3 | 0.397289973 | -| q94 | 73.5 | 43.9 | 0.597278912 | -| q95 | 168.6 | 116.4 | 0.690391459 | -| q96 | 3.9 | 4.3 | 1.102564103 | -| q97 | 48.4 | 35 | 0.723140496 | -| q98 | 9.4 | 13.7 | 1.457446809 | -| q99 | 4.3 | 8.3 | 1.930232558 | -| | | | | -| sum | 6775 | 4131.4 | 63.99% | - -Executor time comparison (Memory Bytes * Seconds): -![blaze-executor-time-comparison-20230925.png](blaze-executor-time-comparison-20230925.png) - -| | Executor non-Blaze | Executor Blaze | Blaze / non-Blaze | -|------|--------------------|----------------|-------------------| -| q01 | 1066219776 | 642344448 | 0.602450323 | -| q02 | 1526866432 | 2922760704 | 1.9142216 | -| q03 | 950981376 | 835230016 | 0.878282201 | -| q04 | 64740622336 | 20666464256 | 0.319219425 | -| q05 | 10753692672 | 5024803840 | 0.467263106 | -| q06 | 14307384320 | 2306884096 | 0.161237305 | -| q07 | 2799118080 | 2538463232 | 0.906879653 | -| q08 | 817900160 | 833955584 | 1.019630054 | -| q09 | 4604357120 | 5600161792 | 1.216274421 | -| q10 | 2019164928 | 1150014208 | 0.569549417 | -| q11 | 6847521792 | 11530115072 | 1.68383766 | -| q12 | 421437472 | 527794208 | 1.252366586 | -| q13 | 2537488896 | 2581031424 | 1.017159692 | -| q14a | 47319994368 | 19942103040 | 0.421430799 | -| q14b | 33793740800 | 17034392576 | 0.504069457 | -| q15 | 1096952832 | 1508379264 | 1.375063011 | -| q16 | 29006024704 | 16265106432 | 0.560749244 | -| q17 | 59924914176 | 21758795776 | 0.363100992 | -| q18 | 2139664512 | 2076931072 | 0.970680712 | -| q19 | 1426642432 | 1331761280 | 0.93349339 | -| q20 | 682654016 | 989317952 | 1.449223075 | -| q21 | 3599564 | 2190540 | 0.608557036 | -| q22 | 7997030 | 5595136 | 0.699651746 | -| q23a | 91218862080 | 39929298944 | 0.437730728 | -| q23b | 86807379968 | 41771245568 | 0.481194636 | -| q24a | 56840605696 | 23366049792 | 0.411080239 | -| q24b | 57046028288 | 23067781120 | 0.404371379 | -| q25 | 81137213440 | 28939937792 | 0.356678971 | -| q26 | 2266821632 | 1939046784 | 0.855403335 | -| q27 | 2868390400 | 2742991104 | 0.956282347 | -| q28 | 11334352896 | 9342280704 | 0.824244735 | -| q29 | 67238019072 | 22397638656 | 0.333109734 | -| q30 | 246767584 | 185725776 | 0.752634414 | -| q31 | 5370021888 | 4150037248 | 0.772815704 | -| q32 | 1792819328 | 1250925696 | 0.697742197 | -| q33 | 2975298304 | 2239600128 | 0.752731289 | -| q34 | 1277662208 | 1036245440 | 0.811048048 | -| q35 | 4694759936 | 1438854784 | 0.306481014 | -| q36 | 1995777024 | 2168232960 | 1.086410423 | -| q37 | 7441158656 | 1896587008 | 0.254877916 | -| q38 | 2782327040 | 2210101504 | 0.794335631 | -| q39a | 9129163 | 7969178 | 0.872936325 | -| q39b | 6214450 | 7149978 | 1.150540756 | -| q40 | 18811385856 | 8185948160 | 0.435159229 | -| q41 | 267059 | 344064 | 1.288344523 | -| q42 | 780070720 | 796281920 | 1.020781706 | -| q43 | 1100126592 | 1593081728 | 1.448089465 | -| q44 | 2055600768 | 1748200576 | 0.85045725 | -| q45 | 502046720 | 662375552 | 1.319350422 | -| q46 | 2064327552 | 2048662272 | 0.992411437 | -| q47 | 2905146112 | 3639533568 | 1.252788475 | -| q48 | 3064995840 | 1796522368 | 0.586141862 | -| q49 | 16623867904 | 9625489408 | 0.579016235 | -| q50 | 40862724096 | 13007288320 | 0.31831672 | -| q51 | 5740080640 | 3399386368 | 0.59221927 | -| q52 | 815559616 | 921632832 | 1.130061879 | -| q53 | 1302507904 | 1043310528 | 0.801001303 | -| q54 | 18482157568 | 5106749440 | 0.276306996 | -| q55 | 753316800 | 806872512 | 1.071093213 | -| q56 | 2466778624 | 2402802176 | 0.974064779 | -| q57 | 1235959936 | 1545929472 | 1.250792543 | -| q58 | 2408737536 | 2987686656 | 1.240353758 | -| q59 | 2044493824 | 4313134592 | 2.109634444 | -| q60 | 2443026688 | 1843951872 | 0.754781714 | -| q61 | 2232641792 | 3019576320 | 1.352467884 | -| q62 | 404345856 | 732178304 | 1.81077237 | -| q63 | 1257313024 | 1041154432 | 0.828078937 | -| q64 | 100637433856 | 75648811008 | 0.751696542 | -| q65 | 3643496704 | 3004107776 | 0.82451228 | -| q66 | 2828176128 | 2889482240 | 1.021676907 | -| q67 | 19781392384 | 14890660864 | 0.752761008 | -| q68 | 2683207424 | 2913215488 | 1.085721313 | -| q69 | 1896093696 | 1502811776 | 0.792583077 | -| q70 | 1909911808 | 2490846976 | 1.304168583 | -| q71 | 2117403648 | 2524851456 | 1.192428028 | -| q72 | 34367750144 | 24774889472 | 0.720876094 | -| q73 | 1062997632 | 958692288 | 0.901876222 | -| q74 | 5037475328 | 6900876800 | 1.369907811 | -| q75 | 14893350912 | 11940381696 | 0.801725667 | -| q76 | 2053630592 | 2017737728 | 0.982522239 | -| q77 | 3320152576 | 3157565184 | 0.951030144 | -| q78 | 95669395456 | 67481985024 | 0.705366483 | -| q79 | 2196531200 | 2170699776 | 0.988239901 | -| q80 | 85122842624 | 65850527744 | 0.773594087 | -| q81 | 410066944 | 316787872 | 0.77252721 | -| q82 | 14951208960 | 3867595776 | 0.25868114 | -| q83 | 314759616 | 258238096 | 0.820429569 | -| q84 | 858770560 | 170827808 | 0.19892136 | -| q85 | 1819089280 | 1153110528 | 0.633894411 | -| q86 | 451036832 | 431567744 | 0.956834816 | -| q87 | 2869883136 | 2405178880 | 0.838075547 | -| q88 | 4182748928 | 4364134400 | 1.043365135 | -| q89 | 1597231872 | 1471633920 | 0.921365236 | -| q90 | 316240800 | 291699072 | 0.92239544 | -| q91 | 70588824 | 61302368 | 0.868442971 | -| q92 | 717752000 | 555040704 | 0.773304295 | -| q93 | 42653380608 | 16590726144 | 0.388966265 | -| q94 | 14066631680 | 7693766656 | 0.546951597 | -| q95 | 25079318528 | 20350398464 | 0.811441445 | -| q96 | 620553792 | 634504768 | 1.022481493 | -| q97 | 8705960960 | 5256201216 | 0.603747391 | -| q98 | 1449452928 | 2047173888 | 1.412376938 | -| q99 | 751303424 | 1512822784 | 2.013597617 | -| | | | | -| sum | 1405609249658 | 780981243936 | 79.98% | diff --git a/benchmark-results/20231108.md b/benchmark-results/20231108.md new file mode 100644 index 000000000..14510ae95 --- /dev/null +++ b/benchmark-results/20231108.md @@ -0,0 +1,152 @@ + +# Report 2023-09-25 + +### Versions +- Blaze version: [2.0.7](https://github.com/blaze-init/blaze/tree/v2.0.7) +- Vanilla spark version: spark-3.3.3 + +### Environment +Hadoop 2.6.0 cluster mode running on 4 nodes, See [Kwai server conf](./kwai1-hardware-conf.md). + +### Configuration + +- Blaze +```properties +spark.executor.memory 5g +spark.executor.memoryOverhead 3072 +spark.blaze.memoryFraction 0.7 +spark.blaze.enable.caseconvert.functions true +spark.blaze.enable.smjInequalityJoin false +spark.blaze.enable.bhjFallbacksToSmj false +``` + +- Vanilla Spark +```properties +spark.executor.memory 6g +spark.executor.memoryOverhead 2048 +``` + +- Common configurations +```properties +spark.speculation false +spark.sql.adaptive.coalescePartitions.initialPartitionNum 1000 +spark.sql.adaptive.coalescePartitions.minPartitionNum 20 +spark.sql.adaptive.coalescePartitions.minPartitionSize 65536 +spark.sql.files.maxPartitionBytes 268435456 +spark.sql.autoBroadcastJoinThreshold 20971520 +``` + +### Results +Query time comparison (seconds): +![blaze-query-time-comparison-20231108.png](blaze-query-time-comparison-20231108.png) + +Executor time comparison (Memory Bytes * Seconds): +![blaze-cluster-resources-cost-comparison-20231108.png](blaze-cluster-resources-cost-comparison-20231108.png) + +| | Memcost Spark | Memcost Blaze | Blaze / non-Blaze | | Query time Spark | Query time Blaze | Blaze / non-Blaze | +| ---- | ------------- | ------------- | ----------------- | ---- | ---------------- | ---------------- | ----------------- | +| q01 | 1064427008 | 465841408 | 0.437645235 | q01 | 10.6 | 5.5 | 0.518867925 | +| q02 | 2368745984 | 2756580608 | 1.163729934 | q02 | 13 | 14.7 | 1.130769231 | +| q03 | 2393231360 | 929133184 | 0.388233749 | q03 | 12 | 6.1 | 0.508333333 | +| q04 | 70389727232 | 21082214400 | 0.299506977 | q04 | 292.8 | 91 | 0.31079235 | +| q05 | 14231480320 | 4988443136 | 0.350521732 | q05 | 58.5 | 22.3 | 0.381196581 | +| q06 | 14682045440 | 2478030848 | 0.168779674 | q06 | 72 | 13 | 0.180555556 | +| q07 | 5505946624 | 2492989184 | 0.452781212 | q07 | 27.3 | 14.3 | 0.523809524 | +| q08 | 2245357056 | 880980864 | 0.392356691 | q08 | 12.3 | 6 | 0.487804878 | +| q09 | 12896677888 | 5840865280 | 0.452896888 | q09 | 53.6 | 24.9 | 0.464552239 | +| q10 | 3314154496 | 850393920 | 0.256594531 | q10 | 22.8 | 12.7 | 0.557017544 | +| q11 | 11654519808 | 11504233472 | 0.987104888 | q11 | 53.4 | 51.5 | 0.964419476 | +| q12 | 686692864 | 435701312 | 0.634492267 | q12 | 5 | 4.5 | 0.9 | +| q13 | 7461695488 | 2950348032 | 0.395399147 | q13 | 37.2 | 16.6 | 0.446236559 | +| q14a | 51038400512 | 19587477504 | 0.383779219 | q14a | 323 | 165.7 | 0.513003096 | +| q14b | 37148839936 | 16872809472 | 0.454194788 | q14b | 259.7 | 151 | 0.581440123 | +| q15 | 1749106432 | 1444340096 | 0.825758839 | q15 | 9.5 | 7.8 | 0.821052632 | +| q16 | 27584167936 | 16530120704 | 0.599261168 | q16 | 123.3 | 77.3 | 0.626926196 | +| q17 | 58074173440 | 31913037824 | 0.549522032 | q17 | 257.3 | 145.2 | 0.564321803 | +| q18 | 3536184832 | 1841279744 | 0.520696692 | q18 | 21.8 | 13.3 | 0.610091743 | +| q19 | 3174092032 | 1262991616 | 0.397906426 | q19 | 24.1 | 7.9 | 0.32780083 | +| q20 | 1256781568 | 877110784 | 0.69790233 | q20 | 8 | 5.3 | 0.6625 | +| q21 | 8047820 | 1677721 | 0.208469002 | q21 | 5.4 | 1.7 | 0.314814815 | +| q22 | 12014388 | 5233048 | 0.435565091 | q22 | 7.4 | 3.3 | 0.445945946 | +| q23a | 81502380032 | 44305956864 | 0.543615497 | q23a | 357.9 | 201.9 | 0.564124057 | +| q23b | 80083304448 | 44114300928 | 0.550855153 | q23b | 351.1 | 193.8 | 0.551979493 | +| q24a | 49402916864 | 32242606080 | 0.652645798 | q24a | 215.1 | 143 | 0.664807066 | +| q24b | 49900470272 | 32306599936 | 0.647420751 | q24b | 215.9 | 147.5 | 0.68318666 | +| q25 | 78905024512 | 40509927424 | 0.513401113 | q25 | 352.4 | 181.5 | 0.515039728 | +| q26 | 2931277056 | 1329268992 | 0.453477773 | q26 | 16.5 | 11.3 | 0.684848485 | +| q27 | 5451323904 | 2441775872 | 0.447923461 | q27 | 28.1 | 13.9 | 0.494661922 | +| q28 | 21703208960 | 9712209920 | 0.447501102 | q28 | 88.8 | 41.8 | 0.470720721 | +| q29 | 54227959808 | 33627506688 | 0.620113809 | q29 | 242 | 151.3 | 0.625206612 | +| q30 | 302891104 | 147115216 | 0.485703324 | q30 | 8.6 | 4.6 | 0.534883721 | +| q31 | 9615978496 | 3625563392 | 0.377035306 | q31 | 41.2 | 18.7 | 0.453883495 | +| q32 | 2419902464 | 903169600 | 0.373225621 | q32 | 14.6 | 6.1 | 0.417808219 | +| q33 | 4866960896 | 1897390848 | 0.389851262 | q33 | 22.6 | 12.4 | 0.548672566 | +| q34 | 2799148544 | 861252800 | 0.30768385 | q34 | 15.4 | 8.2 | 0.532467532 | +| q35 | 5119056896 | 1196330240 | 0.233701298 | q35 | 42.5 | 20.4 | 0.48 | +| q36 | 4177485312 | 2365667328 | 0.566289801 | q36 | 21.4 | 12.4 | 0.579439252 | +| q37 | 7496896512 | 1835760256 | 0.244869361 | q37 | 49.1 | 48.6 | 0.989816701 | +| q38 | 4062855168 | 2003627264 | 0.493157443 | q38 | 30.4 | 17.9 | 0.588815789 | +| q39a | 17670146 | 6130892 | 0.346963291 | q39a | 5.5 | 2.6 | 0.472727273 | +| q39b | 15856440 | 5174066 | 0.326306914 | q39b | 5.3 | 2.2 | 0.41509434 | +| q40 | 15339921408 | 8198391296 | 0.534448064 | q40 | 75.2 | 41.3 | 0.549202128 | +| q41 | 429260 | 425984 | 0.992368262 | q41 | 0.7 | 0.8 | 1.142857143 | +| q42 | 2318457088 | 910912448 | 0.392895971 | q42 | 11.8 | 5.3 | 0.449152542 | +| q43 | 2643484416 | 1599878528 | 0.605215797 | q43 | 32.7 | 8 | 0.244648318 | +| q44 | 4751142912 | 1849382784 | 0.389250085 | q44 | 23.4 | 13.3 | 0.568376068 | +| q45 | 859250816 | 629260352 | 0.732336054 | q45 | 5.7 | 7.3 | 1.280701754 | +| q46 | 5104092160 | 2061359616 | 0.403864106 | q46 | 25.9 | 12.8 | 0.494208494 | +| q47 | 4227521024 | 3306628608 | 0.782167277 | q47 | 22.9 | 19.3 | 0.84279476 | +| q48 | 5522035200 | 1918160384 | 0.347364751 | q48 | 27.8 | 10.1 | 0.363309353 | +| q49 | 18826491904 | 8491696640 | 0.451050397 | q49 | 85.9 | 38.5 | 0.448195576 | +| q50 | 40762097664 | 16581796864 | 0.406794493 | q50 | 177.7 | 72.9 | 0.410241981 | +| q51 | 6946065920 | 3357170944 | 0.483319764 | q51 | 42.2 | 19.9 | 0.471563981 | +| q52 | 2423949056 | 891738560 | 0.367886676 | q52 | 13.3 | 5.9 | 0.443609023 | +| q53 | 2978816512 | 1063898368 | 0.357154717 | q53 | 14.8 | 6.8 | 0.459459459 | +| q54 | 18391373824 | 4836988416 | 0.263003105 | q54 | 111.6 | 24.2 | 0.216845878 | +| q55 | 3162129152 | 904986816 | 0.2861954 | q55 | 105.5 | 6.7 | 0.063507109 | +| q56 | 5093037568 | 1856954368 | 0.364606454 | q56 | 23.8 | 11.9 | 0.5 | +| q57 | 1928995200 | 1409447552 | 0.730664105 | q57 | 11.3 | 10 | 0.884955752 | +| q58 | 4623944704 | 2751867392 | 0.595134148 | q58 | 22.1 | 16.1 | 0.728506787 | +| q59 | 3398420992 | 4046962688 | 1.190836185 | q59 | 16.7 | 21 | 1.25748503 | +| q60 | 5130304512 | 1853107072 | 0.361208008 | q60 | 23.9 | 12.2 | 0.510460251 | +| q61 | 7130669568 | 3167909120 | 0.444265309 | q61 | 31.7 | 17.3 | 0.545741325 | +| q62 | 861110208 | 680694720 | 0.79048502 | q62 | 5.2 | 5.1 | 0.980769231 | +| q63 | 2913974784 | 1040937536 | 0.357222561 | q63 | 14.3 | 6.6 | 0.461538462 | +| q64 | 90821681152 | 69013241856 | 0.759876287 | q64 | 393 | 350.2 | 0.891094148 | +| q65 | 6929706496 | 2843368192 | 0.410315818 | q65 | 31 | 14.4 | 0.464516129 | +| q66 | 4168856064 | 2617344256 | 0.627832723 | q66 | 43 | 13.4 | 0.311627907 | +| q67 | 16813858816 | 17727514624 | 1.054339448 | q67 | 80.9 | 85.8 | 1.060568603 | +| q68 | 6089261056 | 2621406208 | 0.430496604 | q68 | 30.5 | 15.5 | 0.508196721 | +| q69 | 3271612928 | 874701312 | 0.26736088 | q69 | 20.3 | 10.6 | 0.522167488 | +| q70 | 5136711680 | 2550137600 | 0.496453326 | q70 | 24.8 | 19.2 | 0.774193548 | +| q71 | 5308280832 | 1973878784 | 0.371848975 | q71 | 24.9 | 13.8 | 0.554216867 | +| q72 | 34922856448 | 26422075392 | 0.756584028 | q72 | 174.4 | 142.4 | 0.816513761 | +| q73 | 2774287872 | 841416320 | 0.30329092 | q73 | 14.1 | 16.9 | 1.19858156 | +| q74 | 8379421696 | 6379356672 | 0.761312284 | q74 | 38.8 | 30.3 | 0.780927835 | +| q75 | 21823078400 | 11057697792 | 0.506697432 | q75 | 98.5 | 60 | 0.609137056 | +| q76 | 5128589824 | 1697504640 | 0.330988575 | q76 | 36.8 | 10 | 0.27173913 | +| q77 | 6024270336 | 2609286912 | 0.43312912 | q77 | 33.3 | 14.1 | 0.423423423 | +| q78 | 90786725888 | 60526923776 | 0.666693541 | q78 | 377 | 257.2 | 0.682228117 | +| q79 | 5194788864 | 1966597504 | 0.37857121 | q79 | 25.4 | 12.2 | 0.480314961 | +| q80 | 86372556800 | 51899830272 | 0.600883338 | q80 | 351.9 | 213.3 | 0.606138107 | +| q81 | 537159104 | 302697664 | 0.563515841 | q81 | 9.4 | 6.4 | 0.680851064 | +| q82 | 14299611136 | 3833022464 | 0.268050818 | q82 | 83.6 | 97.2 | 1.162679426 | +| q83 | 370437344 | 157327376 | 0.424707116 | q83 | 13.5 | 6.3 | 0.466666667 | +| q84 | 719424896 | 130134840 | 0.180887318 | q84 | 12.9 | 3 | 0.23255814 | +| q85 | 2387102720 | 838269312 | 0.351165999 | q85 | 28.9 | 15.1 | 0.522491349 | +| q86 | 810701824 | 347078592 | 0.428121144 | q86 | 35.8 | 4.1 | 0.11452514 | +| q87 | 4160053504 | 2024300416 | 0.486604418 | q87 | 30.6 | 17.6 | 0.575163399 | +| q88 | 14849074176 | 4215600128 | 0.283896496 | q88 | 61.4 | 20.6 | 0.335504886 | +| q89 | 3119070464 | 1177439232 | 0.377496836 | q89 | 15.7 | 8 | 0.50955414 | +| q90 | 947142592 | 203079744 | 0.214413063 | q90 | 7.5 | 2.5 | 0.333333333 | +| q91 | 140899136 | 51663664 | 0.366671262 | q91 | 5.3 | 3.3 | 0.622641509 | +| q92 | 1332381184 | 414574112 | 0.311152782 | q92 | 9.2 | 4.2 | 0.456521739 | +| q93 | 45288034304 | 18319222784 | 0.404504701 | q93 | 200.3 | 82.3 | 0.410883674 | +| q94 | 16076772352 | 7943606784 | 0.494104576 | q94 | 82.9 | 41.9 | 0.505428227 | +| q95 | 23590234112 | 23093725184 | 0.978952777 | q95 | 120.8 | 131.3 | 1.08692053 | +| q96 | 1928228480 | 512737312 | 0.265911077 | q96 | 9.8 | 3.4 | 0.346938776 | +| q97 | 10208055296 | 5102495232 | 0.499849882 | q97 | 56.9 | 33 | 0.579964851 | +| q98 | 2648099584 | 1700242048 | 0.642061219 | q98 | 15.4 | 10.4 | 0.675324675 | +| q99 | 1629526400 | 1546940288 | 0.949318948 | q99 | 8.7 | 8.9 | 1.022988506 | +| | | | | | | | | +| sum | 1.50781E+12 | 8.1238E+11 | | | 7367.7 | 4273.8 | | diff --git a/benchmark-results/blaze-cluster-resources-cost-comparison-20231108.png b/benchmark-results/blaze-cluster-resources-cost-comparison-20231108.png new file mode 100644 index 000000000..26b40a0cd Binary files /dev/null and b/benchmark-results/blaze-cluster-resources-cost-comparison-20231108.png differ diff --git a/benchmark-results/blaze-executor-time-comparison-20230925.png b/benchmark-results/blaze-executor-time-comparison-20230925.png deleted file mode 100644 index e70b0b577..000000000 Binary files a/benchmark-results/blaze-executor-time-comparison-20230925.png and /dev/null differ diff --git a/benchmark-results/blaze-query-time-comparison-20230925.png b/benchmark-results/blaze-query-time-comparison-20230925.png deleted file mode 100644 index a7cd9d078..000000000 Binary files a/benchmark-results/blaze-query-time-comparison-20230925.png and /dev/null differ diff --git a/benchmark-results/blaze-query-time-comparison-20231108.png b/benchmark-results/blaze-query-time-comparison-20231108.png new file mode 100644 index 000000000..4af395597 Binary files /dev/null and b/benchmark-results/blaze-query-time-comparison-20231108.png differ diff --git a/pom.xml b/pom.xml index 4080e4c23..c5a420ef8 100644 --- a/pom.xml +++ b/pom.xml @@ -13,7 +13,7 @@ - 2.0.6-SNAPSHOT + 2.0.7-SNAPSHOT UTF-8 13.0.0 3.21.9