Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[refactor](Nereids) refactor the parsing way of date series functions #46037

Merged
merged 1 commit into from
Dec 27, 2024
Merged

[refactor](Nereids) refactor the parsing way of date series functions #46037

merged 1 commit into from
Dec 27, 2024
+1,082 −370

Conversation

morrySnow
Copy link
Contributor

What problem does this PR solve?

Problem Summary:

Previously, we use specific syntex to process date_add, date_sub, etc.. In this way, we could not process quoted function name. From now on, we use generic way to parse these functions, and introduce a sepcific function binder to process them.

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Dec 26, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32409 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0dcd609b50f1f9d45bff644470b3ed04b7ffeb27, data reload: false

------ Round 1 ----------------------------------
q1	17626	6227	6079	6079
q2	2043	312	168	168
q3	10403	1261	744	744
q4	10217	870	429	429
q5	7537	2170	1944	1944
q6	208	186	145	145
q7	886	757	608	608
q8	9240	1342	1100	1100
q9	5195	4914	4913	4913
q10	6779	2294	1849	1849
q11	472	272	256	256
q12	338	362	217	217
q13	17770	3530	2957	2957
q14	236	231	212	212
q15	548	502	500	500
q16	648	621	590	590
q17	539	846	324	324
q18	7062	6395	6423	6395
q19	1221	958	544	544
q20	310	313	189	189
q21	2757	2163	1940	1940
q22	356	332	306	306
Total cold run time: 102391 ms
Total hot run time: 32409 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6225	6224	6266	6224
q2	237	326	230	230
q3	2246	2645	2303	2303
q4	1380	1806	1351	1351
q5	4334	4740	4626	4626
q6	180	178	146	146
q7	2138	2024	1809	1809
q8	2594	2765	2699	2699
q9	7369	7256	7184	7184
q10	3043	3298	2841	2841
q11	592	523	510	510
q12	633	736	586	586
q13	3341	3794	3068	3068
q14	273	295	277	277
q15	564	509	509	509
q16	670	676	643	643
q17	1194	1720	1246	1246
q18	7601	7387	7220	7220
q19	757	1103	1057	1057
q20	1972	2027	1798	1798
q21	5391	5082	4893	4893
q22	616	560	591	560
Total cold run time: 53350 ms
Total hot run time: 51780 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189477 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0dcd609b50f1f9d45bff644470b3ed04b7ffeb27, data reload: false

query1	972	388	380	380
query2	6516	2279	2329	2279
query3	6702	214	206	206
query4	33787	24096	23396	23396
query5	4400	618	442	442
query6	307	204	191	191
query7	4621	499	308	308
query8	306	257	245	245
query9	9526	2738	2739	2738
query10	480	331	255	255
query11	18370	15399	15173	15173
query12	167	105	104	104
query13	1681	547	431	431
query14	11899	6729	7012	6729
query15	241	191	195	191
query16	8130	564	458	458
query17	1581	815	565	565
query18	2133	436	287	287
query19	210	177	156	156
query20	118	110	110	110
query21	212	118	102	102
query22	4447	4274	4226	4226
query23	34377	33358	33380	33358
query24	6238	2334	2289	2289
query25	491	452	390	390
query26	1206	267	145	145
query27	2022	455	326	326
query28	5093	2497	2442	2442
query29	738	550	412	412
query30	228	178	157	157
query31	967	897	792	792
query32	92	62	62	62
query33	523	378	289	289
query34	805	821	508	508
query35	815	830	736	736
query36	1016	1027	968	968
query37	113	101	76	76
query38	4150	4139	4052	4052
query39	1510	1438	1428	1428
query40	207	114	99	99
query41	46	45	45	45
query42	122	105	105	105
query43	514	522	492	492
query44	1294	807	806	806
query45	172	174	173	173
query46	860	1039	650	650
query47	1880	1905	1896	1896
query48	376	398	320	320
query49	773	472	400	400
query50	616	671	373	373
query51	7114	7173	6997	6997
query52	103	100	90	90
query53	219	254	182	182
query54	472	492	408	408
query55	80	76	75	75
query56	259	261	230	230
query57	1209	1214	1136	1136
query58	227	232	222	222
query59	3034	3103	3088	3088
query60	272	258	236	236
query61	110	108	112	108
query62	858	804	745	745
query63	227	184	198	184
query64	4590	981	658	658
query65	3284	3197	3222	3197
query66	1044	420	314	314
query67	15867	15821	15468	15468
query68	9545	762	524	524
query69	534	286	251	251
query70	1211	1115	1157	1115
query71	439	281	257	257
query72	5825	3862	3936	3862
query73	1095	757	363	363
query74	10212	9030	8772	8772
query75	4622	3094	2624	2624
query76	5624	1216	772	772
query77	1003	362	266	266
query78	9995	10185	9417	9417
query79	5686	873	585	585
query80	712	519	425	425
query81	475	264	226	226
query82	231	145	122	122
query83	202	164	147	147
query84	289	95	71	71
query85	756	352	312	312
query86	347	306	308	306
query87	4493	4610	4370	4370
query88	4088	2277	2201	2201
query89	434	347	298	298
query90	2067	189	189	189
query91	132	139	103	103
query92	70	62	53	53
query93	3537	883	535	535
query94	662	417	282	282
query95	345	266	263	263
query96	476	610	292	292
query97	2729	2802	2710	2710
query98	220	196	198	196
query99	1616	1581	1469	1469
Total cold run time: 302691 ms
Total hot run time: 189477 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.83 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0dcd609b50f1f9d45bff644470b3ed04b7ffeb27, data reload: false

query1	0.03	0.03	0.04
query2	0.07	0.03	0.04
query3	0.24	0.07	0.07
query4	1.62	0.11	0.11
query5	0.43	0.42	0.41
query6	1.18	0.67	0.65
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.58	0.51	0.52
query10	0.55	0.56	0.55
query11	0.15	0.10	0.10
query12	0.13	0.11	0.10
query13	0.60	0.62	0.60
query14	2.84	2.77	2.75
query15	0.89	0.82	0.82
query16	0.38	0.39	0.39
query17	0.98	1.04	0.98
query18	0.23	0.21	0.22
query19	1.92	1.87	2.00
query20	0.01	0.02	0.01
query21	15.35	0.96	0.61
query22	0.77	1.02	0.83
query23	14.96	1.47	0.60
query24	2.99	1.07	1.35
query25	0.22	0.20	0.16
query26	0.26	0.14	0.15
query27	0.05	0.07	0.05
query28	14.02	1.49	1.05
query29	12.55	3.92	3.29
query30	0.25	0.09	0.06
query31	2.82	0.57	0.38
query32	3.24	0.55	0.47
query33	3.04	3.05	3.25
query34	16.94	5.13	4.56
query35	4.55	4.49	4.55
query36	0.67	0.51	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.04	0.03	0.02
query40	0.16	0.12	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.06 s
Total hot run time: 31.83 s

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32733 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 01b31130e4a6c6c1293997df1ea462112a3af82e, data reload: false

------ Round 1 ----------------------------------
q1	17574	6068	6029	6029
q2	2046	300	160	160
q3	10440	1218	739	739
q4	10199	863	438	438
q5	7527	2207	1990	1990
q6	204	178	144	144
q7	882	734	606	606
q8	9469	1367	1150	1150
q9	5280	4909	4978	4909
q10	7338	2331	1870	1870
q11	478	286	257	257
q12	349	372	225	225
q13	17777	3601	3015	3015
q14	254	229	221	221
q15	583	519	492	492
q16	625	608	588	588
q17	562	851	315	315
q18	6982	6585	6446	6446
q19	1375	981	579	579
q20	328	348	214	214
q21	3100	2316	2036	2036
q22	378	342	310	310
Total cold run time: 103750 ms
Total hot run time: 32733 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6258	6247	6258	6247
q2	247	328	242	242
q3	2379	2702	2340	2340
q4	1446	1842	1411	1411
q5	4558	4935	5129	4935
q6	190	180	148	148
q7	2117	2103	1912	1912
q8	2746	2887	2720	2720
q9	7768	7520	7371	7371
q10	3132	3339	2934	2934
q11	578	500	489	489
q12	667	766	583	583
q13	3485	3779	3079	3079
q14	296	304	271	271
q15	558	526	511	511
q16	649	715	647	647
q17	1211	1744	1263	1263
q18	7664	7434	7339	7339
q19	893	1172	1121	1121
q20	2010	2058	1932	1932
q21	5692	5347	4790	4790
q22	615	583	581	581
Total cold run time: 55159 ms
Total hot run time: 52866 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196058 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 01b31130e4a6c6c1293997df1ea462112a3af82e, data reload: false

query1	1302	935	909	909
query2	6502	2296	2189	2189
query3	11140	4825	5105	4825
query4	33123	23736	23454	23454
query5	3647	605	467	467
query6	287	223	182	182
query7	3974	509	304	304
query8	298	242	230	230
query9	9193	2723	2722	2722
query10	458	297	245	245
query11	17913	15243	15288	15243
query12	151	107	105	105
query13	1567	538	407	407
query14	9896	7597	6950	6950
query15	272	216	187	187
query16	8037	599	470	470
query17	1555	745	567	567
query18	2107	413	311	311
query19	216	178	172	172
query20	134	124	112	112
query21	202	125	109	109
query22	4470	4769	4421	4421
query23	36106	33613	33519	33519
query24	6567	2297	2280	2280
query25	514	456	374	374
query26	740	245	148	148
query27	2112	470	333	333
query28	5175	2496	2448	2448
query29	551	527	419	419
query30	209	183	156	156
query31	982	928	847	847
query32	72	59	58	58
query33	473	344	320	320
query34	768	871	529	529
query35	827	825	752	752
query36	1038	1027	953	953
query37	116	103	73	73
query38	4253	4183	4151	4151
query39	1519	1487	1460	1460
query40	213	132	106	106
query41	49	49	47	47
query42	134	110	110	110
query43	521	526	492	492
query44	1373	832	836	832
query45	189	176	171	171
query46	900	1070	668	668
query47	2019	2053	1958	1958
query48	397	418	326	326
query49	710	497	396	396
query50	642	662	385	385
query51	7433	7339	7318	7318
query52	101	102	93	93
query53	234	256	183	183
query54	488	495	413	413
query55	84	90	80	80
query56	283	243	242	242
query57	1255	1240	1177	1177
query58	232	228	230	228
query59	3176	3142	3090	3090
query60	300	276	254	254
query61	114	108	108	108
query62	847	824	770	770
query63	234	187	190	187
query64	3296	1057	663	663
query65	3315	3277	3282	3277
query66	695	417	309	309
query67	16688	15940	15666	15666
query68	9697	769	545	545
query69	499	286	252	252
query70	1243	1062	1157	1062
query71	448	291	260	260
query72	5838	3865	3792	3792
query73	929	744	360	360
query74	9855	8999	8660	8660
query75	4590	3147	2645	2645
query76	5601	1179	774	774
query77	991	371	265	265
query78	10154	10290	9465	9465
query79	2704	909	616	616
query80	636	511	437	437
query81	492	271	229	229
query82	627	147	117	117
query83	190	167	142	142
query84	278	90	68	68
query85	823	358	311	311
query86	339	317	274	274
query87	4539	4422	4316	4316
query88	3691	2247	2196	2196
query89	419	328	295	295
query90	1798	186	190	186
query91	194	131	101	101
query92	68	55	52	52
query93	1035	906	544	544
query94	653	394	277	277
query95	324	258	250	250
query96	494	599	284	284
query97	2720	2841	2684	2684
query98	208	204	197	197
query99	1655	1543	1452	1452
Total cold run time: 298120 ms
Total hot run time: 196058 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.44 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 01b31130e4a6c6c1293997df1ea462112a3af82e, data reload: false

query1	0.03	0.05	0.03
query2	0.08	0.04	0.03
query3	0.24	0.06	0.08
query4	1.61	0.11	0.10
query5	0.41	0.42	0.40
query6	1.18	0.65	0.65
query7	0.03	0.02	0.01
query8	0.04	0.03	0.04
query9	0.60	0.50	0.50
query10	0.56	0.57	0.56
query11	0.15	0.10	0.10
query12	0.14	0.11	0.11
query13	0.61	0.59	0.60
query14	2.69	2.73	2.80
query15	0.90	0.82	0.83
query16	0.39	0.39	0.37
query17	1.02	0.98	1.02
query18	0.22	0.21	0.22
query19	1.84	1.77	1.98
query20	0.01	0.01	0.01
query21	15.38	0.93	0.60
query22	0.74	0.85	0.77
query23	15.14	1.41	0.61
query24	2.94	0.94	1.70
query25	0.26	0.18	0.10
query26	0.32	0.15	0.14
query27	0.06	0.05	0.06
query28	14.01	1.52	1.04
query29	12.64	3.94	3.31
query30	0.25	0.09	0.06
query31	2.83	0.59	0.38
query32	3.24	0.54	0.47
query33	3.12	3.11	3.13
query34	16.60	5.10	4.51
query35	4.58	4.56	4.51
query36	0.62	0.50	0.48
query37	0.08	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.02	0.03
query40	0.16	0.12	0.12
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.95 s
Total hot run time: 31.44 s

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32945 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 64222a9a8161ecb58c31d33f49e28c1fe01364c0, data reload: false

------ Round 1 ----------------------------------
q1	17591	6227	6096	6096
q2	2048	300	187	187
q3	10514	1260	731	731
q4	10232	878	456	456
q5	7667	2213	1987	1987
q6	206	177	148	148
q7	885	754	620	620
q8	9247	1362	1179	1179
q9	5390	4917	4997	4917
q10	6804	2328	1861	1861
q11	469	298	254	254
q12	375	355	223	223
q13	17785	3572	3026	3026
q14	258	244	215	215
q15	566	502	504	502
q16	639	626	590	590
q17	591	851	321	321
q18	7118	6466	6463	6463
q19	3135	972	573	573
q20	309	315	188	188
q21	3012	2262	2099	2099
q22	378	340	309	309
Total cold run time: 105219 ms
Total hot run time: 32945 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6416	6265	6257	6257
q2	236	325	232	232
q3	2243	2659	2329	2329
q4	1371	1841	1396	1396
q5	4400	4797	5036	4797
q6	188	175	143	143
q7	2096	1999	1826	1826
q8	2618	2835	2721	2721
q9	7258	7137	7210	7137
q10	3058	3322	2816	2816
q11	576	519	501	501
q12	663	768	616	616
q13	3384	3742	3035	3035
q14	291	316	282	282
q15	575	491	507	491
q16	660	682	648	648
q17	1217	1748	1258	1258
q18	7676	7497	7356	7356
q19	828	1069	1084	1069
q20	1884	1971	1811	1811
q21	5442	5121	4940	4940
q22	632	604	554	554
Total cold run time: 53712 ms
Total hot run time: 52215 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190531 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 64222a9a8161ecb58c31d33f49e28c1fe01364c0, data reload: false

query1	973	404	389	389
query2	6526	2402	2451	2402
query3	6706	214	217	214
query4	34122	23466	23414	23414
query5	4323	601	444	444
query6	286	225	195	195
query7	4633	496	318	318
query8	316	248	250	248
query9	9459	2752	2729	2729
query10	466	302	250	250
query11	18000	15358	15268	15268
query12	157	105	104	104
query13	1672	559	424	424
query14	11122	7237	7171	7171
query15	214	196	185	185
query16	7516	561	418	418
query17	1551	724	537	537
query18	2010	382	299	299
query19	216	175	152	152
query20	119	113	108	108
query21	204	120	102	102
query22	4333	4223	4265	4223
query23	34304	34590	33215	33215
query24	6363	2285	2260	2260
query25	457	447	378	378
query26	1070	241	153	153
query27	2036	464	324	324
query28	5080	2456	2445	2445
query29	537	519	405	405
query30	223	181	186	181
query31	975	891	827	827
query32	75	61	57	57
query33	494	348	289	289
query34	777	838	499	499
query35	831	806	732	732
query36	1012	1055	981	981
query37	116	106	75	75
query38	4138	4254	4166	4166
query39	1488	1391	1452	1391
query40	204	112	97	97
query41	49	45	47	45
query42	121	96	99	96
query43	537	545	514	514
query44	1277	787	787	787
query45	180	168	172	168
query46	854	1031	643	643
query47	1919	1934	1877	1877
query48	381	401	312	312
query49	760	469	404	404
query50	618	663	372	372
query51	6994	7200	6999	6999
query52	102	98	89	89
query53	237	250	189	189
query54	480	477	397	397
query55	79	80	78	78
query56	264	258	229	229
query57	1190	1205	1121	1121
query58	246	232	271	232
query59	3212	3433	3234	3234
query60	264	262	247	247
query61	110	103	106	103
query62	885	798	711	711
query63	228	190	186	186
query64	4210	1014	640	640
query65	3257	3206	3200	3200
query66	1056	414	306	306
query67	15951	15832	15512	15512
query68	8469	763	503	503
query69	475	299	270	270
query70	1268	1137	1097	1097
query71	443	281	261	261
query72	5820	3799	3840	3799
query73	665	751	377	377
query74	9580	9567	9073	9073
query75	4573	3156	2673	2673
query76	4126	1192	850	850
query77	833	361	275	275
query78	10034	10007	9381	9381
query79	3445	908	576	576
query80	749	504	430	430
query81	488	266	227	227
query82	630	152	126	126
query83	196	167	146	146
query84	282	88	73	73
query85	787	377	314	314
query86	354	319	290	290
query87	4500	4833	4486	4486
query88	4246	2251	2209	2209
query89	408	320	314	314
query90	1918	184	190	184
query91	135	131	107	107
query92	65	58	52	52
query93	1392	873	528	528
query94	659	388	288	288
query95	341	268	257	257
query96	488	615	282	282
query97	2755	2809	2659	2659
query98	247	205	201	201
query99	1658	1601	1463	1463
Total cold run time: 292594 ms
Total hot run time: 190531 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.97 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 64222a9a8161ecb58c31d33f49e28c1fe01364c0, data reload: false

query1	0.03	0.03	0.03
query2	0.09	0.03	0.03
query3	0.24	0.07	0.07
query4	1.61	0.10	0.10
query5	0.43	0.41	0.43
query6	1.16	0.66	0.66
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.56	0.50	0.50
query10	0.55	0.58	0.56
query11	0.14	0.10	0.10
query12	0.14	0.11	0.11
query13	0.61	0.62	0.59
query14	2.70	2.81	2.86
query15	0.90	0.83	0.82
query16	0.37	0.38	0.38
query17	0.97	1.10	1.08
query18	0.22	0.20	0.21
query19	1.90	1.75	2.02
query20	0.02	0.01	0.02
query21	15.36	1.01	0.58
query22	0.77	0.89	0.64
query23	15.24	1.41	0.57
query24	3.34	0.63	0.76
query25	0.25	0.17	0.11
query26	0.44	0.14	0.13
query27	0.05	0.07	0.04
query28	12.94	1.56	1.05
query29	12.59	3.96	3.23
query30	0.25	0.09	0.06
query31	2.86	0.61	0.38
query32	3.23	0.54	0.46
query33	3.08	3.25	3.10
query34	16.89	5.06	4.49
query35	4.46	4.44	4.47
query36	0.65	0.49	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.18	0.15	0.12
query41	0.08	0.02	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.61 s
Total hot run time: 30.97 s

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32605 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7617f0b92c757ae017648d93dfee413655ca224d, data reload: false

------ Round 1 ----------------------------------
q1	17612	6135	6222	6135
q2	2047	295	166	166
q3	10429	1260	707	707
q4	10219	871	439	439
q5	7517	2176	1967	1967
q6	213	175	145	145
q7	902	739	614	614
q8	9243	1375	1203	1203
q9	5210	4893	4889	4889
q10	6740	2320	1878	1878
q11	474	281	265	265
q12	347	351	217	217
q13	17756	3630	2946	2946
q14	230	230	220	220
q15	560	503	507	503
q16	632	628	594	594
q17	561	850	324	324
q18	7208	6583	6403	6403
q19	1243	967	545	545
q20	324	327	197	197
q21	2782	2172	1930	1930
q22	360	338	318	318
Total cold run time: 102609 ms
Total hot run time: 32605 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6186	6160	6215	6160
q2	246	332	226	226
q3	2273	2667	2324	2324
q4	1430	1866	1396	1396
q5	4346	4740	4730	4730
q6	181	181	141	141
q7	2107	1997	1894	1894
q8	2589	2764	2661	2661
q9	7294	7193	7251	7193
q10	3023	3310	2803	2803
q11	588	500	500	500
q12	657	780	655	655
q13	3387	3737	3089	3089
q14	286	323	289	289
q15	568	509	510	509
q16	658	695	642	642
q17	1205	1702	1264	1264
q18	7735	7532	7198	7198
q19	760	1118	1009	1009
q20	1871	1952	1838	1838
q21	5389	5087	4833	4833
q22	593	632	567	567
Total cold run time: 53372 ms
Total hot run time: 51921 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191042 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7617f0b92c757ae017648d93dfee413655ca224d, data reload: false

query1	973	386	367	367
query2	6516	2364	2346	2346
query3	6708	224	212	212
query4	34144	23621	23765	23621
query5	4305	619	462	462
query6	297	201	185	185
query7	4618	492	299	299
query8	324	253	245	245
query9	9486	2776	2750	2750
query10	470	328	260	260
query11	18268	15468	15062	15062
query12	157	110	111	110
query13	1702	542	424	424
query14	10509	7754	7590	7590
query15	235	195	194	194
query16	8064	642	454	454
query17	1656	768	557	557
query18	1324	358	297	297
query19	218	174	158	158
query20	135	111	111	111
query21	209	117	104	104
query22	4489	4554	4400	4400
query23	34387	33359	33465	33359
query24	6423	2292	2268	2268
query25	471	443	379	379
query26	756	270	153	153
query27	2015	462	323	323
query28	5351	2444	2442	2442
query29	513	524	426	426
query30	228	183	151	151
query31	968	911	800	800
query32	72	59	58	58
query33	504	354	286	286
query34	741	848	509	509
query35	786	812	725	725
query36	1007	1073	991	991
query37	112	97	82	82
query38	4254	4449	4084	4084
query39	1479	1444	1480	1444
query40	203	112	98	98
query41	50	43	46	43
query42	128	101	106	101
query43	545	535	494	494
query44	1279	802	800	800
query45	182	173	171	171
query46	857	1035	632	632
query47	1874	1920	1867	1867
query48	378	402	324	324
query49	729	489	384	384
query50	625	644	392	392
query51	7128	7284	7201	7201
query52	101	99	92	92
query53	213	250	181	181
query54	466	486	418	418
query55	77	79	76	76
query56	263	263	244	244
query57	1202	1180	1100	1100
query58	245	239	232	232
query59	3128	3156	3058	3058
query60	291	256	245	245
query61	112	110	108	108
query62	869	796	747	747
query63	226	190	190	190
query64	3048	977	634	634
query65	3277	3179	3202	3179
query66	881	411	310	310
query67	15956	15746	15684	15684
query68	9035	754	525	525
query69	467	290	250	250
query70	1208	1138	1165	1138
query71	423	281	254	254
query72	5933	3841	3895	3841
query73	661	751	360	360
query74	9444	9075	9025	9025
query75	4572	3092	2655	2655
query76	5424	1195	765	765
query77	1002	373	271	271
query78	9573	9634	9138	9138
query79	2147	928	593	593
query80	697	543	433	433
query81	469	272	235	235
query82	518	149	126	126
query83	166	166	143	143
query84	234	98	73	73
query85	770	380	302	302
query86	347	314	296	296
query87	4713	4450	4412	4412
query88	3166	2254	2220	2220
query89	402	338	292	292
query90	1978	187	187	187
query91	136	138	104	104
query92	67	59	51	51
query93	899	915	521	521
query94	658	407	285	285
query95	333	252	245	245
query96	487	599	284	284
query97	2746	2835	2708	2708
query98	235	209	199	199
query99	1638	1556	1418	1418
Total cold run time: 289755 ms
Total hot run time: 191042 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.62 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7617f0b92c757ae017648d93dfee413655ca224d, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.61	0.11	0.11
query5	0.43	0.42	0.41
query6	1.18	0.68	0.65
query7	0.01	0.02	0.01
query8	0.03	0.03	0.03
query9	0.58	0.51	0.50
query10	0.54	0.57	0.57
query11	0.15	0.10	0.10
query12	0.14	0.10	0.11
query13	0.59	0.60	0.59
query14	2.72	2.75	2.85
query15	0.88	0.82	0.82
query16	0.39	0.39	0.37
query17	1.06	1.07	1.05
query18	0.23	0.22	0.21
query19	1.92	1.85	1.94
query20	0.01	0.01	0.02
query21	15.36	0.94	0.60
query22	0.75	0.82	0.77
query23	15.17	1.37	0.60
query24	3.37	1.34	0.96
query25	0.17	0.20	0.13
query26	0.34	0.15	0.13
query27	0.05	0.07	0.04
query28	12.91	1.50	1.04
query29	12.58	3.94	3.26
query30	0.25	0.09	0.07
query31	2.84	0.58	0.38
query32	3.22	0.56	0.46
query33	3.22	3.15	3.12
query34	16.83	5.11	4.50
query35	4.60	4.50	4.64
query36	0.65	0.48	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.02	0.02
query40	0.15	0.13	0.13
query41	0.07	0.02	0.02
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.59 s
Total hot run time: 31.62 s

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32335 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b9d218ff71d4dac4fece77c02ce0ecd0757ef67e, data reload: false

------ Round 1 ----------------------------------
q1	17570	6364	5997	5997
q2	2043	303	167	167
q3	10461	1203	736	736
q4	10218	872	441	441
q5	7533	2157	1998	1998
q6	203	182	147	147
q7	888	774	602	602
q8	9244	1334	1147	1147
q9	4985	4883	4938	4883
q10	6722	2306	1857	1857
q11	480	279	260	260
q12	356	356	217	217
q13	17793	3597	2917	2917
q14	255	237	209	209
q15	572	497	516	497
q16	619	633	604	604
q17	555	843	322	322
q18	6907	6568	6353	6353
q19	2194	965	567	567
q20	301	309	186	186
q21	2774	2155	1923	1923
q22	388	343	305	305
Total cold run time: 103061 ms
Total hot run time: 32335 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6276	6199	6217	6199
q2	228	329	236	236
q3	2272	2672	2378	2378
q4	1405	1901	1380	1380
q5	4328	4735	4735	4735
q6	189	177	141	141
q7	2042	1923	1819	1819
q8	2612	2789	2687	2687
q9	7339	7256	7270	7256
q10	3088	3388	2885	2885
q11	603	525	489	489
q12	652	752	629	629
q13	3482	3754	3185	3185
q14	278	309	270	270
q15	564	526	512	512
q16	661	678	647	647
q17	1216	1759	1252	1252
q18	7662	7383	7255	7255
q19	835	1109	1106	1106
q20	1945	2033	1885	1885
q21	5726	5367	4842	4842
q22	644	620	609	609
Total cold run time: 54047 ms
Total hot run time: 52397 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197579 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b9d218ff71d4dac4fece77c02ce0ecd0757ef67e, data reload: false

query1	1279	963	899	899
query2	6499	2411	2468	2411
query3	11110	4892	5051	4892
query4	33314	23712	23909	23712
query5	4365	625	483	483
query6	280	202	187	187
query7	3981	475	303	303
query8	292	238	231	231
query9	9458	2749	2728	2728
query10	456	313	249	249
query11	18000	15473	15129	15129
query12	180	105	100	100
query13	1586	531	419	419
query14	10834	6850	7608	6850
query15	227	215	189	189
query16	8069	639	462	462
query17	1507	774	593	593
query18	2145	410	320	320
query19	203	185	159	159
query20	118	121	115	115
query21	206	125	109	109
query22	4591	4780	4582	4582
query23	34396	33894	33979	33894
query24	6446	2370	2356	2356
query25	485	472	396	396
query26	837	282	150	150
query27	2148	464	335	335
query28	5608	2503	2516	2503
query29	650	551	418	418
query30	205	181	156	156
query31	976	947	850	850
query32	87	60	56	56
query33	463	364	322	322
query34	755	856	521	521
query35	796	822	771	771
query36	1054	1057	997	997
query37	124	97	73	73
query38	4333	4161	4168	4161
query39	1520	1458	1458	1458
query40	217	123	104	104
query41	49	43	43	43
query42	121	106	102	102
query43	529	539	490	490
query44	1341	813	814	813
query45	193	181	170	170
query46	872	1057	658	658
query47	2009	2028	1982	1982
query48	389	421	321	321
query49	729	479	392	392
query50	636	681	395	395
query51	7188	7321	7164	7164
query52	108	97	91	91
query53	229	259	182	182
query54	471	499	408	408
query55	82	84	84	84
query56	278	245	242	242
query57	1267	1243	1175	1175
query58	252	240	230	230
query59	3210	3201	3178	3178
query60	289	281	274	274
query61	134	136	129	129
query62	869	825	783	783
query63	238	193	197	193
query64	3619	1010	682	682
query65	3355	3230	3281	3230
query66	817	423	298	298
query67	16448	16023	15625	15625
query68	10159	759	502	502
query69	477	294	250	250
query70	1172	1137	1139	1137
query71	435	305	257	257
query72	5886	3884	3816	3816
query73	789	820	370	370
query74	10199	9428	9177	9177
query75	4518	3163	2628	2628
query76	5589	1217	775	775
query77	1015	374	272	272
query78	9988	10118	9346	9346
query79	4323	879	579	579
query80	712	525	420	420
query81	573	267	226	226
query82	223	152	125	125
query83	186	160	139	139
query84	276	91	70	70
query85	753	359	305	305
query86	350	311	297	297
query87	4666	4453	4437	4437
query88	4030	2223	2221	2221
query89	446	346	297	297
query90	2159	190	188	188
query91	136	132	104	104
query92	70	56	52	52
query93	3093	908	514	514
query94	666	398	283	283
query95	335	265	252	252
query96	490	630	285	285
query97	2793	2856	2655	2655
query98	234	204	193	193
query99	1625	1534	1430	1430
Total cold run time: 303888 ms
Total hot run time: 197579 ms

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32326 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 368bb2d278b0c6ecf883bd4e93397945e4732df6, data reload: false

------ Round 1 ----------------------------------
q1	17572	6145	6054	6054
q2	2047	306	175	175
q3	10556	1229	724	724
q4	10213	873	432	432
q5	7513	2204	1949	1949
q6	206	184	146	146
q7	916	757	600	600
q8	9232	1353	1110	1110
q9	5151	4876	4909	4876
q10	6811	2299	1874	1874
q11	485	282	263	263
q12	337	356	226	226
q13	17803	3600	2964	2964
q14	228	241	233	233
q15	566	528	510	510
q16	650	607	597	597
q17	566	845	320	320
q18	6863	6496	6257	6257
q19	2667	961	576	576
q20	300	322	186	186
q21	2757	2135	1944	1944
q22	369	353	310	310
Total cold run time: 103808 ms
Total hot run time: 32326 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6302	6249	6241	6241
q2	231	326	229	229
q3	2238	2686	2318	2318
q4	1439	1850	1413	1413
q5	4374	4764	4754	4754
q6	194	174	144	144
q7	2098	1994	1808	1808
q8	2630	2812	2683	2683
q9	7259	7224	7312	7224
q10	3065	3350	2875	2875
q11	576	523	493	493
q12	638	740	588	588
q13	3390	3822	3115	3115
q14	306	306	277	277
q15	555	546	496	496
q16	668	683	643	643
q17	1197	1749	1271	1271
q18	7660	7473	7195	7195
q19	792	1073	1089	1073
q20	1974	2086	1880	1880
q21	5792	5302	4927	4927
q22	631	603	594	594
Total cold run time: 54009 ms
Total hot run time: 52241 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196474 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 368bb2d278b0c6ecf883bd4e93397945e4732df6, data reload: false

query1	1301	936	939	936
query2	6495	2269	2313	2269
query3	10987	4767	4655	4655
query4	33658	24240	23446	23446
query5	3867	623	480	480
query6	279	202	188	188
query7	3986	508	309	309
query8	313	260	242	242
query9	9646	2754	2754	2754
query10	473	310	247	247
query11	17945	15333	15226	15226
query12	158	108	104	104
query13	1561	514	383	383
query14	10971	7807	7158	7158
query15	224	209	189	189
query16	7925	640	475	475
query17	1558	764	586	586
query18	2085	405	321	321
query19	213	192	170	170
query20	119	125	112	112
query21	206	132	106	106
query22	4633	4662	4294	4294
query23	34707	33449	33731	33449
query24	6622	2258	2369	2258
query25	461	481	397	397
query26	797	282	157	157
query27	2261	490	332	332
query28	5115	2476	2486	2476
query29	619	560	425	425
query30	205	185	149	149
query31	982	900	851	851
query32	74	64	58	58
query33	517	364	294	294
query34	778	875	555	555
query35	813	832	765	765
query36	1017	1078	947	947
query37	114	94	78	78
query38	4428	4309	4449	4309
query39	1515	1477	1466	1466
query40	210	118	107	107
query41	46	46	43	43
query42	122	106	104	104
query43	538	533	485	485
query44	1307	818	834	818
query45	185	177	165	165
query46	911	1069	692	692
query47	2002	1981	1931	1931
query48	395	423	319	319
query49	722	491	414	414
query50	677	694	428	428
query51	7302	7317	7207	7207
query52	104	112	92	92
query53	230	256	184	184
query54	499	499	423	423
query55	85	76	82	76
query56	255	269	236	236
query57	1270	1250	1167	1167
query58	236	226	230	226
query59	3249	3553	3192	3192
query60	282	270	253	253
query61	109	106	104	104
query62	848	813	737	737
query63	230	190	201	190
query64	3302	1034	676	676
query65	3317	3313	3281	3281
query66	776	403	316	316
query67	16398	15868	15489	15489
query68	7801	775	508	508
query69	496	303	264	264
query70	1223	1168	1147	1147
query71	442	299	268	268
query72	6398	3804	3755	3755
query73	652	782	363	363
query74	10381	9193	9045	9045
query75	4032	3157	2624	2624
query76	3687	1192	748	748
query77	755	364	271	271
query78	10126	10138	9413	9413
query79	3813	937	608	608
query80	730	526	433	433
query81	493	262	229	229
query82	642	155	114	114
query83	197	170	147	147
query84	272	97	74	74
query85	782	353	305	305
query86	363	309	289	289
query87	4645	4362	4330	4330
query88	4217	2271	2204	2204
query89	413	339	300	300
query90	1917	189	188	188
query91	139	133	105	105
query92	64	57	51	51
query93	2140	896	518	518
query94	651	397	291	291
query95	336	271	257	257
query96	499	610	282	282
query97	2780	2835	2726	2726
query98	247	201	194	194
query99	1691	1611	1452	1452
Total cold run time: 298259 ms
Total hot run time: 196474 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.18 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 368bb2d278b0c6ecf883bd4e93397945e4732df6, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.04	0.03
query3	0.24	0.07	0.07
query4	1.62	0.11	0.11
query5	0.43	0.42	0.40
query6	1.15	0.66	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.60	0.50	0.50
query10	0.56	0.56	0.56
query11	0.14	0.11	0.11
query12	0.15	0.11	0.11
query13	0.62	0.60	0.61
query14	2.86	2.71	2.85
query15	0.91	0.84	0.83
query16	0.38	0.38	0.38
query17	1.05	1.06	1.05
query18	0.22	0.22	0.22
query19	1.97	1.90	2.04
query20	0.01	0.01	0.01
query21	15.38	0.92	0.58
query22	0.74	0.86	0.82
query23	15.09	1.52	0.52
query24	2.93	2.40	1.64
query25	0.14	0.10	0.06
query26	0.35	0.17	0.14
query27	0.05	0.04	0.05
query28	14.33	1.45	1.04
query29	12.59	3.93	3.24
query30	0.25	0.09	0.06
query31	2.83	0.60	0.37
query32	3.23	0.56	0.46
query33	3.11	3.15	3.21
query34	16.66	5.05	4.50
query35	4.51	4.45	4.46
query36	0.65	0.49	0.48
query37	0.11	0.07	0.06
query38	0.04	0.04	0.03
query39	0.03	0.03	0.03
query40	0.17	0.15	0.12
query41	0.09	0.03	0.02
query42	0.04	0.02	0.03
query43	0.03	0.03	0.03
Total cold run time: 106.43 s
Total hot run time: 32.18 s

@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Dec 27, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@morrySnow morrySnow merged commit 698211b into apache:master Dec 27, 2024
23 of 25 checks passed
@morrySnow morrySnow deleted the fix_quote_date_sub branch December 27, 2024 08:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@starocean999 starocean999 starocean999 approved these changes

@englefly englefly englefly approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.x dev/2.1.x-conflict dev/3.0.x dev/3.0.x-conflict reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@morrySnow @Thearas @doris-robot @englefly @starocean999