Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feature](cooldown)backup cooldown data #45589

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

justfortaste
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Currently, backup/resore is not supported for cooldown data.

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Dec 18, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@justfortaste
Copy link
Contributor Author

run buildall

Copy link
Member

@xy720 xy720 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@xy720
Copy link
Member

xy720 commented Dec 18, 2024

this pr has been review in #43642

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Dec 18, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

Copy link
Contributor

@lide-reed lide-reed left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.86% (10132/26071)
Line Coverage: 29.77% (85141/286014)
Region Coverage: 28.83% (43686/151550)
Branch Coverage: 25.36% (22189/87492)
Coverage Report: http://coverage.selectdb-in.cc/coverage/60b9dc20b29139d4feef9fe05f83cdf78a15e895_60b9dc20b29139d4feef9fe05f83cdf78a15e895/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 39978 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 60b9dc20b29139d4feef9fe05f83cdf78a15e895, data reload: false

------ Round 1 ----------------------------------
q1	17591	7457	7281	7281
q2	2058	183	169	169
q3	10548	1114	1247	1114
q4	10559	754	721	721
q5	7646	2749	2734	2734
q6	244	150	148	148
q7	994	637	615	615
q8	9244	1872	1876	1872
q9	6664	6474	6429	6429
q10	7036	2326	2342	2326
q11	475	276	265	265
q12	424	226	229	226
q13	17782	2984	2950	2950
q14	249	213	214	213
q15	550	500	497	497
q16	661	582	575	575
q17	1001	544	591	544
q18	7208	6817	6669	6669
q19	1350	931	925	925
q20	481	183	183	183
q21	4028	3398	3209	3209
q22	388	319	313	313
Total cold run time: 107181 ms
Total hot run time: 39978 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7233	7283	7258	7258
q2	330	229	235	229
q3	2964	2887	2969	2887
q4	2072	1890	1852	1852
q5	5745	5709	5653	5653
q6	234	144	154	144
q7	2272	1839	1819	1819
q8	3405	3581	3549	3549
q9	8904	9119	9056	9056
q10	3585	3583	3563	3563
q11	619	526	514	514
q12	821	590	610	590
q13	12326	3117	3111	3111
q14	315	287	275	275
q15	567	509	511	509
q16	684	645	646	645
q17	1874	1648	1635	1635
q18	8200	7730	7649	7649
q19	1703	1567	1565	1565
q20	2151	1816	1921	1816
q21	5569	5513	5458	5458
q22	650	623	611	611
Total cold run time: 72223 ms
Total hot run time: 60388 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196585 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 60b9dc20b29139d4feef9fe05f83cdf78a15e895, data reload: false

query1	1281	937	975	937
query2	6243	2348	2315	2315
query3	10976	4708	4728	4708
query4	33743	23405	23456	23405
query5	5213	480	467	467
query6	283	199	188	188
query7	3992	304	305	304
query8	302	227	229	227
query9	9669	2736	2723	2723
query10	510	243	248	243
query11	18095	15187	15237	15187
query12	165	106	103	103
query13	1573	435	433	433
query14	10852	7358	7608	7358
query15	265	191	188	188
query16	8053	431	489	431
query17	1749	611	619	611
query18	2121	318	357	318
query19	372	184	170	170
query20	128	116	121	116
query21	202	114	110	110
query22	4855	4448	4529	4448
query23	34862	33763	34026	33763
query24	10644	2448	2557	2448
query25	623	397	395	395
query26	1134	153	156	153
query27	2523	344	337	337
query28	7548	2471	2477	2471
query29	833	419	425	419
query30	231	149	154	149
query31	1019	830	822	822
query32	93	57	59	57
query33	753	292	285	285
query34	1233	530	504	504
query35	904	751	778	751
query36	1125	973	954	954
query37	144	80	74	74
query38	4225	4084	4154	4084
query39	1498	1517	1435	1435
query40	207	106	100	100
query41	45	44	44	44
query42	119	111	104	104
query43	539	488	498	488
query44	1233	856	827	827
query45	186	171	175	171
query46	1213	720	732	720
query47	2017	1933	1922	1922
query48	425	333	327	327
query49	892	382	403	382
query50	856	408	399	399
query51	7410	7162	7270	7162
query52	110	94	90	90
query53	264	187	182	182
query54	1034	407	446	407
query55	89	82	84	82
query56	263	255	249	249
query57	1253	1142	1162	1142
query58	250	226	233	226
query59	3316	3186	3051	3051
query60	279	260	264	260
query61	116	103	105	103
query62	853	700	722	700
query63	219	194	195	194
query64	3918	667	649	649
query65	3326	3242	3242	3242
query66	759	312	325	312
query67	16376	15524	15610	15524
query68	5395	561	568	561
query69	472	259	254	254
query70	1202	1112	1127	1112
query71	470	254	261	254
query72	7065	4148	3985	3985
query73	791	364	374	364
query74	10297	8792	8854	8792
query75	3817	2649	2673	2649
query76	3506	1009	1117	1009
query77	711	369	294	294
query78	10167	9519	9298	9298
query79	2258	605	608	605
query80	869	422	446	422
query81	530	231	225	225
query82	1348	123	113	113
query83	187	144	138	138
query84	252	74	71	71
query85	1535	308	310	308
query86	448	305	292	292
query87	4602	4389	4344	4344
query88	3922	2216	2229	2216
query89	424	304	293	293
query90	2191	185	189	185
query91	142	105	105	105
query92	73	53	50	50
query93	2953	548	548	548
query94	907	294	301	294
query95	353	247	246	246
query96	637	280	283	280
query97	2852	2633	2694	2633
query98	218	196	192	192
query99	1585	1303	1316	1303
Total cold run time: 309780 ms
Total hot run time: 196585 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.1 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 60b9dc20b29139d4feef9fe05f83cdf78a15e895, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.07	0.07
query4	1.61	0.11	0.11
query5	0.41	0.44	0.43
query6	1.17	0.66	0.65
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.59	0.50	0.52
query10	0.54	0.57	0.57
query11	0.14	0.10	0.11
query12	0.13	0.11	0.11
query13	0.61	0.61	0.60
query14	2.75	2.76	2.84
query15	0.91	0.84	0.82
query16	0.39	0.40	0.38
query17	1.06	1.06	1.06
query18	0.21	0.22	0.21
query19	1.96	1.87	2.01
query20	0.01	0.02	0.01
query21	15.37	0.59	0.59
query22	2.61	2.10	2.43
query23	16.83	1.13	0.82
query24	2.94	0.97	2.20
query25	0.14	0.22	0.16
query26	0.51	0.14	0.14
query27	0.04	0.04	0.05
query28	9.83	1.12	1.07
query29	12.58	3.23	3.23
query30	0.25	0.06	0.07
query31	2.86	0.40	0.38
query32	3.28	0.46	0.45
query33	3.16	3.09	3.05
query34	16.81	4.44	4.59
query35	4.51	4.47	4.47
query36	0.69	0.48	0.48
query37	0.09	0.06	0.06
query38	0.04	0.03	0.03
query39	0.04	0.03	0.02
query40	0.17	0.13	0.12
query41	0.07	0.02	0.02
query42	0.03	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.78 s
Total hot run time: 33.1 s

@justfortaste
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.87% (10134/26072)
Line Coverage: 29.78% (85201/286070)
Region Coverage: 28.83% (43695/151579)
Branch Coverage: 25.37% (22200/87514)
Coverage Report: http://coverage.selectdb-in.cc/coverage/065de6ad1dc215830a95e325d1afbc3a08fcdc9f_065de6ad1dc215830a95e325d1afbc3a08fcdc9f/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 39738 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 065de6ad1dc215830a95e325d1afbc3a08fcdc9f, data reload: false

------ Round 1 ----------------------------------
q1	17580	7394	7251	7251
q2	2046	186	188	186
q3	10809	1089	1118	1089
q4	10529	746	736	736
q5	7621	2737	2601	2601
q6	238	147	144	144
q7	967	628	626	626
q8	9255	1898	1926	1898
q9	6792	6540	6525	6525
q10	7018	2278	2318	2278
q11	464	264	258	258
q12	429	222	224	222
q13	17785	2967	2934	2934
q14	239	207	209	207
q15	554	526	500	500
q16	669	579	579	579
q17	972	607	554	554
q18	7275	6602	6569	6569
q19	1350	959	948	948
q20	466	187	184	184
q21	3921	3143	3247	3143
q22	376	308	306	306
Total cold run time: 107355 ms
Total hot run time: 39738 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7239	7229	7229	7229
q2	330	230	227	227
q3	2887	2802	2915	2802
q4	2091	1817	1817	1817
q5	5679	5635	5632	5632
q6	222	141	142	141
q7	2219	1785	1785	1785
q8	3358	3551	3441	3441
q9	8906	8934	8950	8934
q10	3640	3524	3518	3518
q11	614	517	500	500
q12	843	597	596	596
q13	10883	3123	3058	3058
q14	313	280	279	279
q15	569	512	508	508
q16	682	645	649	645
q17	1835	1631	1634	1631
q18	8294	7767	7615	7615
q19	1749	1531	1501	1501
q20	2043	1840	1875	1840
q21	5621	5424	5510	5424
q22	616	583	567	567
Total cold run time: 70633 ms
Total hot run time: 59690 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196578 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 065de6ad1dc215830a95e325d1afbc3a08fcdc9f, data reload: false

query1	1266	973	905	905
query2	6245	2399	2247	2247
query3	11119	4686	4745	4686
query4	33215	23353	23286	23286
query5	4034	464	442	442
query6	275	190	188	188
query7	3980	293	303	293
query8	292	219	226	219
query9	9462	2668	2663	2663
query10	467	237	247	237
query11	17902	15324	15275	15275
query12	155	100	102	100
query13	1559	408	413	408
query14	9717	7098	6707	6707
query15	266	198	198	198
query16	8333	462	485	462
query17	1614	577	575	575
query18	2185	309	313	309
query19	368	156	158	156
query20	123	116	111	111
query21	212	110	108	108
query22	5004	4731	4547	4547
query23	34597	33932	33802	33802
query24	10440	2504	2446	2446
query25	645	395	385	385
query26	1246	149	149	149
query27	2465	319	338	319
query28	7536	2424	2438	2424
query29	843	420	409	409
query30	231	156	147	147
query31	1016	819	846	819
query32	101	55	63	55
query33	754	298	315	298
query34	1162	514	517	514
query35	891	787	748	748
query36	1123	954	961	954
query37	152	74	83	74
query38	4235	4173	4275	4173
query39	1519	1485	1471	1471
query40	206	100	101	100
query41	46	41	44	41
query42	108	101	105	101
query43	533	482	493	482
query44	1288	817	810	810
query45	189	169	165	165
query46	1174	715	719	715
query47	2070	1976	1987	1976
query48	408	320	317	317
query49	925	377	406	377
query50	837	415	393	393
query51	7387	7279	7320	7279
query52	106	91	91	91
query53	253	181	183	181
query54	1168	420	474	420
query55	79	78	78	78
query56	265	242	224	224
query57	1318	1178	1141	1141
query58	237	215	225	215
query59	3268	3102	3200	3102
query60	288	251	244	244
query61	109	105	109	105
query62	883	704	676	676
query63	219	187	186	186
query64	4080	732	649	649
query65	3299	3285	3267	3267
query66	817	322	310	310
query67	16428	15567	15550	15550
query68	4613	548	538	538
query69	470	269	252	252
query70	1164	1100	1128	1100
query71	430	244	260	244
query72	6675	4207	4134	4134
query73	776	356	350	350
query74	10188	8859	8776	8776
query75	3472	2649	2651	2649
query76	3297	1010	1165	1010
query77	573	275	260	260
query78	10215	11004	10046	10046
query79	1104	601	580	580
query80	779	413	420	413
query81	500	226	224	224
query82	212	121	119	119
query83	200	144	138	138
query84	288	68	78	68
query85	754	305	307	305
query86	407	303	300	300
query87	4774	4538	4342	4342
query88	3857	2166	2173	2166
query89	395	287	294	287
query90	2053	185	184	184
query91	133	101	106	101
query92	60	50	50	50
query93	1060	525	524	524
query94	775	276	268	268
query95	342	243	242	242
query96	605	282	280	280
query97	2852	2675	2661	2661
query98	209	191	200	191
query99	1576	1272	1312	1272
Total cold run time: 299545 ms
Total hot run time: 196578 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.71 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 065de6ad1dc215830a95e325d1afbc3a08fcdc9f, data reload: false

query1	0.04	0.02	0.03
query2	0.08	0.04	0.03
query3	0.23	0.08	0.06
query4	1.61	0.10	0.11
query5	0.43	0.40	0.42
query6	1.18	0.65	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.57	0.51	0.49
query10	0.55	0.57	0.56
query11	0.14	0.11	0.10
query12	0.12	0.11	0.11
query13	0.62	0.61	0.60
query14	2.74	2.70	2.84
query15	0.89	0.83	0.82
query16	0.38	0.38	0.37
query17	0.99	0.97	1.00
query18	0.22	0.21	0.20
query19	1.94	1.83	1.97
query20	0.02	0.02	0.01
query21	15.36	0.60	0.60
query22	2.96	2.66	2.61
query23	16.95	0.96	0.78
query24	3.08	1.16	2.07
query25	0.32	0.15	0.05
query26	0.45	0.14	0.13
query27	0.04	0.04	0.04
query28	9.69	1.11	1.07
query29	12.59	3.45	3.41
query30	0.25	0.07	0.07
query31	2.85	0.39	0.38
query32	3.27	0.47	0.45
query33	3.08	3.12	3.13
query34	17.01	4.52	4.50
query35	4.51	4.47	4.53
query36	0.66	0.47	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.02	0.03
query40	0.17	0.13	0.13
query41	0.07	0.03	0.03
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.37 s
Total hot run time: 33.71 s

@justfortaste
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 39819 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 97a37a6cabce7490f08c7ba17dcea5382a70cecd, data reload: false

------ Round 1 ----------------------------------
q1	17586	8115	7323	7323
q2	2052	195	173	173
q3	10574	1097	1284	1097
q4	10531	754	731	731
q5	7606	2704	2696	2696
q6	241	147	145	145
q7	985	625	603	603
q8	9249	1858	1930	1858
q9	6613	6378	6490	6378
q10	7060	2299	2317	2299
q11	463	256	258	256
q12	431	227	213	213
q13	17797	2921	2956	2921
q14	250	210	208	208
q15	573	526	496	496
q16	686	588	615	588
q17	981	587	524	524
q18	7266	6664	6750	6664
q19	1338	966	926	926
q20	476	178	182	178
q21	4065	3489	3227	3227
q22	372	315	316	315
Total cold run time: 107195 ms
Total hot run time: 39819 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7335	7252	7250	7250
q2	339	232	231	231
q3	2899	2872	2952	2872
q4	2094	1809	1837	1809
q5	5642	5658	5679	5658
q6	228	140	140	140
q7	2236	1849	1777	1777
q8	3409	3558	3558	3558
q9	8924	8981	8917	8917
q10	3566	3522	3581	3522
q11	603	519	507	507
q12	822	614	648	614
q13	12536	3052	3075	3052
q14	306	281	287	281
q15	561	514	507	507
q16	690	668	672	668
q17	1873	1619	1605	1605
q18	8438	7872	7709	7709
q19	1731	1675	1440	1440
q20	2090	1896	1913	1896
q21	5740	5476	5658	5476
q22	660	566	616	566
Total cold run time: 72722 ms
Total hot run time: 60055 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.87% (10133/26068)
Line Coverage: 29.81% (85277/286090)
Region Coverage: 28.91% (43497/150448)
Branch Coverage: 25.44% (22181/87182)
Coverage Report: http://coverage.selectdb-in.cc/coverage/97a37a6cabce7490f08c7ba17dcea5382a70cecd_97a37a6cabce7490f08c7ba17dcea5382a70cecd/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 198645 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 97a37a6cabce7490f08c7ba17dcea5382a70cecd, data reload: false

query1	1352	1051	955	955
query2	6210	2351	2449	2351
query3	11098	4898	4867	4867
query4	33028	23509	23498	23498
query5	4143	492	492	492
query6	293	193	193	193
query7	3986	320	324	320
query8	312	253	248	248
query9	9524	2656	2654	2654
query10	474	254	259	254
query11	17822	15299	15385	15299
query12	159	112	104	104
query13	1648	424	426	424
query14	10486	7750	7783	7750
query15	301	205	192	192
query16	8074	448	463	448
query17	1821	638	578	578
query18	2202	312	318	312
query19	365	155	163	155
query20	124	112	118	112
query21	206	106	109	106
query22	4905	4658	4546	4546
query23	35017	34168	34478	34168
query24	10397	2710	2553	2553
query25	622	388	396	388
query26	1178	154	156	154
query27	2192	341	336	336
query28	7053	2497	2426	2426
query29	841	428	411	411
query30	231	157	151	151
query31	1077	875	834	834
query32	107	57	55	55
query33	784	313	303	303
query34	989	537	547	537
query35	900	795	787	787
query36	1119	971	972	971
query37	147	78	76	76
query38	4272	4229	4192	4192
query39	1518	1478	1447	1447
query40	212	112	107	107
query41	48	44	45	44
query42	117	112	107	107
query43	546	508	513	508
query44	1339	840	855	840
query45	197	170	197	170
query46	1231	754	735	735
query47	2038	1876	1911	1876
query48	433	332	338	332
query49	884	392	407	392
query50	862	417	407	407
query51	7389	7319	7232	7232
query52	103	95	95	95
query53	272	201	189	189
query54	1154	437	427	427
query55	83	80	83	80
query56	277	240	250	240
query57	1322	1185	1182	1182
query58	244	222	248	222
query59	3393	3309	3121	3121
query60	273	243	249	243
query61	104	110	104	104
query62	890	666	681	666
query63	224	190	191	190
query64	3845	672	626	626
query65	3338	3204	3228	3204
query66	753	292	313	292
query67	16209	15599	15602	15599
query68	4857	575	573	573
query69	458	265	263	263
query70	1257	1081	1113	1081
query71	399	246	258	246
query72	6940	4123	4289	4123
query73	815	377	385	377
query74	10224	8966	8902	8902
query75	3405	2638	2664	2638
query76	2744	1042	1176	1042
query77	484	279	269	269
query78	10379	9428	9616	9428
query79	1470	621	610	610
query80	1021	434	420	420
query81	541	235	230	230
query82	900	116	114	114
query83	249	149	148	148
query84	227	68	80	68
query85	1202	315	299	299
query86	366	290	287	287
query87	4666	4316	4262	4262
query88	3400	2278	2232	2232
query89	440	294	296	294
query90	2061	194	193	193
query91	144	111	104	104
query92	63	50	51	50
query93	1510	558	555	555
query94	1024	284	285	284
query95	356	254	264	254
query96	680	279	278	278
query97	2875	2730	2617	2617
query98	224	197	198	197
query99	1587	1340	1330	1330
Total cold run time: 301725 ms
Total hot run time: 198645 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.38 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 97a37a6cabce7490f08c7ba17dcea5382a70cecd, data reload: false

query1	0.04	0.03	0.04
query2	0.07	0.03	0.03
query3	0.25	0.07	0.07
query4	1.61	0.10	0.11
query5	0.42	0.42	0.42
query6	1.14	0.64	0.66
query7	0.03	0.02	0.01
query8	0.04	0.03	0.03
query9	0.59	0.50	0.50
query10	0.56	0.56	0.54
query11	0.14	0.10	0.11
query12	0.14	0.11	0.11
query13	0.60	0.60	0.61
query14	2.71	2.83	2.72
query15	0.90	0.82	0.82
query16	0.36	0.38	0.39
query17	0.97	1.07	1.05
query18	0.22	0.21	0.21
query19	2.00	1.83	1.92
query20	0.01	0.01	0.02
query21	15.36	0.61	0.60
query22	2.91	2.85	2.29
query23	17.04	0.94	0.99
query24	2.95	0.98	1.24
query25	0.20	0.14	0.11
query26	0.44	0.14	0.14
query27	0.04	0.05	0.05
query28	10.70	1.10	1.08
query29	12.62	3.23	3.24
query30	0.25	0.06	0.07
query31	2.85	0.38	0.38
query32	3.25	0.47	0.46
query33	3.12	3.06	3.11
query34	16.97	4.47	4.56
query35	4.51	4.52	4.51
query36	0.65	0.50	0.50
query37	0.10	0.06	0.06
query38	0.04	0.04	0.03
query39	0.04	0.02	0.02
query40	0.16	0.13	0.13
query41	0.07	0.03	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 107.14 s
Total hot run time: 33.38 s

@justfortaste
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.86% (10131/26068)
Line Coverage: 29.80% (85248/286090)
Region Coverage: 28.90% (43481/150448)
Branch Coverage: 25.43% (22170/87182)
Coverage Report: http://coverage.selectdb-in.cc/coverage/4b72d138b06f38cba8a0a0cfbbdb07f36b92c9ee_4b72d138b06f38cba8a0a0cfbbdb07f36b92c9ee/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 39571 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4b72d138b06f38cba8a0a0cfbbdb07f36b92c9ee, data reload: false

------ Round 1 ----------------------------------
q1	17608	7459	7301	7301
q2	2051	176	164	164
q3	10625	1054	1170	1054
q4	10571	711	721	711
q5	7636	2658	2747	2658
q6	242	149	145	145
q7	989	626	607	607
q8	9239	1891	1904	1891
q9	6595	6411	6327	6327
q10	7059	2288	2307	2288
q11	466	257	262	257
q12	427	227	216	216
q13	17791	2933	2948	2933
q14	240	218	209	209
q15	553	514	485	485
q16	666	585	556	556
q17	976	584	577	577
q18	7107	6632	6781	6632
q19	1350	1031	902	902
q20	476	179	184	179
q21	4018	3235	3174	3174
q22	378	319	305	305
Total cold run time: 107063 ms
Total hot run time: 39571 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7240	7229	7256	7229
q2	328	228	229	228
q3	2907	2814	2903	2814
q4	2045	1788	1755	1755
q5	5676	5672	5675	5672
q6	238	146	142	142
q7	2266	1774	1892	1774
q8	3409	3562	3519	3519
q9	8892	8879	8958	8879
q10	3591	3541	3573	3541
q11	590	511	503	503
q12	831	599	574	574
q13	12466	3133	3108	3108
q14	305	284	262	262
q15	564	507	513	507
q16	707	627	651	627
q17	1835	1609	1583	1583
q18	8324	7708	7571	7571
q19	2002	1541	1458	1458
q20	2071	1837	1841	1837
q21	5729	5499	5465	5465
q22	648	601	593	593
Total cold run time: 72664 ms
Total hot run time: 59641 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195196 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4b72d138b06f38cba8a0a0cfbbdb07f36b92c9ee, data reload: false

query1	1282	992	919	919
query2	6225	2451	2280	2280
query3	11106	4907	4808	4808
query4	32980	23231	23335	23231
query5	4304	476	450	450
query6	288	194	179	179
query7	3984	303	306	303
query8	304	248	237	237
query9	9248	2648	2640	2640
query10	456	245	247	245
query11	18003	15207	15039	15039
query12	157	105	103	103
query13	1582	453	428	428
query14	9529	6551	6587	6551
query15	255	195	192	192
query16	8296	478	439	439
query17	1647	583	598	583
query18	2150	320	317	317
query19	383	157	154	154
query20	130	120	113	113
query21	204	108	107	107
query22	4661	4427	4625	4427
query23	35256	33696	33444	33444
query24	10474	2484	2439	2439
query25	664	394	407	394
query26	1223	163	145	145
query27	2460	342	353	342
query28	7626	2444	2399	2399
query29	834	409	436	409
query30	228	154	147	147
query31	1053	818	806	806
query32	97	55	58	55
query33	751	302	307	302
query34	1193	517	507	507
query35	892	741	803	741
query36	1132	999	973	973
query37	163	80	85	80
query38	4350	4165	4201	4165
query39	1478	1476	1415	1415
query40	205	105	113	105
query41	51	48	42	42
query42	120	99	98	98
query43	561	515	511	511
query44	1381	869	841	841
query45	189	169	170	169
query46	1208	743	715	715
query47	2086	1942	1947	1942
query48	416	325	328	325
query49	904	391	389	389
query50	845	397	382	382
query51	7356	7190	7159	7159
query52	107	94	96	94
query53	271	183	179	179
query54	1181	412	408	408
query55	84	98	80	80
query56	262	255	255	255
query57	1306	1169	1171	1169
query58	231	222	219	219
query59	3366	3156	3134	3134
query60	272	265	253	253
query61	106	112	107	107
query62	887	721	690	690
query63	221	194	187	187
query64	3929	689	708	689
query65	3285	3248	3266	3248
query66	864	297	301	297
query67	16616	15612	15548	15548
query68	5864	542	548	542
query69	500	256	246	246
query70	1194	1134	1126	1126
query71	519	251	245	245
query72	6938	4158	4085	4085
query73	791	363	360	360
query74	10228	8837	8864	8837
query75	4060	2622	2628	2622
query76	4265	1052	1115	1052
query77	675	300	267	267
query78	10118	9282	9334	9282
query79	1533	607	601	601
query80	725	446	415	415
query81	498	239	219	219
query82	226	112	118	112
query83	161	147	145	145
query84	272	73	66	66
query85	1006	303	301	301
query86	362	253	290	253
query87	4783	4512	4398	4398
query88	4345	2219	2198	2198
query89	435	288	291	288
query90	2103	192	182	182
query91	134	102	103	102
query92	65	49	51	49
query93	4355	546	537	537
query94	868	284	324	284
query95	350	268	243	243
query96	644	282	274	274
query97	2766	2634	2661	2634
query98	213	204	202	202
query99	1550	1286	1331	1286
Total cold run time: 307904 ms
Total hot run time: 195196 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.46 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4b72d138b06f38cba8a0a0cfbbdb07f36b92c9ee, data reload: false

query1	0.03	0.03	0.03
query2	0.08	0.03	0.03
query3	0.23	0.07	0.07
query4	1.61	0.10	0.10
query5	0.43	0.42	0.41
query6	1.17	0.66	0.66
query7	0.03	0.02	0.01
query8	0.04	0.04	0.03
query9	0.59	0.50	0.50
query10	0.56	0.56	0.55
query11	0.15	0.10	0.10
query12	0.13	0.11	0.11
query13	0.60	0.60	0.59
query14	2.72	2.73	2.83
query15	0.91	0.83	0.83
query16	0.38	0.38	0.38
query17	1.03	1.05	1.06
query18	0.23	0.21	0.22
query19	1.94	1.85	1.93
query20	0.02	0.01	0.01
query21	15.36	0.61	0.59
query22	2.52	2.83	1.50
query23	16.92	0.99	0.82
query24	3.28	1.50	1.00
query25	0.26	0.15	0.12
query26	0.56	0.13	0.14
query27	0.05	0.04	0.04
query28	10.16	1.10	1.08
query29	12.55	3.25	3.24
query30	0.24	0.06	0.06
query31	2.85	0.39	0.39
query32	3.24	0.47	0.46
query33	3.03	3.05	3.08
query34	17.10	4.50	4.50
query35	4.51	4.47	4.45
query36	0.67	0.50	0.48
query37	0.09	0.06	0.06
query38	0.04	0.03	0.04
query39	0.03	0.02	0.02
query40	0.17	0.12	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 106.67 s
Total hot run time: 32.46 s

@justfortaste
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40040 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0b9ffbe9968fa1bd8916222011fd1b6e2b25c338, data reload: false

------ Round 1 ----------------------------------
q1	17601	8184	7311	7311
q2	2063	183	182	182
q3	10774	1123	1164	1123
q4	10581	800	738	738
q5	7625	2734	2754	2734
q6	241	149	145	145
q7	1010	623	611	611
q8	9278	1892	1983	1892
q9	6661	6514	6417	6417
q10	6997	2329	2332	2329
q11	474	269	262	262
q12	429	222	228	222
q13	17763	2930	2980	2930
q14	260	208	224	208
q15	571	513	502	502
q16	680	597	585	585
q17	993	551	552	551
q18	7327	6568	6580	6568
q19	1352	1064	972	972
q20	469	188	189	188
q21	4052	3456	3257	3257
q22	384	328	313	313
Total cold run time: 107585 ms
Total hot run time: 40040 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7222	7204	7191	7191
q2	330	223	228	223
q3	2965	2897	2929	2897
q4	2047	1853	1811	1811
q5	5651	5677	5656	5656
q6	226	144	145	144
q7	2270	1783	1808	1783
q8	3402	3571	3557	3557
q9	8891	9040	9044	9040
q10	3636	3538	3587	3538
q11	612	516	506	506
q12	802	619	593	593
q13	12853	3126	3028	3028
q14	315	285	266	266
q15	559	523	502	502
q16	704	662	636	636
q17	1862	1675	1645	1645
q18	8345	7864	7619	7619
q19	2621	1618	1527	1527
q20	2134	1911	1909	1909
q21	5586	5489	5436	5436
q22	655	610	606	606
Total cold run time: 73688 ms
Total hot run time: 60113 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.79% (10094/26021)
Line Coverage: 29.78% (85159/285963)
Region Coverage: 28.90% (43475/150458)
Branch Coverage: 25.43% (22160/87148)
Coverage Report: http://coverage.selectdb-in.cc/coverage/0b9ffbe9968fa1bd8916222011fd1b6e2b25c338_0b9ffbe9968fa1bd8916222011fd1b6e2b25c338/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 197503 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0b9ffbe9968fa1bd8916222011fd1b6e2b25c338, data reload: false

query1	1337	979	973	973
query2	6220	2452	2429	2429
query3	10992	4649	4977	4649
query4	33197	23493	23337	23337
query5	3957	479	463	463
query6	295	214	191	191
query7	3985	309	318	309
query8	292	233	227	227
query9	9581	2745	2756	2745
query10	457	251	249	249
query11	17768	15265	15269	15265
query12	160	108	102	102
query13	1560	418	415	415
query14	9871	7208	7826	7208
query15	297	200	192	192
query16	8335	447	495	447
query17	1802	607	614	607
query18	2164	335	343	335
query19	385	171	176	171
query20	126	119	118	118
query21	213	114	110	110
query22	4853	4608	4409	4409
query23	35296	34397	34000	34000
query24	10653	2612	2505	2505
query25	619	402	395	395
query26	1233	155	152	152
query27	2584	339	342	339
query28	7433	2551	2551	2551
query29	854	408	421	408
query30	234	155	151	151
query31	1058	860	844	844
query32	91	59	55	55
query33	770	311	300	300
query34	974	535	521	521
query35	874	749	774	749
query36	1130	996	985	985
query37	146	75	75	75
query38	4288	4279	4285	4279
query39	1515	1485	1482	1482
query40	209	105	106	105
query41	44	44	46	44
query42	115	102	101	101
query43	545	509	521	509
query44	1234	854	829	829
query45	191	171	173	171
query46	1192	737	745	737
query47	2019	1924	1947	1924
query48	441	327	332	327
query49	955	422	413	413
query50	821	403	383	383
query51	7274	7175	7208	7175
query52	111	99	94	94
query53	283	188	188	188
query54	1255	425	418	418
query55	84	81	83	81
query56	278	269	259	259
query57	1286	1187	1170	1170
query58	238	232	227	227
query59	3370	3039	3329	3039
query60	281	256	261	256
query61	111	108	118	108
query62	859	681	661	661
query63	227	188	187	187
query64	4003	672	661	661
query65	3270	3199	3199	3199
query66	724	302	304	302
query67	15992	15538	15475	15475
query68	5389	566	562	562
query69	481	252	268	252
query70	1217	1172	1118	1118
query71	474	254	247	247
query72	7134	4219	4075	4075
query73	804	432	364	364
query74	10033	8848	8955	8848
query75	3441	2611	2655	2611
query76	3740	1113	1122	1113
query77	582	287	269	269
query78	10243	9572	9354	9354
query79	2613	625	628	625
query80	1352	425	432	425
query81	523	227	228	227
query82	664	121	112	112
query83	198	150	144	144
query84	293	70	70	70
query85	1416	337	303	303
query86	398	317	283	283
query87	4524	4360	4365	4360
query88	4377	2204	2183	2183
query89	495	292	294	292
query90	2094	200	186	186
query91	142	111	104	104
query92	59	51	51	51
query93	5327	558	560	558
query94	861	290	287	287
query95	355	253	251	251
query96	682	282	280	280
query97	2929	2714	2652	2652
query98	217	198	203	198
query99	1611	1314	1332	1314
Total cold run time: 309679 ms
Total hot run time: 197503 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.84 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0b9ffbe9968fa1bd8916222011fd1b6e2b25c338, data reload: false

query1	0.04	0.04	0.06
query2	0.06	0.04	0.03
query3	0.23	0.07	0.08
query4	1.61	0.10	0.11
query5	0.42	0.40	0.41
query6	1.17	0.66	0.65
query7	0.02	0.02	0.01
query8	0.04	0.04	0.03
query9	0.58	0.51	0.50
query10	0.55	0.58	0.55
query11	0.15	0.10	0.10
query12	0.14	0.11	0.11
query13	0.60	0.60	0.60
query14	2.87	2.73	2.72
query15	0.89	0.83	0.83
query16	0.38	0.38	0.38
query17	1.02	1.06	1.00
query18	0.22	0.21	0.20
query19	1.90	1.83	2.02
query20	0.01	0.01	0.01
query21	15.37	0.58	0.59
query22	2.98	1.83	2.84
query23	17.35	0.98	0.76
query24	3.55	1.70	1.27
query25	0.20	0.10	0.07
query26	0.61	0.14	0.13
query27	0.05	0.03	0.04
query28	9.88	1.09	1.08
query29	12.61	3.22	3.25
query30	0.25	0.06	0.06
query31	2.87	0.40	0.38
query32	3.26	0.48	0.45
query33	3.05	3.10	3.18
query34	16.86	4.48	4.49
query35	4.50	4.46	4.50
query36	0.65	0.49	0.48
query37	0.10	0.06	0.06
query38	0.04	0.03	0.03
query39	0.04	0.03	0.02
query40	0.17	0.12	0.12
query41	0.08	0.03	0.02
query42	0.04	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 107.45 s
Total hot run time: 32.84 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants