Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] backup privileges catalogs workloadgroups #46495

Open
wants to merge 6 commits into
base: master
Choose a base branch
from

Conversation

justfortaste
Copy link
Contributor

What problem does this PR solve?

https://doc.weixin.qq.com/doc/w3_AGkArQbjACc5rBcdFOxQcaBSzESxW?scode=AJEAIQdfAAosLUmBoQAGkArQbjACc

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@justfortaste justfortaste force-pushed the feature_backup_user_master_new branch from 90fd604 to 1e4e1a5 Compare January 7, 2025 02:36
@doris-robot
Copy link

TPC-H: Total hot run time: 33783 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 90fd604599fa0bd6ac4d9b7c9191771b39ed6348, data reload: false

------ Round 1 ----------------------------------
q1	17664	6127	6148	6127
q2	2716	324	180	180
q3	11211	1245	748	748
q4	10220	885	455	455
q5	7787	2194	2009	2009
q6	210	186	156	156
q7	918	740	629	629
q8	9344	1381	1182	1182
q9	5719	5008	5027	5008
q10	6766	2339	1888	1888
q11	497	286	260	260
q12	343	357	232	232
q13	17905	3679	3137	3137
q14	246	238	216	216
q15	578	527	492	492
q16	641	621	621	621
q17	623	865	353	353
q18	8588	7012	7099	7012
q19	6590	1057	575	575
q20	314	313	187	187
q21	2894	2257	2012	2012
q22	361	339	304	304
Total cold run time: 112135 ms
Total hot run time: 33783 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6840	6303	6239	6239
q2	240	327	234	234
q3	2226	2643	2295	2295
q4	1439	1851	1414	1414
q5	4619	4987	4937	4937
q6	190	182	152	152
q7	2097	1976	1863	1863
q8	2604	2808	2702	2702
q9	7421	7335	7223	7223
q10	2998	3380	2868	2868
q11	579	528	522	522
q12	674	780	628	628
q13	3527	3920	3197	3197
q14	297	293	265	265
q15	570	514	508	508
q16	644	680	660	660
q17	1230	1726	1270	1270
q18	7745	7467	7480	7467
q19	909	1140	1091	1091
q20	1983	2043	1962	1962
q21	5654	5301	5007	5007
q22	612	602	592	592
Total cold run time: 55098 ms
Total hot run time: 53096 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 198058 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 90fd604599fa0bd6ac4d9b7c9191771b39ed6348, data reload: false

query1	1304	985	941	941
query2	6377	2345	2308	2308
query3	11142	4818	4812	4812
query4	32820	23881	23275	23275
query5	4704	618	453	453
query6	280	205	193	193
query7	3992	515	307	307
query8	324	250	245	245
query9	9650	2762	2744	2744
query10	455	311	245	245
query11	18155	15292	15658	15292
query12	164	102	100	100
query13	1650	547	387	387
query14	10922	6861	7291	6861
query15	236	204	183	183
query16	8056	631	472	472
query17	1587	766	567	567
query18	2093	403	336	336
query19	189	194	189	189
query20	125	113	118	113
query21	204	137	115	115
query22	4606	4650	4408	4408
query23	34346	34655	34203	34203
query24	6587	2349	2423	2349
query25	439	444	396	396
query26	740	276	160	160
query27	2430	505	345	345
query28	5759	2527	2541	2527
query29	553	562	448	448
query30	214	188	160	160
query31	1000	935	862	862
query32	97	67	58	58
query33	492	369	312	312
query34	781	852	520	520
query35	811	841	793	793
query36	1070	1070	977	977
query37	121	96	73	73
query38	4183	4299	4343	4299
query39	1518	1467	1461	1461
query40	217	116	106	106
query41	44	42	48	42
query42	132	107	108	107
query43	539	538	501	501
query44	1406	845	840	840
query45	190	182	178	178
query46	908	1108	685	685
query47	2011	2081	1950	1950
query48	393	420	327	327
query49	705	489	424	424
query50	648	691	385	385
query51	7427	7392	7296	7296
query52	107	103	92	92
query53	240	254	186	186
query54	485	507	418	418
query55	79	80	82	80
query56	268	255	235	235
query57	1242	1227	1167	1167
query58	239	229	236	229
query59	3316	3335	3195	3195
query60	281	279	289	279
query61	124	109	107	107
query62	867	822	782	782
query63	234	190	199	190
query64	3772	1041	678	678
query65	3352	3241	3292	3241
query66	821	419	317	317
query67	16276	15807	15668	15668
query68	8836	695	520	520
query69	481	302	246	246
query70	1216	1175	1147	1147
query71	443	297	253	253
query72	6490	3945	3822	3822
query73	670	757	366	366
query74	10544	9243	9040	9040
query75	3885	3180	2660	2660
query76	3652	1208	774	774
query77	764	361	293	293
query78	10208	10176	9563	9563
query79	3578	820	578	578
query80	653	530	422	422
query81	505	268	229	229
query82	596	159	119	119
query83	189	160	146	146
query84	291	93	75	75
query85	784	378	302	302
query86	387	314	299	299
query87	4392	4668	4351	4351
query88	4439	2222	2204	2204
query89	420	323	292	292
query90	1886	185	187	185
query91	126	132	105	105
query92	64	53	52	52
query93	2154	892	530	530
query94	645	385	291	291
query95	332	268	247	247
query96	495	608	279	279
query97	2938	2993	2819	2819
query98	230	198	194	194
query99	1663	1574	1461	1461
Total cold run time: 300455 ms
Total hot run time: 198058 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.71 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 90fd604599fa0bd6ac4d9b7c9191771b39ed6348, data reload: false

query1	0.03	0.03	0.02
query2	0.07	0.04	0.03
query3	0.24	0.07	0.06
query4	1.61	0.10	0.10
query5	0.43	0.43	0.42
query6	1.17	0.65	0.64
query7	0.03	0.02	0.01
query8	0.04	0.03	0.03
query9	0.59	0.52	0.50
query10	0.56	0.55	0.55
query11	0.14	0.09	0.10
query12	0.14	0.11	0.11
query13	0.61	0.60	0.59
query14	2.72	2.82	2.73
query15	0.91	0.83	0.82
query16	0.38	0.38	0.39
query17	1.03	1.06	1.07
query18	0.23	0.22	0.21
query19	1.94	1.88	1.98
query20	0.01	0.01	0.01
query21	15.37	0.97	0.57
query22	0.75	0.85	0.80
query23	15.12	1.44	0.62
query24	3.05	1.07	2.17
query25	0.14	0.23	0.08
query26	0.21	0.16	0.13
query27	0.05	0.06	0.05
query28	14.89	1.46	1.05
query29	12.58	3.96	3.27
query30	0.25	0.09	0.06
query31	2.82	0.59	0.37
query32	3.23	0.53	0.46
query33	3.08	3.09	3.16
query34	16.40	5.12	4.56
query35	4.53	4.51	4.55
query36	0.64	0.48	0.48
query37	0.09	0.06	0.05
query38	0.04	0.03	0.04
query39	0.03	0.03	0.03
query40	0.17	0.14	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.02	0.03
Total cold run time: 106.48 s
Total hot run time: 31.71 s

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cause there is no mvcc or snapshot for global objects, We'd better backup these objects use scripts rather than handle them in core.

@justfortaste
Copy link
Contributor Author

Cause there is no mvcc or snapshot for global objects, We'd better backup these objects use scripts rather than handle them in core.

Currently,we can't get password by external tool

@justfortaste
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32094 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0d3aa68edf6bf1c9b10ffb16bcd4f87e1a885431, data reload: false

------ Round 1 ----------------------------------
q1	17573	5510	5422	5422
q2	2055	303	175	175
q3	10747	1227	735	735
q4	10218	948	511	511
q5	7560	2377	2112	2112
q6	197	167	138	138
q7	880	757	596	596
q8	9225	1326	1165	1165
q9	5204	4883	4869	4869
q10	6856	2336	1870	1870
q11	463	282	250	250
q12	342	358	217	217
q13	17785	3669	3091	3091
q14	220	247	217	217
q15	503	477	461	461
q16	616	624	585	585
q17	576	862	344	344
q18	7111	6458	6388	6388
q19	2516	954	526	526
q20	301	319	192	192
q21	2808	2193	1921	1921
q22	360	328	309	309
Total cold run time: 104116 ms
Total hot run time: 32094 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5571	5471	5427	5427
q2	238	329	248	248
q3	2249	2651	2340	2340
q4	1362	1816	1332	1332
q5	4330	4739	4597	4597
q6	166	160	126	126
q7	2024	1962	1851	1851
q8	2603	2824	2742	2742
q9	7324	7144	7307	7144
q10	3041	3295	2763	2763
q11	568	517	483	483
q12	635	713	578	578
q13	3506	3872	3313	3313
q14	277	304	277	277
q15	525	466	471	466
q16	662	684	631	631
q17	1200	1733	1279	1279
q18	7820	7479	7399	7399
q19	791	1149	1080	1080
q20	2011	2060	1879	1879
q21	5671	5292	4949	4949
q22	586	600	559	559
Total cold run time: 53160 ms
Total hot run time: 51463 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195181 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0d3aa68edf6bf1c9b10ffb16bcd4f87e1a885431, data reload: false

query1	1329	948	963	948
query2	6339	2197	2158	2158
query3	10981	4483	4421	4421
query4	60555	30629	23442	23442
query5	5551	616	476	476
query6	438	208	180	180
query7	5621	512	303	303
query8	334	252	237	237
query9	8215	2590	2601	2590
query10	462	319	250	250
query11	18155	15309	15549	15309
query12	163	108	103	103
query13	1463	549	405	405
query14	11047	7617	7085	7085
query15	219	207	204	204
query16	7123	628	471	471
query17	1101	733	594	594
query18	1609	445	333	333
query19	219	196	163	163
query20	117	112	110	110
query21	223	132	109	109
query22	4548	4685	4682	4682
query23	33850	33076	33244	33076
query24	5585	2322	2385	2322
query25	502	489	403	403
query26	643	284	163	163
query27	1661	492	342	342
query28	3974	2468	2426	2426
query29	565	564	436	436
query30	217	188	166	166
query31	946	888	809	809
query32	69	60	60	60
query33	435	361	304	304
query34	755	879	506	506
query35	806	865	810	810
query36	1009	1047	945	945
query37	129	108	77	77
query38	4364	4375	4388	4375
query39	1580	1437	1418	1418
query40	207	118	102	102
query41	53	48	49	48
query42	132	106	101	101
query43	550	533	505	505
query44	1372	818	834	818
query45	183	181	171	171
query46	902	1079	661	661
query47	1932	1913	1823	1823
query48	395	418	319	319
query49	733	506	401	401
query50	714	681	401	401
query51	6957	6864	7067	6864
query52	105	107	95	95
query53	235	261	195	195
query54	494	519	421	421
query55	96	81	87	81
query56	280	282	253	253
query57	1233	1192	1147	1147
query58	260	257	255	255
query59	3360	3146	2911	2911
query60	282	266	258	258
query61	121	121	120	120
query62	689	742	674	674
query63	231	193	193	193
query64	1231	1024	660	660
query65	3336	3153	3168	3153
query66	684	394	291	291
query67	16229	15895	15493	15493
query68	4468	856	536	536
query69	503	314	307	307
query70	1209	1183	1152	1152
query71	410	298	267	267
query72	6028	3926	3877	3877
query73	774	780	364	364
query74	10230	9339	8915	8915
query75	3214	3155	2692	2692
query76	3547	1134	784	784
query77	505	416	294	294
query78	10087	9949	9255	9255
query79	3398	829	592	592
query80	1676	546	441	441
query81	571	272	236	236
query82	380	148	127	127
query83	298	180	157	157
query84	284	96	77	77
query85	781	357	299	299
query86	458	322	308	308
query87	4459	4538	4516	4516
query88	4727	2162	2144	2144
query89	411	331	287	287
query90	1633	189	190	189
query91	136	138	109	109
query92	63	55	56	55
query93	2761	911	531	531
query94	768	407	300	300
query95	345	267	254	254
query96	500	630	286	286
query97	2801	2901	2755	2755
query98	260	199	192	192
query99	1333	1378	1258	1258
Total cold run time: 314916 ms
Total hot run time: 195181 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.78 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0d3aa68edf6bf1c9b10ffb16bcd4f87e1a885431, data reload: false

query1	0.03	0.03	0.03
query2	0.08	0.03	0.03
query3	0.23	0.07	0.06
query4	1.61	0.10	0.11
query5	0.44	0.43	0.40
query6	1.16	0.64	0.66
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.60	0.51	0.50
query10	0.56	0.57	0.55
query11	0.14	0.10	0.10
query12	0.13	0.11	0.11
query13	0.60	0.60	0.59
query14	2.72	2.85	2.86
query15	0.91	0.83	0.81
query16	0.40	0.38	0.39
query17	1.06	1.04	1.05
query18	0.22	0.21	0.20
query19	1.82	1.73	2.02
query20	0.02	0.00	0.02
query21	15.38	0.91	0.58
query22	0.75	0.79	0.69
query23	15.29	1.45	0.53
query24	3.01	1.01	1.47
query25	0.24	0.17	0.21
query26	0.33	0.15	0.15
query27	0.05	0.07	0.05
query28	14.02	0.98	0.44
query29	12.63	4.03	3.28
query30	0.25	0.09	0.06
query31	2.82	0.60	0.39
query32	3.22	0.55	0.47
query33	3.03	3.00	3.02
query34	16.52	5.15	4.49
query35	4.51	4.51	4.61
query36	0.62	0.49	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.02	0.02
query40	0.16	0.13	0.12
query41	0.08	0.02	0.02
query42	0.04	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.95 s
Total hot run time: 30.78 s

@justfortaste
Copy link
Contributor Author

run cloud_p0

@justfortaste justfortaste force-pushed the feature_backup_user_master_new branch from 0d3aa68 to e60f148 Compare January 23, 2025 14:33
@justfortaste justfortaste force-pushed the feature_backup_user_master_new branch from e60f148 to 7b0f4fa Compare January 24, 2025 09:56
@justfortaste
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32217 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7b0f4faa5d7108530d8bda06a3b183c34ad2fd9f, data reload: false

------ Round 1 ----------------------------------
q1	17606	5521	5335	5335
q2	2049	293	171	171
q3	10494	1229	744	744
q4	10215	959	545	545
q5	7541	2353	2142	2142
q6	199	165	134	134
q7	911	765	638	638
q8	9261	1355	1124	1124
q9	5066	4870	4909	4870
q10	6817	2362	1892	1892
q11	477	277	264	264
q12	346	357	224	224
q13	17799	3710	3098	3098
q14	226	221	211	211
q15	510	472	447	447
q16	633	620	596	596
q17	578	854	326	326
q18	7136	6385	6485	6385
q19	2041	944	533	533
q20	300	316	192	192
q21	2829	2215	2021	2021
q22	367	348	325	325
Total cold run time: 103401 ms
Total hot run time: 32217 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5528	5531	5470	5470
q2	235	331	230	230
q3	2226	2644	2333	2333
q4	1424	1873	1361	1361
q5	4315	4749	4640	4640
q6	162	154	123	123
q7	2063	2013	1843	1843
q8	2659	2825	2686	2686
q9	7237	7243	7276	7243
q10	2978	3248	2779	2779
q11	586	525	486	486
q12	692	792	643	643
q13	3584	3958	3319	3319
q14	268	308	269	269
q15	501	464	465	464
q16	650	704	644	644
q17	1207	1731	1266	1266
q18	7600	7613	7377	7377
q19	764	1067	1074	1067
q20	2042	2032	1872	1872
q21	5679	5361	4890	4890
q22	626	626	598	598
Total cold run time: 53026 ms
Total hot run time: 51603 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185685 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7b0f4faa5d7108530d8bda06a3b183c34ad2fd9f, data reload: false

query1	977	378	373	373
query2	6533	2191	2124	2124
query3	6782	224	211	211
query4	34075	23384	23385	23384
query5	4321	620	458	458
query6	286	201	189	189
query7	4601	512	315	315
query8	301	246	231	231
query9	9465	2609	2624	2609
query10	480	321	252	252
query11	18157	15313	15112	15112
query12	161	110	108	108
query13	1658	543	402	402
query14	10456	7048	6694	6694
query15	232	193	197	193
query16	7887	640	457	457
query17	1607	740	539	539
query18	2062	423	301	301
query19	214	186	149	149
query20	116	108	107	107
query21	207	118	103	103
query22	4085	4206	4273	4206
query23	34026	32987	33033	32987
query24	6416	2307	2313	2307
query25	491	450	388	388
query26	1202	273	154	154
query27	1986	472	327	327
query28	5116	2445	2392	2392
query29	674	557	407	407
query30	229	199	158	158
query31	987	891	776	776
query32	71	59	62	59
query33	514	359	288	288
query34	743	864	503	503
query35	845	815	743	743
query36	975	1038	948	948
query37	123	105	78	78
query38	4154	4235	4131	4131
query39	1430	1452	1414	1414
query40	216	110	99	99
query41	51	50	53	50
query42	122	102	106	102
query43	527	548	502	502
query44	1335	804	806	804
query45	188	175	164	164
query46	880	1067	645	645
query47	1801	1797	1763	1763
query48	382	404	321	321
query49	779	514	386	386
query50	655	639	391	391
query51	4184	4169	4131	4131
query52	114	110	92	92
query53	239	267	189	189
query54	496	487	441	441
query55	84	79	82	79
query56	258	262	248	248
query57	1160	1120	1060	1060
query58	245	230	228	228
query59	3177	3164	3135	3135
query60	293	278	257	257
query61	120	118	117	117
query62	788	706	677	677
query63	224	194	186	186
query64	4137	1019	663	663
query65	3231	3187	3179	3179
query66	1057	419	322	322
query67	15662	15433	15509	15433
query68	2399	866	561	561
query69	415	313	263	263
query70	1208	1120	1145	1120
query71	335	312	276	276
query72	5894	3795	3818	3795
query73	640	789	364	364
query74	9757	9169	9109	9109
query75	3161	3158	2677	2677
query76	2234	1210	767	767
query77	408	374	279	279
query78	10312	10126	9267	9267
query79	2611	802	593	593
query80	1681	547	448	448
query81	574	274	238	238
query82	350	155	119	119
query83	267	180	158	158
query84	246	97	74	74
query85	827	376	322	322
query86	485	286	311	286
query87	4478	4582	4347	4347
query88	4069	2196	2141	2141
query89	392	324	308	308
query90	1817	192	192	192
query91	132	141	107	107
query92	62	60	57	57
query93	1681	878	532	532
query94	666	421	304	304
query95	354	268	257	257
query96	486	648	282	282
query97	2839	2870	2737	2737
query98	228	195	193	193
query99	1311	1384	1271	1271
Total cold run time: 279369 ms
Total hot run time: 185685 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.47 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7b0f4faa5d7108530d8bda06a3b183c34ad2fd9f, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.04	0.03
query3	0.24	0.08	0.07
query4	1.61	0.10	0.11
query5	0.44	0.41	0.41
query6	1.17	0.67	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.59	0.50	0.51
query10	0.55	0.56	0.55
query11	0.15	0.11	0.11
query12	0.14	0.11	0.11
query13	0.61	0.62	0.60
query14	2.84	2.74	2.83
query15	0.90	0.82	0.82
query16	0.39	0.39	0.38
query17	0.97	1.01	1.07
query18	0.23	0.20	0.20
query19	1.86	1.87	2.01
query20	0.01	0.01	0.02
query21	15.37	0.93	0.60
query22	0.75	0.79	0.67
query23	15.30	1.44	0.52
query24	3.43	1.66	0.77
query25	0.20	0.08	0.21
query26	0.30	0.15	0.13
query27	0.07	0.04	0.06
query28	13.51	0.93	0.43
query29	12.59	3.98	3.30
query30	0.25	0.09	0.07
query31	2.83	0.60	0.40
query32	3.23	0.55	0.45
query33	2.99	3.01	3.07
query34	16.74	5.11	4.48
query35	4.57	4.48	4.53
query36	0.64	0.49	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.03	0.02
query40	0.17	0.14	0.13
query41	0.07	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 106.13 s
Total hot run time: 30.47 s

@justfortaste
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32148 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fffb16fe32abd686526b05599e8c79eaaecb9901, data reload: false

------ Round 1 ----------------------------------
q1	17605	5459	5339	5339
q2	2051	296	167	167
q3	10441	1246	740	740
q4	10257	982	530	530
q5	8450	2351	2141	2141
q6	200	162	136	136
q7	889	763	602	602
q8	9237	1310	1152	1152
q9	5093	4755	4886	4755
q10	6790	2290	1867	1867
q11	463	271	259	259
q12	336	353	222	222
q13	17868	3691	3308	3308
q14	226	227	215	215
q15	532	483	472	472
q16	633	606	588	588
q17	564	869	345	345
q18	6988	6529	6362	6362
q19	1479	955	524	524
q20	309	321	193	193
q21	2762	2131	1929	1929
q22	371	338	302	302
Total cold run time: 103544 ms
Total hot run time: 32148 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5498	5446	5469	5446
q2	239	330	226	226
q3	2248	2602	2276	2276
q4	1420	1801	1366	1366
q5	4315	4728	4657	4657
q6	176	161	125	125
q7	2019	1935	1815	1815
q8	2613	2822	2694	2694
q9	7377	7198	7268	7198
q10	3005	3289	2792	2792
q11	576	497	475	475
q12	642	712	605	605
q13	3537	3935	3235	3235
q14	295	298	270	270
q15	515	472	473	472
q16	664	681	659	659
q17	1215	1749	1257	1257
q18	7571	7408	7253	7253
q19	761	1138	1065	1065
q20	2005	2071	1916	1916
q21	5774	5210	4843	4843
q22	630	651	605	605
Total cold run time: 53095 ms
Total hot run time: 51250 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190573 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit fffb16fe32abd686526b05599e8c79eaaecb9901, data reload: false

query1	1302	965	901	901
query2	6354	2001	2081	2001
query3	11015	4427	4402	4402
query4	32436	23224	22936	22936
query5	3635	603	439	439
query6	280	202	193	193
query7	3968	486	304	304
query8	304	252	235	235
query9	9179	2605	2584	2584
query10	432	299	259	259
query11	17703	15132	14870	14870
query12	157	105	102	102
query13	1561	513	391	391
query14	9187	6276	6780	6276
query15	232	193	192	192
query16	8076	632	503	503
query17	1552	765	586	586
query18	2174	422	351	351
query19	209	227	174	174
query20	126	123	114	114
query21	210	129	110	110
query22	4453	4622	4341	4341
query23	34491	33758	34078	33758
query24	6859	2344	2385	2344
query25	525	498	421	421
query26	1180	281	158	158
query27	2802	475	327	327
query28	5879	2468	2426	2426
query29	747	554	426	426
query30	216	182	154	154
query31	968	888	831	831
query32	95	58	55	55
query33	508	351	305	305
query34	764	869	525	525
query35	832	831	764	764
query36	1030	1065	950	950
query37	123	103	108	103
query38	4393	4331	4158	4158
query39	1519	1445	1420	1420
query40	195	116	102	102
query41	51	51	50	50
query42	123	109	106	106
query43	541	553	510	510
query44	1338	840	823	823
query45	186	176	174	174
query46	866	1045	641	641
query47	1887	1936	1894	1894
query48	393	407	334	334
query49	787	486	412	412
query50	631	688	404	404
query51	4303	4278	4165	4165
query52	120	106	96	96
query53	234	261	200	200
query54	483	501	411	411
query55	79	79	84	79
query56	269	278	261	261
query57	1207	1181	1155	1155
query58	255	237	231	231
query59	3199	3328	3067	3067
query60	301	274	272	272
query61	121	130	152	130
query62	758	765	651	651
query63	226	197	189	189
query64	4601	1058	654	654
query65	3290	3243	3207	3207
query66	808	401	298	298
query67	16129	15584	15413	15413
query68	5757	816	536	536
query69	455	291	281	281
query70	1217	1120	1160	1120
query71	376	288	246	246
query72	5816	3817	3772	3772
query73	648	747	357	357
query74	9960	8985	8794	8794
query75	3146	3065	2637	2637
query76	3108	1165	739	739
query77	462	429	274	274
query78	10063	10039	9383	9383
query79	3103	801	614	614
query80	674	522	465	465
query81	508	280	234	234
query82	421	141	126	126
query83	167	175	173	173
query84	243	96	72	72
query85	775	348	302	302
query86	395	287	302	287
query87	4563	4467	4466	4466
query88	4912	2231	2168	2168
query89	407	322	293	293
query90	1775	193	196	193
query91	136	132	109	109
query92	67	53	54	53
query93	2376	870	542	542
query94	666	409	283	283
query95	328	267	263	263
query96	479	606	293	293
query97	2736	2864	2737	2737
query98	223	198	201	198
query99	1292	1389	1245	1245
Total cold run time: 288111 ms
Total hot run time: 190573 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.19 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit fffb16fe32abd686526b05599e8c79eaaecb9901, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.05
query3	0.24	0.06	0.06
query4	1.64	0.10	0.10
query5	0.45	0.43	0.40
query6	1.15	0.65	0.65
query7	0.02	0.01	0.02
query8	0.04	0.04	0.03
query9	0.59	0.51	0.50
query10	0.55	0.56	0.56
query11	0.14	0.10	0.10
query12	0.14	0.11	0.10
query13	0.60	0.59	0.60
query14	2.89	2.74	2.75
query15	0.88	0.83	0.82
query16	0.39	0.40	0.39
query17	1.03	0.99	1.05
query18	0.23	0.21	0.22
query19	1.97	1.82	2.02
query20	0.01	0.01	0.01
query21	15.39	0.90	0.58
query22	0.78	0.76	0.64
query23	15.32	1.37	0.50
query24	3.26	0.70	0.68
query25	0.31	0.11	0.08
query26	0.36	0.15	0.14
query27	0.04	0.05	0.07
query28	13.08	1.01	0.43
query29	12.56	3.96	3.30
query30	0.25	0.10	0.06
query31	2.82	0.63	0.40
query32	3.24	0.54	0.46
query33	3.03	3.01	3.02
query34	16.62	5.12	4.46
query35	4.52	4.47	4.48
query36	0.64	0.49	0.47
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.04	0.02	0.02
query40	0.16	0.13	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.03
query43	0.04	0.04	0.03
Total cold run time: 105.78 s
Total hot run time: 30.19 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants