Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-3.0: [fix](profile) Fix profile of broker load #46676 #46695

Merged

Conversation

zhiqiang-hhhh
Copy link
Contributor

cherry pick from #46676

@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@doris-robot
Copy link

TPC-H: Total hot run time: 41021 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 73d3c5b101688da60c90554d7df06f65634f4d7a, data reload: false

------ Round 1 ----------------------------------
q1	17749	7803	7366	7366
q2	3075	174	175	174
q3	11268	1132	1202	1132
q4	10406	771	686	686
q5	7738	2884	2902	2884
q6	237	144	144	144
q7	950	623	603	603
q8	9343	1937	2019	1937
q9	6665	6384	6413	6384
q10	7002	2309	2293	2293
q11	457	266	259	259
q12	409	209	211	209
q13	17778	3010	2989	2989
q14	250	204	205	204
q15	575	529	527	527
q16	673	650	629	629
q17	975	591	499	499
q18	7327	6754	6687	6687
q19	1389	1065	1099	1065
q20	470	198	198	198
q21	4102	3160	3180	3160
q22	1091	992	1009	992
Total cold run time: 109929 ms
Total hot run time: 41021 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7239	7247	7231	7231
q2	334	239	231	231
q3	3073	2995	3028	2995
q4	2037	1841	1836	1836
q5	5684	5750	5698	5698
q6	215	139	143	139
q7	2222	1849	1835	1835
q8	3374	3584	3483	3483
q9	8867	8881	8900	8881
q10	3590	3600	3582	3582
q11	599	514	504	504
q12	795	616	658	616
q13	9439	3142	3204	3142
q14	298	272	268	268
q15	575	533	517	517
q16	720	691	659	659
q17	1820	1634	1606	1606
q18	8318	7731	7607	7607
q19	1655	1509	1569	1509
q20	2047	1825	1810	1810
q21	5324	5198	5200	5198
q22	1082	986	988	986
Total cold run time: 69307 ms
Total hot run time: 60333 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192053 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 73d3c5b101688da60c90554d7df06f65634f4d7a, data reload: false

query1	989	376	368	368
query2	6533	2082	2087	2082
query3	6695	214	224	214
query4	34172	23451	23316	23316
query5	4339	474	455	455
query6	278	200	164	164
query7	4614	308	312	308
query8	282	229	217	217
query9	9519	2692	2693	2692
query10	486	270	265	265
query11	18096	15142	15242	15142
query12	158	101	101	101
query13	1635	439	411	411
query14	9447	7015	7102	7015
query15	249	173	189	173
query16	7987	456	438	438
query17	1625	594	571	571
query18	2087	315	336	315
query19	231	163	150	150
query20	119	106	111	106
query21	210	107	104	104
query22	4380	4328	4217	4217
query23	34644	33842	34160	33842
query24	11208	2867	2939	2867
query25	678	408	387	387
query26	1441	169	164	164
query27	2901	333	334	333
query28	8052	2456	2434	2434
query29	925	426	430	426
query30	327	167	168	167
query31	1021	774	804	774
query32	102	54	56	54
query33	780	281	279	279
query34	993	502	532	502
query35	870	732	721	721
query36	1096	952	971	952
query37	159	81	82	81
query38	4176	3868	3910	3868
query39	1478	1440	1408	1408
query40	280	97	99	97
query41	53	47	49	47
query42	110	99	102	99
query43	545	509	506	506
query44	1200	806	823	806
query45	181	165	170	165
query46	1171	729	725	725
query47	1952	1840	1852	1840
query48	477	399	385	385
query49	1201	385	390	385
query50	828	405	404	404
query51	7280	7020	7126	7020
query52	104	92	89	89
query53	261	187	192	187
query54	1307	453	461	453
query55	78	77	75	75
query56	287	273	257	257
query57	1243	1095	1115	1095
query58	246	212	228	212
query59	3255	3161	2966	2966
query60	281	267	253	253
query61	122	109	124	109
query62	894	687	678	678
query63	229	200	191	191
query64	5339	662	625	625
query65	3319	3187	3239	3187
query66	1442	316	319	316
query67	16030	15727	15543	15543
query68	3985	586	576	576
query69	427	256	261	256
query70	1174	1142	1116	1116
query71	327	259	260	259
query72	6243	4331	4297	4297
query73	751	354	358	354
query74	10023	9013	9044	9013
query75	3465	2646	2644	2644
query76	2838	1199	1131	1131
query77	425	290	284	284
query78	10464	9659	9637	9637
query79	1134	607	600	600
query80	815	457	467	457
query81	522	243	242	242
query82	1267	129	123	123
query83	249	158	153	153
query84	240	83	78	78
query85	1175	371	358	358
query86	323	299	307	299
query87	4361	4264	4403	4264
query88	3547	2435	2361	2361
query89	402	291	302	291
query90	2158	189	189	189
query91	179	149	151	149
query92	58	51	52	51
query93	1073	559	546	546
query94	840	310	297	297
query95	353	253	252	252
query96	613	279	278	278
query97	3366	3302	3190	3190
query98	213	200	196	196
query99	1551	1327	1314	1314
Total cold run time: 299258 ms
Total hot run time: 192053 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.41 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 73d3c5b101688da60c90554d7df06f65634f4d7a, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.02	0.03
query3	0.24	0.06	0.06
query4	1.63	0.10	0.10
query5	0.53	0.51	0.51
query6	1.14	0.73	0.72
query7	0.02	0.02	0.02
query8	0.04	0.02	0.03
query9	0.56	0.51	0.48
query10	0.54	0.55	0.55
query11	0.15	0.10	0.10
query12	0.14	0.11	0.11
query13	0.60	0.61	0.60
query14	2.98	2.95	2.95
query15	0.90	0.85	0.83
query16	0.38	0.38	0.38
query17	1.02	1.06	1.02
query18	0.23	0.22	0.22
query19	1.91	1.93	2.02
query20	0.01	0.00	0.01
query21	15.35	0.61	0.57
query22	2.54	2.07	1.66
query23	16.90	1.05	0.80
query24	2.71	1.48	0.47
query25	0.36	0.19	0.13
query26	0.31	0.14	0.13
query27	0.04	0.04	0.03
query28	11.00	1.10	1.08
query29	12.58	3.24	3.22
query30	0.26	0.06	0.06
query31	2.86	0.40	0.39
query32	3.23	0.46	0.48
query33	3.04	2.99	3.06
query34	16.95	4.49	4.57
query35	4.49	4.51	4.48
query36	0.68	0.51	0.50
query37	0.10	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.12	0.13
query41	0.08	0.02	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.92 s
Total hot run time: 32.41 s

@yiguolei yiguolei merged commit 49cb288 into apache:branch-3.0 Jan 9, 2025
21 of 22 checks passed
@zhiqiang-hhhh zhiqiang-hhhh deleted the pick_46676_to_upstream_branch-3.0 branch January 9, 2025 09:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants