Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-3.0: [opt](test)Optimize index compaction UT test config with log scene #46170 #46208

Open
wants to merge 1 commit into
base: branch-3.0
Choose a base branch
from

Conversation

github-actions[bot]
Copy link
Contributor

Cherry-picked from #46170

@Thearas
Copy link
Contributor

Thearas commented Dec 31, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Dec 31, 2024
@Thearas
Copy link
Contributor

Thearas commented Dec 31, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41115 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 61dd055b9fe1a5cf38703b351710393897dffaa5, data reload: false

------ Round 1 ----------------------------------
q1	17571	8054	7316	7316
q2	2063	191	174	174
q3	10710	1113	1179	1113
q4	10583	795	793	793
q5	7753	2877	2913	2877
q6	245	147	143	143
q7	969	639	629	629
q8	9345	2012	1994	1994
q9	6591	6445	6514	6445
q10	7010	2348	2339	2339
q11	461	255	263	255
q12	409	214	206	206
q13	17791	2951	2972	2951
q14	256	210	209	209
q15	566	529	505	505
q16	671	633	606	606
q17	1004	560	524	524
q18	7448	6742	6833	6742
q19	1390	1118	983	983
q20	483	205	204	204
q21	4030	3158	3115	3115
q22	1110	992	1008	992
Total cold run time: 108459 ms
Total hot run time: 41115 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7289	7219	7231	7219
q2	322	232	233	232
q3	2992	2937	2932	2932
q4	2111	1885	1773	1773
q5	5756	5715	5719	5715
q6	233	139	140	139
q7	2263	1827	1819	1819
q8	3343	3625	3473	3473
q9	8934	8990	8841	8841
q10	3589	3538	3549	3538
q11	599	490	498	490
q12	812	636	601	601
q13	10206	3171	3131	3131
q14	308	272	285	272
q15	591	517	521	517
q16	692	683	683	683
q17	1863	1626	1618	1618
q18	8389	7752	7577	7577
q19	1702	1601	1499	1499
q20	2106	1905	1874	1874
q21	5660	5402	5363	5363
q22	1161	1076	1047	1047
Total cold run time: 70921 ms
Total hot run time: 60353 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197858 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 61dd055b9fe1a5cf38703b351710393897dffaa5, data reload: false

query1	1279	928	919	919
query2	6246	2189	2168	2168
query3	10928	4583	4550	4550
query4	33462	23552	23320	23320
query5	3556	466	457	457
query6	271	170	171	170
query7	4005	307	313	307
query8	294	221	226	221
query9	9290	2730	2713	2713
query10	470	256	259	256
query11	17724	15216	15078	15078
query12	157	102	99	99
query13	1541	429	412	412
query14	9996	7458	7125	7125
query15	254	179	200	179
query16	7344	506	468	468
query17	1655	581	595	581
query18	2047	320	327	320
query19	263	164	154	154
query20	126	116	120	116
query21	61	47	46	46
query22	4689	4449	4595	4449
query23	35015	34486	34272	34272
query24	11339	2984	2885	2885
query25	638	434	421	421
query26	1058	168	169	168
query27	2522	317	323	317
query28	7623	2521	2490	2490
query29	725	462	441	441
query30	275	166	178	166
query31	1035	805	842	805
query32	102	58	60	58
query33	792	291	287	287
query34	1166	529	508	508
query35	854	748	758	748
query36	1132	974	972	972
query37	126	80	78	78
query38	4101	3993	4043	3993
query39	1504	1499	1448	1448
query40	198	85	85	85
query41	51	50	52	50
query42	113	99	102	99
query43	562	515	528	515
query44	1261	818	825	818
query45	188	167	167	167
query46	1179	717	724	717
query47	2009	1878	1914	1878
query48	487	411	391	391
query49	963	428	406	406
query50	838	418	412	412
query51	7179	7319	7404	7319
query52	98	90	90	90
query53	265	186	188	186
query54	1322	462	454	454
query55	78	76	77	76
query56	267	238	244	238
query57	1234	1159	1177	1159
query58	231	213	216	213
query59	3442	3182	3008	3008
query60	270	255	257	255
query61	110	110	104	104
query62	887	680	659	659
query63	220	185	198	185
query64	5149	686	656	656
query65	3251	3166	3194	3166
query66	1060	290	315	290
query67	16028	15594	15733	15594
query68	4627	567	581	567
query69	459	260	266	260
query70	1193	1159	1131	1131
query71	342	246	247	246
query72	6196	4021	4059	4021
query73	749	355	344	344
query74	10269	8986	9160	8986
query75	3413	2677	2593	2593
query76	2690	1064	1087	1064
query77	390	276	283	276
query78	10626	9682	9504	9504
query79	1216	589	592	589
query80	1045	436	432	432
query81	557	239	237	237
query82	1101	125	123	123
query83	234	149	142	142
query84	230	78	80	78
query85	1368	320	291	291
query86	386	304	300	300
query87	4372	4342	4315	4315
query88	3686	2396	2361	2361
query89	413	286	298	286
query90	1948	190	183	183
query91	193	145	154	145
query92	61	49	50	49
query93	1382	546	537	537
query94	924	297	297	297
query95	358	257	260	257
query96	611	281	281	281
query97	3329	3119	3159	3119
query98	213	204	202	202
query99	1507	1334	1287	1287
Total cold run time: 300693 ms
Total hot run time: 197858 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.77 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 61dd055b9fe1a5cf38703b351710393897dffaa5, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.03	0.03
query3	0.23	0.06	0.06
query4	1.63	0.10	0.11
query5	0.51	0.52	0.51
query6	1.14	0.72	0.74
query7	0.02	0.02	0.02
query8	0.04	0.04	0.03
query9	0.57	0.52	0.50
query10	0.54	0.53	0.57
query11	0.15	0.11	0.11
query12	0.14	0.12	0.11
query13	0.62	0.60	0.59
query14	2.95	3.00	2.91
query15	0.89	0.83	0.82
query16	0.39	0.39	0.38
query17	0.99	1.03	1.07
query18	0.23	0.21	0.22
query19	1.99	1.78	2.05
query20	0.01	0.01	0.01
query21	15.36	0.61	0.57
query22	3.05	2.16	1.68
query23	17.15	0.90	0.84
query24	3.55	1.51	0.99
query25	0.34	0.23	0.05
query26	0.27	0.14	0.13
query27	0.06	0.04	0.05
query28	10.12	1.09	1.08
query29	12.64	3.24	3.24
query30	0.24	0.06	0.07
query31	2.86	0.38	0.38
query32	3.26	0.46	0.48
query33	2.99	2.98	3.07
query34	16.88	4.48	4.54
query35	4.64	4.53	4.55
query36	0.65	0.48	0.51
query37	0.09	0.06	0.06
query38	0.05	0.03	0.04
query39	0.04	0.02	0.02
query40	0.15	0.12	0.13
query41	0.07	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 107.67 s
Total hot run time: 32.77 s

Copy link
Member

@airborne12 airborne12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 1, 2025
Copy link
Contributor Author

github-actions bot commented Jan 1, 2025

PR approved by at least one committer and no changes requested.

Copy link
Contributor Author

github-actions bot commented Jan 1, 2025

PR approved by anyone and no changes requested.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants