Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-3.0: [enhance](mtmv)Change the way to verify the existence of partition names when refreshing MTMV #45290 #45723

Merged
merged 1 commit into from
Dec 23, 2024

Conversation

github-actions[bot]
Copy link
Contributor

Cherry-picked from #45290

…mes when refreshing MTMV (#45290)

### What problem does this PR solve?

Previously, when refreshing the materialized view according to the
partition name, the existing partition of the materialized view was used
to verify whether the partition name existed
After the change, the partition that should be present after refreshing
the materialized view is used for verification
@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Dec 20, 2024
@hello-stephen
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40159 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0bd7f51b6e6e45f9dd96e0e6234a6336f137f960, data reload: false

------ Round 1 ----------------------------------
q1	17572	7262	7236	7236
q2	2043	171	161	161
q3	10875	1036	1122	1036
q4	10529	699	724	699
q5	7724	2791	2758	2758
q6	232	145	141	141
q7	961	604	618	604
q8	9578	1912	1976	1912
q9	8015	6333	6364	6333
q10	6949	2278	2334	2278
q11	469	258	259	258
q12	391	210	208	208
q13	17845	2990	3124	2990
q14	249	211	207	207
q15	574	515	513	513
q16	685	593	622	593
q17	970	647	520	520
q18	7265	6547	6637	6547
q19	2558	1023	1029	1023
q20	462	202	193	193
q21	4005	3215	2977	2977
q22	1101	981	972	972
Total cold run time: 111052 ms
Total hot run time: 40159 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7288	7133	7185	7133
q2	317	233	231	231
q3	2917	2852	2857	2852
q4	1995	1827	1729	1729
q5	5659	5661	5696	5661
q6	223	142	138	138
q7	2122	1781	1769	1769
q8	3273	3523	3450	3450
q9	8763	8819	8789	8789
q10	3538	3532	3506	3506
q11	607	487	496	487
q12	806	568	597	568
q13	16487	3145	3108	3108
q14	298	286	272	272
q15	565	522	533	522
q16	707	683	654	654
q17	1813	1622	1603	1603
q18	8213	7747	7534	7534
q19	7390	1554	1600	1554
q20	2083	1832	1876	1832
q21	5437	5263	5107	5107
q22	1131	1010	1009	1009
Total cold run time: 81632 ms
Total hot run time: 59508 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195924 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0bd7f51b6e6e45f9dd96e0e6234a6336f137f960, data reload: false

query1	1324	913	898	898
query2	6243	2111	2149	2111
query3	10933	4160	4174	4160
query4	66093	29129	23301	23301
query5	5223	442	436	436
query6	408	174	166	166
query7	5671	319	307	307
query8	308	235	230	230
query9	9512	2683	2661	2661
query10	502	267	256	256
query11	18003	15051	15686	15051
query12	155	99	101	99
query13	1556	431	412	412
query14	10027	7219	7480	7219
query15	211	173	187	173
query16	7279	532	488	488
query17	1078	586	576	576
query18	1865	336	311	311
query19	224	159	155	155
query20	123	112	123	112
query21	64	46	47	46
query22	4768	4430	4408	4408
query23	34507	34034	34153	34034
query24	6138	2945	2917	2917
query25	532	404	426	404
query26	671	172	173	172
query27	1789	310	301	301
query28	4465	2525	2521	2521
query29	701	453	445	445
query30	250	169	164	164
query31	1025	881	818	818
query32	61	53	55	53
query33	405	277	280	277
query34	903	501	490	490
query35	843	757	742	742
query36	1083	924	949	924
query37	121	73	72	72
query38	4068	4022	3942	3942
query39	1494	1474	1477	1474
query40	145	85	82	82
query41	51	47	46	46
query42	111	100	99	99
query43	552	509	506	506
query44	1148	789	792	789
query45	191	170	170	170
query46	1158	746	731	731
query47	1988	1880	1928	1880
query48	463	375	352	352
query49	714	370	373	370
query50	840	424	415	415
query51	7346	7256	7048	7048
query52	98	86	81	81
query53	263	176	176	176
query54	553	452	440	440
query55	81	75	73	73
query56	245	241	236	236
query57	1199	1079	1124	1079
query58	202	198	221	198
query59	3462	3107	3202	3107
query60	272	244	236	236
query61	106	103	104	103
query62	777	659	651	651
query63	202	184	192	184
query64	1733	661	610	610
query65	3206	3158	3133	3133
query66	721	299	300	299
query67	15907	15506	15293	15293
query68	4747	564	556	556
query69	442	251	249	249
query70	1191	1137	1109	1109
query71	403	255	275	255
query72	6558	3950	3973	3950
query73	798	342	347	342
query74	10205	8830	8986	8830
query75	3322	2596	2662	2596
query76	2479	1036	1044	1036
query77	549	274	285	274
query78	10665	9799	9685	9685
query79	6824	585	584	584
query80	2027	409	433	409
query81	555	241	241	241
query82	1776	119	111	111
query83	241	143	143	143
query84	288	79	76	76
query85	1184	303	290	290
query86	468	269	301	269
query87	4408	4200	4243	4200
query88	5394	2395	2357	2357
query89	421	292	290	290
query90	2092	185	187	185
query91	180	143	140	140
query92	67	50	49	49
query93	6000	542	546	542
query94	894	298	294	294
query95	357	248	259	248
query96	610	273	272	272
query97	3313	3152	3160	3152
query98	219	203	199	199
query99	1619	1278	1312	1278
Total cold run time: 334656 ms
Total hot run time: 195924 ms

@yiguolei yiguolei merged commit 01ab23e into branch-3.0 Dec 23, 2024
19 of 21 checks passed
@github-actions github-actions bot deleted the auto-pick-45290-branch-3.0 branch December 23, 2024 02:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants