Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[dependencies](fe)upgrade paimon to 0.8.1 #37205

Merged
merged 2 commits into from
Jul 4, 2024
Merged

[dependencies](fe)upgrade paimon to 0.8.1 #37205

merged 2 commits into from
Jul 4, 2024

Conversation

CalvinKirs
Copy link
Member

Proposed changes

FYI apache/doris-shade#46

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@CalvinKirs
Copy link
Member Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39515 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 77afaacf97dc7945090ba13149ccef5b0b963ea4, data reload: false

------ Round 1 ----------------------------------
q1	17646	4377	4242	4242
q2	2026	191	189	189
q3	10461	1172	1097	1097
q4	10191	805	700	700
q5	7494	2647	2611	2611
q6	220	137	136	136
q7	946	599	607	599
q8	9225	2083	2048	2048
q9	8663	6464	6487	6464
q10	8903	3696	3648	3648
q11	447	248	238	238
q12	502	232	228	228
q13	17769	2987	2964	2964
q14	276	227	212	212
q15	540	481	483	481
q16	509	382	371	371
q17	951	727	742	727
q18	8205	7484	7336	7336
q19	7700	1479	1405	1405
q20	685	322	316	316
q21	4868	3198	3174	3174
q22	390	329	340	329
Total cold run time: 118617 ms
Total hot run time: 39515 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4357	4238	4259	4238
q2	379	264	256	256
q3	2940	2890	2923	2890
q4	1989	1673	1782	1673
q5	5584	5481	5425	5425
q6	227	139	139	139
q7	2206	1891	1853	1853
q8	3301	3423	3400	3400
q9	8694	8753	8729	8729
q10	4194	3762	3773	3762
q11	594	493	501	493
q12	816	637	647	637
q13	17081	3155	3202	3155
q14	307	281	267	267
q15	522	495	511	495
q16	478	436	426	426
q17	1812	1499	1486	1486
q18	8041	7943	7932	7932
q19	1761	1618	1723	1618
q20	2952	1878	1827	1827
q21	8364	4804	4853	4804
q22	640	584	547	547
Total cold run time: 77239 ms
Total hot run time: 56052 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 173265 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 77afaacf97dc7945090ba13149ccef5b0b963ea4, data reload: false

query1	909	382	370	370
query2	6454	2404	2333	2333
query3	6638	205	218	205
query4	20386	17547	17252	17252
query5	3731	495	472	472
query6	260	160	173	160
query7	4596	297	289	289
query8	322	282	282	282
query9	8470	2362	2363	2362
query10	563	312	288	288
query11	10497	9925	9985	9925
query12	113	94	80	80
query13	1638	395	364	364
query14	10339	6938	7715	6938
query15	233	186	195	186
query16	7749	277	284	277
query17	1841	592	541	541
query18	1877	290	277	277
query19	198	152	155	152
query20	93	85	85	85
query21	213	147	129	129
query22	4307	3955	3932	3932
query23	33942	33592	33496	33496
query24	10940	2910	2866	2866
query25	619	398	390	390
query26	711	158	158	158
query27	2244	317	334	317
query28	6309	2150	2152	2150
query29	919	660	664	660
query30	255	221	165	165
query31	986	751	781	751
query32	93	50	52	50
query33	748	290	285	285
query34	1062	488	483	483
query35	758	640	656	640
query36	1118	994	983	983
query37	137	81	79	79
query38	2999	2811	2797	2797
query39	904	859	841	841
query40	200	124	124	124
query41	53	50	54	50
query42	115	98	100	98
query43	599	540	558	540
query44	1191	733	729	729
query45	196	161	163	161
query46	1082	718	730	718
query47	1808	1767	1742	1742
query48	371	318	305	305
query49	822	417	413	413
query50	788	384	389	384
query51	6829	6811	6737	6737
query52	110	92	98	92
query53	365	291	283	283
query54	906	452	448	448
query55	74	70	73	70
query56	287	260	270	260
query57	1090	1056	1019	1019
query58	243	248	239	239
query59	3397	3336	3192	3192
query60	307	274	281	274
query61	92	88	89	88
query62	608	458	440	440
query63	311	299	290	290
query64	8694	2270	1743	1743
query65	3149	3055	3154	3055
query66	749	322	333	322
query67	15407	14893	14932	14893
query68	4888	557	543	543
query69	660	408	325	325
query70	1136	1076	1163	1076
query71	439	295	287	287
query72	8525	5231	5502	5231
query73	769	326	324	324
query74	5840	5539	5471	5471
query75	4113	2661	2675	2661
query76	3476	897	897	897
query77	669	300	302	300
query78	10411	9982	9656	9656
query79	2858	519	523	519
query80	2308	477	484	477
query81	568	220	217	217
query82	1434	109	107	107
query83	305	172	183	172
query84	273	89	94	89
query85	1262	286	282	282
query86	457	310	335	310
query87	3284	3082	3103	3082
query88	4284	2465	2492	2465
query89	486	393	386	386
query90	1853	190	189	189
query91	127	101	103	101
query92	59	51	49	49
query93	2882	524	523	523
query94	1149	193	186	186
query95	408	318	320	318
query96	594	273	272	272
query97	3169	3077	2988	2988
query98	228	204	198	198
query99	1123	845	854	845
Total cold run time: 276051 ms
Total hot run time: 173265 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.74 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 77afaacf97dc7945090ba13149ccef5b0b963ea4, data reload: false

query1	0.04	0.03	0.03
query2	0.09	0.04	0.04
query3	0.22	0.05	0.06
query4	1.68	0.08	0.10
query5	0.50	0.50	0.48
query6	1.14	0.74	0.73
query7	0.02	0.02	0.01
query8	0.05	0.05	0.05
query9	0.55	0.49	0.49
query10	0.55	0.54	0.54
query11	0.15	0.11	0.12
query12	0.15	0.12	0.12
query13	0.60	0.59	0.59
query14	0.77	0.78	0.79
query15	0.85	0.83	0.82
query16	0.35	0.37	0.36
query17	0.97	1.00	1.03
query18	0.24	0.25	0.24
query19	1.80	1.71	1.66
query20	0.01	0.01	0.00
query21	15.46	0.78	0.66
query22	4.39	7.36	2.05
query23	18.34	1.45	1.24
query24	2.11	0.25	0.22
query25	0.16	0.09	0.07
query26	0.25	0.17	0.18
query27	0.07	0.08	0.08
query28	13.24	1.02	1.00
query29	12.63	3.27	3.24
query30	0.25	0.06	0.05
query31	2.87	0.40	0.40
query32	3.25	0.47	0.47
query33	2.91	2.95	2.90
query34	17.24	4.40	4.43
query35	4.56	4.54	4.56
query36	0.66	0.48	0.51
query37	0.20	0.16	0.17
query38	0.17	0.16	0.15
query39	0.05	0.03	0.03
query40	0.18	0.14	0.13
query41	0.09	0.04	0.05
query42	0.05	0.06	0.05
query43	0.05	0.04	0.03
Total cold run time: 109.91 s
Total hot run time: 30.74 s

@CalvinKirs
Copy link
Member Author

run buildall

morningman
morningman approved these changes Jul 4, 2024
View reviewed changes
Copy link
Contributor

@morningman morningman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 4, 2024
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jul 4, 2024

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jul 4, 2024

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 40200 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e0b952a86e7684c37e0264b8d848aa4f1b95475c, data reload: false

------ Round 1 ----------------------------------
q1	17889	5300	4418	4418
q2	2665	200	197	197
q3	12058	1176	1019	1019
q4	10615	774	772	772
q5	7980	2723	2620	2620
q6	227	144	140	140
q7	981	590	606	590
q8	9221	2077	2060	2060
q9	8809	6502	6498	6498
q10	8933	3738	3728	3728
q11	481	253	239	239
q12	446	234	235	234
q13	17777	3002	3008	3002
q14	266	219	237	219
q15	529	483	491	483
q16	511	369	374	369
q17	978	746	675	675
q18	8049	7454	7462	7454
q19	5234	1452	1545	1452
q20	703	340	350	340
q21	4987	3340	3922	3340
q22	403	355	351	351
Total cold run time: 119742 ms
Total hot run time: 40200 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4417	4266	4264	4264
q2	362	271	268	268
q3	2994	2741	2762	2741
q4	1892	1592	1622	1592
q5	5269	5288	5284	5284
q6	221	132	130	130
q7	2089	1695	1671	1671
q8	3207	3362	3320	3320
q9	8353	8389	8388	8388
q10	3928	3686	3622	3622
q11	588	485	483	483
q12	761	613	622	613
q13	16397	3002	2974	2974
q14	291	249	260	249
q15	506	485	472	472
q16	467	411	409	409
q17	1763	1488	1459	1459
q18	7698	7576	7336	7336
q19	1731	1589	1580	1580
q20	1988	1807	1754	1754
q21	4887	4746	4804	4746
q22	630	539	548	539
Total cold run time: 70439 ms
Total hot run time: 53894 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 172396 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e0b952a86e7684c37e0264b8d848aa4f1b95475c, data reload: false

query1	920	382	371	371
query2	6469	2438	2334	2334
query3	6656	202	208	202
query4	19826	17761	17320	17320
query5	4207	494	510	494
query6	280	168	161	161
query7	4613	304	306	304
query8	345	294	306	294
query9	8696	2450	2450	2450
query10	632	298	297	297
query11	10572	10158	10134	10134
query12	138	86	84	84
query13	1649	379	374	374
query14	8601	7643	6453	6453
query15	236	195	191	191
query16	7822	323	315	315
query17	1575	564	550	550
query18	1915	283	275	275
query19	202	161	157	157
query20	93	89	82	82
query21	217	132	125	125
query22	4392	4006	4049	4006
query23	33708	33050	33033	33033
query24	12230	2855	2878	2855
query25	702	383	388	383
query26	1833	161	157	157
query27	3127	321	316	316
query28	7943	2120	2101	2101
query29	1168	661	630	630
query30	293	157	161	157
query31	949	748	761	748
query32	97	60	57	57
query33	787	315	296	296
query34	975	483	483	483
query35	764	667	620	620
query36	1071	941	926	926
query37	303	79	81	79
query38	2913	2737	2747	2737
query39	867	812	800	800
query40	279	131	127	127
query41	59	53	56	53
query42	129	103	106	103
query43	595	540	516	516
query44	1228	738	745	738
query45	198	168	168	168
query46	1081	723	725	723
query47	1888	1763	1770	1763
query48	375	309	304	304
query49	1221	433	439	433
query50	778	393	398	393
query51	6860	6682	6755	6682
query52	112	97	105	97
query53	368	296	296	296
query54	997	456	457	456
query55	78	80	79	79
query56	308	282	288	282
query57	1164	1059	1058	1058
query58	262	354	264	264
query59	3450	3309	3240	3240
query60	320	289	271	271
query61	106	98	94	94
query62	663	435	468	435
query63	323	307	298	298
query64	9879	2283	1749	1749
query65	3188	3094	3129	3094
query66	1383	369	334	334
query67	15772	15048	15093	15048
query68	6605	562	544	544
query69	673	463	331	331
query70	1179	1145	1079	1079
query71	532	279	274	274
query72	9060	5407	5422	5407
query73	824	326	323	323
query74	5953	5534	5527	5527
query75	5032	2671	2689	2671
query76	4812	926	952	926
query77	775	319	319	319
query78	9540	8948	8819	8819
query79	8054	528	534	528
query80	2218	495	503	495
query81	588	221	219	219
query82	849	111	108	108
query83	290	173	173	173
query84	271	89	132	89
query85	1459	278	291	278
query86	463	315	328	315
query87	3299	3109	3141	3109
query88	4798	2395	2354	2354
query89	508	392	384	384
query90	1996	195	195	195
query91	132	104	102	102
query92	66	49	51	49
query93	6178	516	527	516
query94	1311	229	217	217
query95	418	324	326	324
query96	641	273	272	272
query97	3160	3063	2967	2967
query98	221	194	191	191
query99	1160	852	842	842
Total cold run time: 295915 ms
Total hot run time: 172396 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.1 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e0b952a86e7684c37e0264b8d848aa4f1b95475c, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.22	0.05	0.06
query4	1.66	0.08	0.09
query5	0.50	0.49	0.50
query6	1.15	0.73	0.72
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.55	0.50	0.49
query10	0.55	0.55	0.55
query11	0.16	0.12	0.12
query12	0.15	0.13	0.12
query13	0.60	0.58	0.59
query14	0.78	0.78	0.80
query15	0.86	0.81	0.83
query16	0.37	0.36	0.36
query17	0.98	0.99	0.95
query18	0.23	0.25	0.26
query19	1.92	1.78	1.82
query20	0.02	0.01	0.01
query21	15.39	0.74	0.66
query22	4.19	6.77	2.30
query23	18.66	1.33	1.24
query24	2.06	0.22	0.23
query25	0.15	0.09	0.10
query26	0.27	0.18	0.18
query27	0.09	0.08	0.08
query28	13.34	1.02	1.01
query29	12.63	3.31	3.32
query30	0.25	0.06	0.05
query31	2.88	0.39	0.39
query32	3.27	0.47	0.48
query33	2.90	2.94	2.92
query34	17.12	4.40	4.46
query35	4.52	4.47	4.45
query36	0.66	0.46	0.48
query37	0.20	0.16	0.15
query38	0.15	0.15	0.16
query39	0.04	0.04	0.03
query40	0.18	0.14	0.15
query41	0.10	0.05	0.05
query42	0.06	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 110.05 s
Total hot run time: 31.1 s

JNSimba
JNSimba approved these changes Jul 4, 2024
View reviewed changes
Copy link
Member

@JNSimba JNSimba left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@CalvinKirs CalvinKirs merged commit a8aa038 into apache:master Jul 4, 2024
26 of 29 checks passed
@CalvinKirs CalvinKirs deleted the master-paimon-211 branch July 4, 2024 11:21
CalvinKirs added a commit to CalvinKirs/incubator-doris that referenced this pull request Jul 9, 2024
@CalvinKirs
[dependencies](fe)upgrade paimon to 0.8.1 (apache#37205)
d977828 
## Proposed changes
FYI apache/doris-shade#46

(cherry picked from commit a8aa038)
@CalvinKirs CalvinKirs mentioned this pull request Jul 9, 2024
Merged
morningman pushed a commit that referenced this pull request Jul 10, 2024
@CalvinKirs
[dependencies](fe)upgrade paimon to 0.8.1 (#37205) (#37554)
770e7d2 
bp #37205
dataroaring pushed a commit that referenced this pull request Jul 17, 2024
@CalvinKirs @dataroaring
[dependencies](fe)upgrade paimon to 0.8.1 (#37205)
42fdc22 
## Proposed changes
FYI apache/doris-shade#46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@JNSimba JNSimba JNSimba approved these changes

@morningman morningman morningman approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.5-merged dev/3.0.1-merged reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@CalvinKirs @doris-robot @morningman @JNSimba @dataroaring