Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feature](backup) backup restore coloate table #46059

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

justfortaste
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@justfortaste
Copy link
Contributor Author

run buildall

@justfortaste
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32947 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ad3cfd2f143eea6042e2685f7883319cad57252a, data reload: false

------ Round 1 ----------------------------------
q1	17588	6192	6170	6170
q2	2045	325	174	174
q3	10387	1356	713	713
q4	10192	916	449	449
q5	7532	2317	2034	2034
q6	221	182	147	147
q7	909	763	609	609
q8	9240	1484	1278	1278
q9	5300	4956	4987	4956
q10	6783	2318	1872	1872
q11	489	272	269	269
q12	351	374	229	229
q13	17752	3635	2980	2980
q14	237	236	206	206
q15	578	502	499	499
q16	632	639	579	579
q17	571	891	325	325
q18	7142	6452	6355	6355
q19	1226	1045	589	589
q20	322	323	182	182
q21	2976	2261	2020	2020
q22	368	323	312	312
Total cold run time: 102841 ms
Total hot run time: 32947 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6346	6388	6391	6388
q2	249	329	230	230
q3	2241	2656	2298	2298
q4	1432	1829	1359	1359
q5	4352	4788	4996	4788
q6	196	180	146	146
q7	2152	1985	1795	1795
q8	2661	2868	2713	2713
q9	7329	7252	7230	7230
q10	3077	3311	2853	2853
q11	590	522	496	496
q12	664	761	596	596
q13	3349	3810	3091	3091
q14	282	293	298	293
q15	593	513	503	503
q16	636	699	650	650
q17	1266	1748	1251	1251
q18	7727	7424	7289	7289
q19	848	1196	1146	1146
q20	1942	1969	1839	1839
q21	5446	5050	4885	4885
q22	613	612	581	581
Total cold run time: 53991 ms
Total hot run time: 52420 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 188856 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ad3cfd2f143eea6042e2685f7883319cad57252a, data reload: false

query1	958	373	362	362
query2	6518	2469	2405	2405
query3	6706	218	208	208
query4	34076	23662	23321	23321
query5	4293	630	468	468
query6	287	195	198	195
query7	4628	491	305	305
query8	282	240	233	233
query9	9532	2721	2703	2703
query10	436	317	235	235
query11	18086	15444	15549	15444
query12	165	106	106	106
query13	1679	558	408	408
query14	12108	6716	7202	6716
query15	237	194	182	182
query16	8095	577	433	433
query17	1534	745	546	546
query18	2095	390	284	284
query19	211	181	155	155
query20	116	111	109	109
query21	204	119	99	99
query22	4263	4538	4140	4140
query23	34383	33343	33283	33283
query24	6215	2306	2246	2246
query25	511	459	373	373
query26	771	269	150	150
query27	2027	464	337	337
query28	5387	2463	2406	2406
query29	655	532	401	401
query30	230	179	149	149
query31	998	921	805	805
query32	94	57	56	56
query33	519	366	285	285
query34	738	829	513	513
query35	802	813	772	772
query36	995	1038	943	943
query37	115	104	73	73
query38	4145	4106	4140	4106
query39	1476	1452	1419	1419
query40	208	116	106	106
query41	49	51	51	51
query42	125	102	101	101
query43	521	543	501	501
query44	1283	798	805	798
query45	183	175	167	167
query46	871	1034	651	651
query47	1892	1883	1864	1864
query48	378	397	335	335
query49	751	488	394	394
query50	654	642	378	378
query51	7228	7263	7054	7054
query52	95	99	91	91
query53	218	249	183	183
query54	466	474	397	397
query55	80	78	77	77
query56	238	250	218	218
query57	1221	1158	1118	1118
query58	239	220	229	220
query59	3047	3146	2926	2926
query60	274	262	248	248
query61	109	115	107	107
query62	829	846	750	750
query63	238	189	191	189
query64	3747	1028	621	621
query65	3270	3128	3261	3128
query66	842	417	300	300
query67	16152	16164	15570	15570
query68	8645	744	507	507
query69	483	279	258	258
query70	1241	1127	1040	1040
query71	423	284	252	252
query72	5746	3794	3777	3777
query73	661	745	353	353
query74	9642	9379	8855	8855
query75	4568	3259	2614	2614
query76	4612	1200	776	776
query77	864	351	267	267
query78	10059	10251	9227	9227
query79	3071	895	591	591
query80	650	504	444	444
query81	488	269	238	238
query82	690	148	119	119
query83	164	172	153	153
query84	236	89	86	86
query85	805	362	301	301
query86	344	318	339	318
query87	4595	4605	4308	4308
query88	4023	2254	2207	2207
query89	410	326	305	305
query90	1937	186	186	186
query91	137	129	111	111
query92	65	56	50	50
query93	952	854	522	522
query94	657	373	276	276
query95	327	262	251	251
query96	497	606	279	279
query97	2749	2822	2642	2642
query98	231	234	199	199
query99	2561	1570	1427	1427
Total cold run time: 294311 ms
Total hot run time: 188856 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.98 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ad3cfd2f143eea6042e2685f7883319cad57252a, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.22	0.08	0.07
query4	1.61	0.10	0.10
query5	0.45	0.41	0.40
query6	1.13	0.65	0.66
query7	0.03	0.02	0.01
query8	0.04	0.03	0.02
query9	0.57	0.51	0.51
query10	0.55	0.55	0.55
query11	0.15	0.11	0.11
query12	0.14	0.11	0.12
query13	0.60	0.60	0.60
query14	2.72	2.77	2.76
query15	0.89	0.83	0.84
query16	0.38	0.39	0.39
query17	1.07	1.05	1.03
query18	0.23	0.21	0.21
query19	1.91	1.89	1.98
query20	0.01	0.02	0.01
query21	15.38	0.94	0.56
query22	0.76	0.89	0.57
query23	15.30	1.40	0.52
query24	3.24	2.01	1.68
query25	0.20	0.10	0.13
query26	0.28	0.17	0.14
query27	0.06	0.04	0.05
query28	14.38	1.45	1.05
query29	12.55	3.89	3.24
query30	0.24	0.09	0.06
query31	2.83	0.59	0.38
query32	3.24	0.55	0.46
query33	3.05	3.08	3.11
query34	16.76	5.11	4.50
query35	4.49	4.47	4.46
query36	0.66	0.49	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.14	0.13
query41	0.08	0.03	0.03
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.74 s
Total hot run time: 31.98 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants