Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[fix](schema-change) fix the bug of alter column nullable when double writing (#41737) #42351

Merged
merged 5 commits into from
Oct 30, 2024
Merged

[fix](schema-change) fix the bug of alter column nullable when double writing (#41737) #42351

merged 5 commits into from
Oct 30, 2024
+88 −10

Conversation

luwei16
Copy link
Contributor

@luwei16 luwei16 commented Oct 23, 2024 •
edited
Loading

pick master #41737

@luwei16
[fix](schema-change) fix the bug of alter column nullable when double…
f2894ba 
… writing (apache#41737)

CREATE TABLE t (
    `k1` VARCHAR(30) NOT NULL,
    `v1` INT NOT NULL
)

alter table t modify column `v1` INT NULL

insert into value ('1', 2), ('1', 3);

core dump

Schema change leads to double writing, during double writing, the two
schemas and slots are as follows

```
old tablet schema
k1 varchar not null
v1 int not null
```

```
new tablet scheam
k1 varchar not null
v1 int null
```

```
slot
k1 varchar not null
v1 int not null
v1 int null
```

During the double writing process, when selecting slots through the
schema, only the column names and types were compared, without comparing
the nullable attributes, which led to the selection of the wrong slot.
Since the slot determines the nullable attribute of the block, the
nullable attribute of the columns in the block is different from that of
the columns in the schema, resulting in a core dump.
@luwei16
Merge remote-tracking branch 'doris-origin/branch-2.0' into luwei/fix…
02d0052 
…-alter-null-2.0
@luwei16
fix
0cb8b92
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@luwei16
Copy link
Contributor Author

luwei16 commented Oct 23, 2024

run buildall

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 49227 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0cb8b92ed2ed038148a52a538c72035c51fcaff5, data reload: false

------ Round 1 ----------------------------------
q1	17686	4399	4305	4305
q2	2074	158	150	150
q3	10267	1889	1943	1889
q4	10112	1252	1323	1252
q5	8421	3931	3910	3910
q6	239	126	125	125
q7	2041	1577	1599	1577
q8	9543	2748	2709	2709
q9	13926	10168	9947	9947
q10	8645	3521	3509	3509
q11	414	248	249	248
q12	460	297	300	297
q13	18343	3963	4000	3963
q14	367	324	326	324
q15	508	471	466	466
q16	533	464	450	450
q17	1130	1001	964	964
q18	7193	6844	6842	6842
q19	1661	1572	1558	1558
q20	536	320	301	301
q21	4428	4104	4051	4051
q22	491	390	407	390
Total cold run time: 119018 ms
Total hot run time: 49227 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4299	4285	4309	4285
q2	331	224	223	223
q3	4123	4184	4132	4132
q4	2741	2728	2755	2728
q5	7195	7178	7191	7178
q6	237	124	119	119
q7	3224	2795	2811	2795
q8	4398	4455	4470	4455
q9	14260	13728	13940	13728
q10	4222	4230	4246	4230
q11	780	689	673	673
q12	1044	843	849	843
q13	6973	3764	3680	3680
q14	471	430	435	430
q15	509	455	454	454
q16	649	607	579	579
q17	3777	3823	3857	3823
q18	8832	8726	8853	8726
q19	1699	1684	1650	1650
q20	2403	2119	2126	2119
q21	8464	8541	8371	8371
q22	1006	955	901	901
Total cold run time: 81637 ms
Total hot run time: 76122 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.85% (8157/21553)
Line Coverage: 29.57% (67130/227038)
Region Coverage: 29.05% (34616/119179)
Branch Coverage: 25.00% (17871/71486)
Coverage Report: http://coverage.selectdb-in.cc/coverage/0cb8b92ed2ed038148a52a538c72035c51fcaff5_0cb8b92ed2ed038148a52a538c72035c51fcaff5/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 213659 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0cb8b92ed2ed038148a52a538c72035c51fcaff5, data reload: false

query1	946	390	408	390
query2	6561	2143	2107	2107
query3	6919	203	199	199
query4	23184	21325	21461	21325
query5	19740	6527	6511	6511
query6	290	219	236	219
query7	4337	306	312	306
query8	279	244	266	244
query9	3125	2666	2594	2594
query10	470	310	316	310
query11	15652	15229	14758	14758
query12	135	79	73	73
query13	1032	447	443	443
query14	17039	13321	13543	13321
query15	391	228	232	228
query16	6484	282	260	260
query17	1755	964	911	911
query18	905	319	319	319
query19	209	156	155	155
query20	104	105	99	99
query21	191	99	95	95
query22	5274	5135	5059	5059
query23	34232	33335	33499	33335
query24	7656	6234	6359	6234
query25	503	435	434	434
query26	1257	167	168	167
query27	2295	298	292	292
query28	6092	2270	2241	2241
query29	2965	2657	2846	2657
query30	239	170	168	168
query31	971	737	728	728
query32	75	63	56	56
query33	444	266	249	249
query34	846	465	474	465
query35	1143	987	930	930
query36	1483	1170	1183	1170
query37	91	61	61	61
query38	3102	2896	2927	2896
query39	1370	1332	1328	1328
query40	304	100	98	98
query41	40	40	38	38
query42	87	86	92	86
query43	612	572	655	572
query44	1181	719	728	719
query45	252	231	232	231
query46	1233	969	959	959
query47	1774	1871	1706	1706
query48	518	411	402	402
query49	649	384	370	370
query50	866	607	591	591
query51	4816	4645	4709	4645
query52	88	85	89	85
query53	239	186	191	186
query54	2646	2460	2481	2460
query55	91	81	80	80
query56	226	210	213	210
query57	1282	1173	1175	1173
query58	212	215	221	215
query59	3541	3207	3220	3207
query60	224	219	210	210
query61	99	95	98	95
query62	843	460	522	460
query63	204	177	178	177
query64	3573	1576	1425	1425
query65	3632	3549	3564	3549
query66	784	433	434	433
query67	17899	15593	15420	15420
query68	10290	647	632	632
query69	499	270	280	270
query70	1663	1461	1306	1306
query71	415	311	310	310
query72	6860	4925	4888	4888
query73	764	319	326	319
query74	6361	5893	5793	5793
query75	5364	3652	3659	3652
query76	5946	1115	1211	1115
query77	1021	260	263	260
query78	12935	15138	13350	13350
query79	11496	639	658	639
query80	837	393	382	382
query81	511	235	233	233
query82	267	100	94	94
query83	203	136	134	134
query84	264	73	70	70
query85	763	325	324	324
query86	329	284	287	284
query87	3247	3058	3099	3058
query88	4297	2294	2286	2286
query89	384	300	280	280
query90	2678	216	213	213
query91	157	133	129	129
query92	62	53	52	52
query93	980	543	525	525
query94	1194	215	209	209
query95	2042	2001	2040	2001
query96	640	321	327	321
query97	6556	6369	6345	6345
query98	210	218	200	200
query99	3052	846	963	846
Total cold run time: 319988 ms
Total hot run time: 213659 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.49 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0cb8b92ed2ed038148a52a538c72035c51fcaff5, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.26	0.05	0.05
query4	1.78	0.07	0.06
query5	0.52	0.53	0.53
query6	1.22	0.60	0.61
query7	0.02	0.01	0.02
query8	0.03	0.02	0.02
query9	0.53	0.48	0.48
query10	0.53	0.53	0.54
query11	0.12	0.08	0.09
query12	0.12	0.10	0.09
query13	0.61	0.61	0.60
query14	0.80	0.79	0.81
query15	0.77	0.78	0.76
query16	0.38	0.34	0.38
query17	1.00	1.01	1.02
query18	0.22	0.27	0.24
query19	1.87	1.85	1.84
query20	0.02	0.01	0.01
query21	15.45	0.54	0.55
query22	1.91	2.37	1.59
query23	16.76	1.20	0.97
query24	5.29	0.80	1.36
query25	0.39	0.10	0.04
query26	0.57	0.16	0.16
query27	0.05	0.04	0.03
query28	7.69	0.79	0.71
query29	12.64	2.36	2.24
query30	0.63	0.54	0.55
query31	2.81	0.39	0.37
query32	3.39	0.49	0.49
query33	3.07	3.09	3.05
query34	15.24	4.80	4.83
query35	4.85	4.88	4.83
query36	1.04	1.01	1.01
query37	0.05	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.14	0.14
query41	0.06	0.02	0.01
query42	0.02	0.02	0.01
query43	0.02	0.02	0.01
Total cold run time: 103.03 s
Total hot run time: 30.49 s

@luwei16
Copy link
Contributor Author

luwei16 commented Oct 25, 2024

run buildall

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.85% (8157/21553)
Line Coverage: 29.57% (67131/227046)
Region Coverage: 29.05% (34618/119182)
Branch Coverage: 25.00% (17871/71488)
Coverage Report: http://coverage.selectdb-in.cc/coverage/29f4deca9bcf2f5ace07c42a6d985046073f2a0c_29f4deca9bcf2f5ace07c42a6d985046073f2a0c/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 48968 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 29f4deca9bcf2f5ace07c42a6d985046073f2a0c, data reload: false

------ Round 1 ----------------------------------
q1	17670	4395	4303	4303
q2	2099	154	147	147
q3	10398	1924	1923	1923
q4	10360	1238	1317	1238
q5	8390	3855	3917	3855
q6	233	127	122	122
q7	2047	1613	1610	1610
q8	9304	2737	2723	2723
q9	10147	9807	9780	9780
q10	8662	3556	3516	3516
q11	420	255	256	255
q12	469	292	295	292
q13	18375	3945	4035	3945
q14	349	328	325	325
q15	516	454	461	454
q16	529	446	454	446
q17	1128	971	945	945
q18	7232	6787	6909	6787
q19	1660	1561	1532	1532
q20	531	320	292	292
q21	4433	4167	4081	4081
q22	495	397	397	397
Total cold run time: 115447 ms
Total hot run time: 48968 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4312	4274	4288	4274
q2	320	229	226	226
q3	4156	4143	4153	4143
q4	2737	2743	2740	2740
q5	7095	7070	7114	7070
q6	240	123	120	120
q7	3266	2878	2896	2878
q8	4385	4564	4473	4473
q9	13628	13602	13499	13499
q10	4275	4288	4252	4252
q11	773	637	691	637
q12	1016	838	854	838
q13	6719	3729	3757	3729
q14	460	439	420	420
q15	499	463	460	460
q16	655	613	585	585
q17	3897	3872	3817	3817
q18	8714	8764	8674	8674
q19	1716	1682	1622	1622
q20	2355	2144	2105	2105
q21	8572	8396	8525	8396
q22	989	943	970	943
Total cold run time: 80779 ms
Total hot run time: 75901 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 211758 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 29f4deca9bcf2f5ace07c42a6d985046073f2a0c, data reload: false

query1	943	419	373	373
query2	6538	2210	2070	2070
query3	6942	200	196	196
query4	23566	21514	21378	21378
query5	19735	6543	6487	6487
query6	283	222	231	222
query7	4333	298	295	295
query8	272	251	257	251
query9	3037	2628	2554	2554
query10	458	302	289	289
query11	15618	15372	14908	14908
query12	123	77	71	71
query13	1051	434	421	421
query14	17585	13309	13235	13235
query15	389	222	230	222
query16	6483	274	257	257
query17	1790	923	907	907
query18	900	318	323	318
query19	211	149	143	143
query20	102	100	102	100
query21	191	97	91	91
query22	5208	4884	4968	4884
query23	34361	33540	33544	33540
query24	7810	6302	6284	6284
query25	519	434	420	420
query26	1263	167	162	162
query27	2383	297	289	289
query28	6148	2251	2210	2210
query29	2806	2705	2615	2615
query30	241	169	165	165
query31	975	733	724	724
query32	71	61	57	57
query33	449	239	263	239
query34	844	485	476	476
query35	1127	916	925	916
query36	1322	1192	1737	1192
query37	172	60	65	60
query38	3077	2912	2936	2912
query39	1368	1327	1322	1322
query40	308	96	92	92
query41	41	37	36	36
query42	86	84	90	84
query43	668	649	536	536
query44	1159	720	711	711
query45	247	229	231	229
query46	1236	993	972	972
query47	1812	2016	1797	1797
query48	495	424	411	411
query49	645	370	389	370
query50	859	615	625	615
query51	4817	4662	4678	4662
query52	87	71	83	71
query53	225	178	197	178
query54	2626	2482	2471	2471
query55	93	87	85	85
query56	235	217	206	206
query57	1282	1246	1156	1156
query58	210	218	213	213
query59	3369	3012	3432	3012
query60	218	214	200	200
query61	97	94	95	94
query62	876	444	503	444
query63	195	177	174	174
query64	3536	1578	1498	1498
query65	3646	3535	3551	3535
query66	783	382	395	382
query67	17293	16951	15786	15786
query68	9155	647	632	632
query69	499	281	265	265
query70	1732	1390	1341	1341
query71	399	306	305	305
query72	6815	4804	4970	4804
query73	748	318	320	318
query74	6201	5907	5789	5789
query75	4662	3801	3656	3656
query76	4778	1119	1127	1119
query77	663	259	255	255
query78	12453	11553	12175	11553
query79	6020	635	618	618
query80	2330	395	373	373
query81	509	236	234	234
query82	1505	95	102	95
query83	176	140	139	139
query84	257	72	70	70
query85	1318	308	317	308
query86	361	313	286	286
query87	3237	3029	3015	3015
query88	4711	2280	2299	2280
query89	418	292	283	283
query90	1787	206	202	202
query91	157	135	136	135
query92	61	50	49	49
query93	4844	544	559	544
query94	872	206	205	205
query95	2036	2012	1915	1915
query96	647	325	321	321
query97	6425	6384	6298	6298
query98	219	209	215	209
query99	2906	1010	867	867
Total cold run time: 316739 ms
Total hot run time: 211758 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.01 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 29f4deca9bcf2f5ace07c42a6d985046073f2a0c, data reload: false

query1	0.02	0.02	0.03
query2	0.07	0.02	0.03
query3	0.25	0.04	0.05
query4	1.85	0.06	0.07
query5	0.53	0.52	0.52
query6	1.24	0.72	0.60
query7	0.01	0.01	0.01
query8	0.04	0.02	0.02
query9	0.52	0.49	0.48
query10	0.54	0.52	0.54
query11	0.13	0.09	0.09
query12	0.12	0.10	0.10
query13	0.62	0.61	0.61
query14	0.78	0.79	0.82
query15	0.79	0.76	0.76
query16	0.39	0.39	0.38
query17	0.99	1.02	1.04
query18	0.21	0.28	0.24
query19	1.91	1.84	1.85
query20	0.02	0.01	0.00
query21	15.45	0.60	0.57
query22	2.11	2.51	1.67
query23	17.34	1.11	0.94
query24	4.86	2.00	1.10
query25	0.38	0.07	0.07
query26	0.66	0.15	0.15
query27	0.04	0.03	0.05
query28	7.21	0.75	0.76
query29	12.64	2.30	2.32
query30	0.59	0.50	0.54
query31	2.81	0.38	0.37
query32	3.41	0.50	0.49
query33	3.07	3.07	3.04
query34	15.25	4.80	4.80
query35	4.83	4.83	4.87
query36	1.06	1.02	1.02
query37	0.06	0.05	0.04
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.15	0.14
query41	0.07	0.02	0.02
query42	0.02	0.02	0.01
query43	0.02	0.02	0.02
Total cold run time: 103.13 s
Total hot run time: 31.01 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 29f4deca9bcf2f5ace07c42a6d985046073f2a0c with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.5 seconds inserted 10000000 Rows, about 465K ops/s

@luwei16
Copy link
Contributor Author

luwei16 commented Oct 28, 2024

run buildall

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 48984 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 03e85d52e4266daedf7d304b51cff536f37929c4, data reload: false

------ Round 1 ----------------------------------
q1	17630	4422	4381	4381
q2	2056	160	144	144
q3	10260	1929	1908	1908
q4	10382	1250	1314	1250
q5	8475	3882	3885	3882
q6	235	123	123	123
q7	2053	1598	1575	1575
q8	9497	2714	2723	2714
q9	13364	10024	9672	9672
q10	8641	3553	3498	3498
q11	422	251	255	251
q12	467	299	304	299
q13	18355	4003	4010	4003
q14	348	334	337	334
q15	511	464	463	463
q16	532	451	454	451
q17	1114	936	921	921
q18	7297	6905	6828	6828
q19	1655	1529	1546	1529
q20	517	314	318	314
q21	4434	4135	4052	4052
q22	494	392	404	392
Total cold run time: 118739 ms
Total hot run time: 48984 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4276	4280	4294	4280
q2	315	224	219	219
q3	4198	4158	4138	4138
q4	2743	2746	2738	2738
q5	7126	7122	7089	7089
q6	238	120	117	117
q7	3279	2825	2823	2823
q8	4347	4455	4501	4455
q9	13839	13722	13496	13496
q10	4210	4259	4290	4259
q11	747	694	704	694
q12	1044	866	842	842
q13	6618	3737	3701	3701
q14	456	429	422	422
q15	489	461	451	451
q16	639	589	595	589
q17	3825	3844	3847	3844
q18	8709	8721	8751	8721
q19	1733	1616	1642	1616
q20	2409	2118	2088	2088
q21	8591	8449	8532	8449
q22	1027	960	978	960
Total cold run time: 80858 ms
Total hot run time: 75991 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.86% (8159/21553)
Line Coverage: 29.57% (67137/227046)
Region Coverage: 29.05% (34622/119182)
Branch Coverage: 25.00% (17870/71488)
Coverage Report: http://coverage.selectdb-in.cc/coverage/03e85d52e4266daedf7d304b51cff536f37929c4_03e85d52e4266daedf7d304b51cff536f37929c4/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 212059 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 03e85d52e4266daedf7d304b51cff536f37929c4, data reload: false

query1	943	392	414	392
query2	6560	2262	2075	2075
query3	6917	201	211	201
query4	23431	21676	21625	21625
query5	19732	6523	6475	6475
query6	289	221	242	221
query7	4156	292	312	292
query8	269	248	229	229
query9	3055	2638	2562	2562
query10	417	300	299	299
query11	15741	14998	15081	14998
query12	129	74	73	73
query13	1022	439	435	435
query14	17088	13707	13251	13251
query15	383	223	233	223
query16	6498	280	261	261
query17	1736	959	908	908
query18	902	318	307	307
query19	202	152	149	149
query20	103	106	95	95
query21	196	101	98	98
query22	5258	5177	5095	5095
query23	34302	33325	33636	33325
query24	7844	6332	6394	6332
query25	519	432	426	426
query26	1271	168	160	160
query27	2493	294	292	292
query28	6062	2228	2196	2196
query29	2858	2782	2702	2702
query30	244	170	166	166
query31	946	718	734	718
query32	69	64	58	58
query33	456	250	270	250
query34	842	466	456	456
query35	1127	929	931	929
query36	1363	1212	1026	1026
query37	175	63	61	61
query38	3120	2937	2931	2931
query39	1371	1328	1332	1328
query40	309	91	96	91
query41	40	37	36	36
query42	94	95	84	84
query43	649	706	652	652
query44	1148	725	722	722
query45	247	239	233	233
query46	1245	967	963	963
query47	1766	1763	1680	1680
query48	498	403	409	403
query49	656	369	394	369
query50	872	605	607	605
query51	4770	4594	4676	4594
query52	102	74	79	74
query53	227	184	196	184
query54	2700	2465	2534	2465
query55	105	83	90	83
query56	227	205	205	205
query57	1352	1111	1183	1111
query58	225	219	205	205
query59	3492	3448	3279	3279
query60	218	210	207	207
query61	93	96	95	95
query62	830	484	470	470
query63	197	177	169	169
query64	3541	1583	1369	1369
query65	3642	3554	3552	3552
query66	764	427	415	415
query67	16121	15835	15286	15286
query68	9556	627	633	627
query69	493	280	256	256
query70	1594	1500	1489	1489
query71	407	314	304	304
query72	6842	4790	4954	4790
query73	739	318	317	317
query74	6341	5906	5802	5802
query75	5251	3726	3726	3726
query76	5234	1126	1211	1126
query77	890	258	269	258
query78	12807	11487	12525	11487
query79	9497	628	631	628
query80	1136	378	399	378
query81	482	240	237	237
query82	1451	101	97	97
query83	164	131	138	131
query84	254	71	70	70
query85	911	311	316	311
query86	326	291	287	287
query87	3180	3055	3078	3055
query88	4636	2301	2291	2291
query89	504	281	287	281
query90	2022	215	221	215
query91	161	130	141	130
query92	61	50	50	50
query93	6151	533	536	533
query94	708	211	209	209
query95	2014	1947	1958	1947
query96	653	324	334	324
query97	6509	6412	6470	6412
query98	220	208	205	205
query99	2869	897	865	865
Total cold run time: 320282 ms
Total hot run time: 212059 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.43 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 03e85d52e4266daedf7d304b51cff536f37929c4, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.25	0.04	0.04
query4	1.80	0.07	0.06
query5	0.54	0.52	0.51
query6	1.26	0.61	0.67
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.54	0.48	0.48
query10	0.54	0.54	0.54
query11	0.12	0.08	0.08
query12	0.11	0.10	0.09
query13	0.62	0.60	0.61
query14	0.78	0.79	0.78
query15	0.77	0.77	0.75
query16	0.35	0.36	0.35
query17	1.01	1.01	1.00
query18	0.22	0.26	0.24
query19	1.95	1.85	1.86
query20	0.01	0.01	0.01
query21	15.46	0.53	0.54
query22	2.24	2.83	1.98
query23	17.15	1.01	0.93
query24	6.71	1.54	1.35
query25	0.37	0.11	0.04
query26	0.84	0.16	0.15
query27	0.05	0.04	0.03
query28	5.60	0.81	0.77
query29	12.66	2.30	2.26
query30	0.59	0.54	0.51
query31	2.80	0.38	0.37
query32	3.39	0.50	0.49
query33	3.10	3.12	3.06
query34	15.24	4.80	4.78
query35	4.85	4.85	4.86
query36	1.05	1.02	1.01
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.15	0.14	0.14
query41	0.07	0.02	0.01
query42	0.02	0.02	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.49 s
Total hot run time: 31.43 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 03e85d52e4266daedf7d304b51cff536f37929c4 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.2 seconds inserted 10000000 Rows, about 471K ops/s

@dataroaring dataroaring merged commit 6d50c28 into apache:branch-2.0 Oct 30, 2024
19 of 23 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
kind/test
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@luwei16 @doris-robot @dataroaring