You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org> on 2024/07/16 07:13:08 UTC

[PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

zhiqiang-hhhh opened a new pull request, #37896:
URL: https://github.com/apache/doris/pull/37896

   about 25% improvement


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232498348

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232506959

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232531359

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 39770 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 0135fe1c450dcfe8ed75a1239b7d44c25a7bb292, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17621	4461	4253	4253
   q2	2014	192	180	180
   q3	10450	1197	1099	1099
   q4	10194	798	851	798
   q5	7528	2695	2607	2607
   q6	223	140	140	140
   q7	959	604	606	604
   q8	9222	2099	2054	2054
   q9	8802	6588	6522	6522
   q10	8894	3815	3782	3782
   q11	432	236	235	235
   q12	442	238	237	237
   q13	17770	3012	2996	2996
   q14	270	236	244	236
   q15	532	493	493	493
   q16	511	380	380	380
   q17	966	709	725	709
   q18	7978	7449	7378	7378
   q19	4329	1372	1297	1297
   q20	654	314	320	314
   q21	4941	3179	3955	3179
   q22	353	277	289	277
   Total cold run time: 115085 ms
   Total hot run time: 39770 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4450	4308	4243	4243
   q2	376	278	277	277
   q3	2988	2737	2931	2737
   q4	1976	1745	1624	1624
   q5	5618	5546	5543	5543
   q6	229	138	143	138
   q7	2182	1851	1886	1851
   q8	3314	3409	3428	3409
   q9	8826	8827	8877	8827
   q10	4048	3900	3877	3877
   q11	629	490	496	490
   q12	780	652	623	623
   q13	16379	3213	3189	3189
   q14	331	315	327	315
   q15	532	491	492	491
   q16	507	450	445	445
   q17	1839	1501	1519	1501
   q18	8176	7917	7815	7815
   q19	1816	1365	1447	1365
   q20	2850	1929	1866	1866
   q21	10297	4870	4797	4797
   q22	588	525	531	525
   Total cold run time: 78731 ms
   Total hot run time: 55948 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232704130

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232693245

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232430467

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 40453 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 0cb96a202a8a924fd65b8ce7f7423e63770c7e10, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17910	4560	4428	4428
   q2	2289	188	199	188
   q3	10458	1233	1203	1203
   q4	10201	816	837	816
   q5	7539	2711	2661	2661
   q6	224	137	140	137
   q7	966	608	603	603
   q8	9212	2099	2091	2091
   q9	8692	6541	6597	6541
   q10	8762	3825	3810	3810
   q11	458	236	234	234
   q12	400	234	234	234
   q13	18689	3025	2978	2978
   q14	271	237	253	237
   q15	524	486	500	486
   q16	473	391	387	387
   q17	973	748	757	748
   q18	8053	7614	7372	7372
   q19	3003	1462	1459	1459
   q20	719	331	329	329
   q21	4983	3221	3231	3221
   q22	342	290	296	290
   Total cold run time: 115141 ms
   Total hot run time: 40453 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4394	4340	4312	4312
   q2	375	275	259	259
   q3	3036	2772	2778	2772
   q4	1922	1636	1548	1548
   q5	5317	5305	5309	5305
   q6	225	134	135	134
   q7	2171	1666	1732	1666
   q8	3200	3361	3325	3325
   q9	8457	8416	8403	8403
   q10	3920	3649	3712	3649
   q11	590	515	482	482
   q12	794	589	618	589
   q13	16558	2999	2980	2980
   q14	302	271	282	271
   q15	528	483	485	483
   q16	488	425	437	425
   q17	1789	1485	1470	1470
   q18	7620	7549	7286	7286
   q19	3721	1560	1456	1456
   q20	1984	1792	1779	1779
   q21	4811	4746	4625	4625
   q22	565	482	488	482
   Total cold run time: 72767 ms
   Total hot run time: 53701 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232414508

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232392059

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232730770

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 40229 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit b2ecef09beb2ef9b22f974b1b08a09653d8f1002, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17882	5524	4422	4422
   q2	3009	195	191	191
   q3	11888	1185	1130	1130
   q4	11303	854	841	841
   q5	7982	2683	2680	2680
   q6	222	136	139	136
   q7	953	609	614	609
   q8	9296	2062	2079	2062
   q9	8896	6526	6531	6526
   q10	8765	3741	3799	3741
   q11	465	239	242	239
   q12	394	223	224	223
   q13	18861	2987	2940	2940
   q14	275	239	244	239
   q15	536	487	487	487
   q16	498	375	375	375
   q17	958	772	757	757
   q18	8099	7541	7353	7353
   q19	5812	1363	1428	1363
   q20	678	330	337	330
   q21	4806	3300	3851	3300
   q22	341	285	289	285
   Total cold run time: 121919 ms
   Total hot run time: 40229 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4638	4320	4350	4320
   q2	372	262	256	256
   q3	2989	2829	2720	2720
   q4	1853	1571	1606	1571
   q5	5316	5320	5294	5294
   q6	213	134	129	129
   q7	2078	1712	1732	1712
   q8	3209	3329	3305	3305
   q9	8397	8328	8323	8323
   q10	3912	3744	3742	3742
   q11	575	496	474	474
   q12	793	601	595	595
   q13	16609	2951	2995	2951
   q14	312	269	271	269
   q15	522	472	481	472
   q16	482	435	441	435
   q17	1786	1491	1453	1453
   q18	7542	7422	7375	7375
   q19	2234	1632	1563	1563
   q20	1990	1767	1764	1764
   q21	4899	4709	4704	4704
   q22	573	489	511	489
   Total cold run time: 71294 ms
   Total hot run time: 53916 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232398895

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232546111

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 174694 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 0135fe1c450dcfe8ed75a1239b7d44c25a7bb292, data reload: false
   
   query1	903	379	375	375
   query2	6445	1850	1870	1850
   query3	6633	211	224	211
   query4	28528	17771	17569	17569
   query5	3669	484	486	484
   query6	265	177	169	169
   query7	4580	294	301	294
   query8	253	194	202	194
   query9	8723	2418	2410	2410
   query10	438	283	286	283
   query11	11167	10030	10117	10030
   query12	116	92	84	84
   query13	1646	385	377	377
   query14	9380	8063	8065	8063
   query15	225	170	163	163
   query16	7905	314	309	309
   query17	1805	564	529	529
   query18	1877	279	276	276
   query19	203	146	149	146
   query20	88	84	82	82
   query21	203	133	130	130
   query22	4295	3930	3888	3888
   query23	34072	33798	33787	33787
   query24	11170	2940	2966	2940
   query25	573	406	406	406
   query26	702	157	154	154
   query27	2232	277	296	277
   query28	6462	2064	2064	2064
   query29	886	655	640	640
   query30	252	155	152	152
   query31	944	732	767	732
   query32	103	56	55	55
   query33	757	315	296	296
   query34	963	518	513	513
   query35	691	620	584	584
   query36	1109	968	966	966
   query37	150	87	86	86
   query38	2986	2889	2836	2836
   query39	906	831	824	824
   query40	207	127	125	125
   query41	49	45	45	45
   query42	117	101	103	101
   query43	495	455	510	455
   query44	1205	719	722	719
   query45	205	159	156	156
   query46	1095	754	740	740
   query47	1835	1766	1738	1738
   query48	379	292	291	291
   query49	821	425	423	423
   query50	788	398	395	395
   query51	6965	6759	6887	6759
   query52	108	93	93	93
   query53	358	295	304	295
   query54	901	464	447	447
   query55	80	75	76	75
   query56	293	272	268	268
   query57	1122	1070	1037	1037
   query58	240	268	252	252
   query59	2792	2593	2516	2516
   query60	294	277	278	277
   query61	96	93	96	93
   query62	775	658	642	642
   query63	325	300	326	300
   query64	9190	2245	1672	1672
   query65	3175	3148	3140	3140
   query66	706	330	323	323
   query67	15132	14838	14672	14672
   query68	4582	556	543	543
   query69	622	423	341	341
   query70	1142	1141	1115	1115
   query71	408	295	280	280
   query72	7761	5617	5978	5617
   query73	772	327	331	327
   query74	6085	5636	5651	5636
   query75	3388	2705	2698	2698
   query76	2290	1016	951	951
   query77	684	322	318	318
   query78	11253	9445	9996	9445
   query79	2641	527	532	527
   query80	1485	494	492	492
   query81	580	223	219	219
   query82	502	133	136	133
   query83	343	168	175	168
   query84	280	93	85	85
   query85	762	319	300	300
   query86	478	324	316	316
   query87	3276	3104	3035	3035
   query88	3958	2382	2364	2364
   query89	474	377	399	377
   query90	1862	199	194	194
   query91	128	102	100	100
   query92	66	53	52	52
   query93	3271	511	519	511
   query94	1221	215	216	215
   query95	419	319	322	319
   query96	613	278	273	273
   query97	3235	3014	3020	3014
   query98	226	200	200	200
   query99	1578	1252	1270	1252
   Total cold run time: 280438 ms
   Total hot run time: 174694 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2230667130

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2230186065

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
   See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232764451

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 30.8 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit b2ecef09beb2ef9b22f974b1b08a09653d8f1002, data reload: false
   
   query1	0.04	0.03	0.03
   query2	0.08	0.04	0.03
   query3	0.22	0.05	0.06
   query4	1.67	0.08	0.08
   query5	0.49	0.48	0.48
   query6	1.14	0.73	0.73
   query7	0.02	0.02	0.01
   query8	0.06	0.04	0.05
   query9	0.54	0.49	0.50
   query10	0.54	0.55	0.54
   query11	0.15	0.12	0.11
   query12	0.15	0.12	0.12
   query13	0.59	0.59	0.59
   query14	0.79	0.78	0.77
   query15	0.86	0.84	0.82
   query16	0.36	0.35	0.36
   query17	1.02	0.96	1.02
   query18	0.22	0.22	0.21
   query19	1.92	1.70	1.68
   query20	0.01	0.01	0.01
   query21	15.43	0.75	0.67
   query22	4.01	7.79	2.15
   query23	18.28	1.40	1.26
   query24	2.06	0.22	0.23
   query25	0.16	0.09	0.09
   query26	0.30	0.20	0.21
   query27	0.45	0.23	0.24
   query28	13.28	1.01	0.99
   query29	12.59	3.31	3.32
   query30	0.26	0.06	0.05
   query31	2.88	0.40	0.38
   query32	3.27	0.48	0.48
   query33	2.85	2.85	2.91
   query34	17.04	4.34	4.33
   query35	4.35	4.44	4.41
   query36	0.65	0.49	0.49
   query37	0.18	0.15	0.15
   query38	0.15	0.15	0.15
   query39	0.04	0.03	0.04
   query40	0.16	0.13	0.12
   query41	0.10	0.05	0.05
   query42	0.06	0.05	0.05
   query43	0.04	0.05	0.04
   Total cold run time: 109.46 s
   Total hot run time: 30.8 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232399192

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232409199

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 40055 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit b6505e709205622ae22cc7b38600d22d31c1a8f5, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	18251	4411	4400	4400
   q2	2841	196	191	191
   q3	11105	1177	1004	1004
   q4	10450	894	856	856
   q5	7960	2730	2669	2669
   q6	225	145	141	141
   q7	982	610	623	610
   q8	9544	2047	2081	2047
   q9	8708	6598	6557	6557
   q10	8677	3764	3773	3764
   q11	471	236	241	236
   q12	402	227	233	227
   q13	17775	2999	3002	2999
   q14	267	239	253	239
   q15	524	483	487	483
   q16	491	378	369	369
   q17	952	686	747	686
   q18	8090	7473	7432	7432
   q19	3892	1435	1416	1416
   q20	657	316	339	316
   q21	4871	3127	3955	3127
   q22	350	289	286	286
   Total cold run time: 117485 ms
   Total hot run time: 40055 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4330	4285	4247	4247
   q2	374	277	264	264
   q3	2965	2810	2744	2744
   q4	1865	1618	1605	1605
   q5	5270	5305	5329	5305
   q6	216	133	134	133
   q7	2153	1737	1757	1737
   q8	3225	3341	3324	3324
   q9	8492	8438	8420	8420
   q10	3967	3703	3754	3703
   q11	585	483	492	483
   q12	807	639	619	619
   q13	17586	2985	2989	2985
   q14	299	287	269	269
   q15	527	495	487	487
   q16	474	414	427	414
   q17	1745	1459	1484	1459
   q18	7913	7613	7410	7410
   q19	1681	1511	1654	1511
   q20	2042	1787	1789	1787
   q21	4889	4683	4808	4683
   q22	600	487	486	486
   Total cold run time: 72005 ms
   Total hot run time: 54075 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2230669376

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2230783448

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 40064 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 925e87fbe4afaa020d13390eaff25ae0873c496b, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17788	4645	4513	4513
   q2	2587	195	202	195
   q3	11619	1207	1189	1189
   q4	10287	787	794	787
   q5	7593	2739	2704	2704
   q6	223	140	145	140
   q7	985	610	628	610
   q8	9298	2085	2105	2085
   q9	8760	6608	6554	6554
   q10	8680	3732	3743	3732
   q11	451	244	241	241
   q12	397	225	219	219
   q13	17869	2976	2992	2976
   q14	275	246	238	238
   q15	522	493	488	488
   q16	507	377	384	377
   q17	983	730	653	653
   q18	8070	7632	7388	7388
   q19	8236	1511	1302	1302
   q20	701	315	318	315
   q21	4970	3066	3859	3066
   q22	351	294	292	292
   Total cold run time: 121152 ms
   Total hot run time: 40064 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4495	4308	4218	4218
   q2	380	268	298	268
   q3	3003	2828	2730	2730
   q4	1908	1593	1595	1593
   q5	5339	5321	5303	5303
   q6	217	132	131	131
   q7	2161	1765	1697	1697
   q8	3184	3340	3332	3332
   q9	8452	8386	8416	8386
   q10	3907	3698	3709	3698
   q11	593	486	479	479
   q12	775	598	602	598
   q13	16287	3009	3035	3009
   q14	314	259	274	259
   q15	517	478	467	467
   q16	492	412	418	412
   q17	1791	1508	1466	1466
   q18	7608	7548	7317	7317
   q19	1846	1586	1620	1586
   q20	1992	1780	1773	1773
   q21	4824	4596	4825	4596
   q22	581	514	515	514
   Total cold run time: 70666 ms
   Total hot run time: 53832 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2230748453

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232553712

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 30.64 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 0135fe1c450dcfe8ed75a1239b7d44c25a7bb292, data reload: false
   
   query1	0.04	0.03	0.03
   query2	0.08	0.03	0.04
   query3	0.22	0.05	0.06
   query4	1.67	0.10	0.09
   query5	0.50	0.49	0.49
   query6	1.14	0.73	0.73
   query7	0.02	0.01	0.02
   query8	0.05	0.05	0.04
   query9	0.55	0.47	0.49
   query10	0.56	0.54	0.52
   query11	0.16	0.11	0.11
   query12	0.15	0.12	0.13
   query13	0.59	0.60	0.57
   query14	0.76	0.77	0.78
   query15	0.85	0.82	0.83
   query16	0.35	0.37	0.37
   query17	1.05	1.04	0.98
   query18	0.23	0.22	0.22
   query19	1.89	1.82	1.75
   query20	0.01	0.02	0.01
   query21	15.41	0.74	0.65
   query22	4.31	6.80	1.93
   query23	18.29	1.31	1.24
   query24	2.07	0.23	0.22
   query25	0.16	0.09	0.08
   query26	0.30	0.21	0.21
   query27	0.45	0.24	0.24
   query28	13.36	1.03	0.99
   query29	12.65	3.43	3.34
   query30	0.25	0.06	0.05
   query31	2.87	0.39	0.38
   query32	3.29	0.47	0.46
   query33	2.92	2.90	2.97
   query34	17.20	4.35	4.33
   query35	4.44	4.39	4.48
   query36	0.66	0.47	0.49
   query37	0.19	0.15	0.16
   query38	0.15	0.14	0.15
   query39	0.04	0.04	0.03
   query40	0.15	0.12	0.12
   query41	0.10	0.05	0.05
   query42	0.05	0.06	0.05
   query43	0.05	0.04	0.04
   Total cold run time: 110.23 s
   Total hot run time: 30.64 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232384007

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2230674707

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2230808784

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 172916 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 925e87fbe4afaa020d13390eaff25ae0873c496b, data reload: false
   
   query1	911	377	362	362
   query2	6454	1836	1791	1791
   query3	6661	210	226	210
   query4	27868	17437	17417	17417
   query5	4173	502	483	483
   query6	274	176	168	168
   query7	4600	286	281	281
   query8	241	206	201	201
   query9	8725	2391	2376	2376
   query10	434	291	280	280
   query11	12165	10054	10001	10001
   query12	134	86	86	86
   query13	1634	380	372	372
   query14	10430	7952	7852	7852
   query15	234	173	178	173
   query16	8015	321	324	321
   query17	1787	561	549	549
   query18	2039	280	282	280
   query19	200	158	162	158
   query20	93	81	84	81
   query21	219	132	127	127
   query22	4321	4021	4365	4021
   query23	33827	33066	33294	33066
   query24	12157	2911	2840	2840
   query25	681	388	392	388
   query26	1749	166	155	155
   query27	2944	274	276	274
   query28	7761	1997	1996	1996
   query29	1078	648	645	645
   query30	286	150	149	149
   query31	951	740	749	740
   query32	96	55	60	55
   query33	792	316	313	313
   query34	956	492	501	492
   query35	705	597	622	597
   query36	1101	934	926	926
   query37	285	84	88	84
   query38	2884	2748	2730	2730
   query39	897	818	839	818
   query40	293	125	123	123
   query41	50	47	48	47
   query42	120	99	104	99
   query43	518	448	464	448
   query44	1263	740	728	728
   query45	193	162	162	162
   query46	1113	830	710	710
   query47	1819	1757	1745	1745
   query48	360	289	290	289
   query49	1224	406	411	406
   query50	785	393	387	387
   query51	6859	6818	6870	6818
   query52	106	94	88	88
   query53	356	287	294	287
   query54	1014	444	440	440
   query55	78	76	74	74
   query56	293	282	266	266
   query57	1130	1065	1056	1056
   query58	271	249	251	249
   query59	3099	2922	2744	2744
   query60	303	287	295	287
   query61	97	118	95	95
   query62	828	646	659	646
   query63	329	292	300	292
   query64	10524	2278	1698	1698
   query65	3203	3106	3115	3106
   query66	1366	338	333	333
   query67	15454	14803	15234	14803
   query68	6526	557	557	557
   query69	723	449	364	364
   query70	1129	1126	1053	1053
   query71	506	276	274	274
   query72	9008	5466	5472	5466
   query73	787	327	328	327
   query74	6216	5676	5625	5625
   query75	4981	2702	2718	2702
   query76	4207	1008	913	913
   query77	769	308	301	301
   query78	9814	8939	9044	8939
   query79	7672	519	523	519
   query80	1032	480	483	480
   query81	579	223	226	223
   query82	801	134	139	134
   query83	334	166	165	165
   query84	278	85	87	85
   query85	1411	319	355	319
   query86	433	293	326	293
   query87	3256	3051	3145	3051
   query88	4815	2387	2389	2387
   query89	513	397	394	394
   query90	2028	195	191	191
   query91	131	102	104	102
   query92	69	49	54	49
   query93	6069	510	500	500
   query94	1353	222	208	208
   query95	405	316	307	307
   query96	611	278	271	271
   query97	3193	2983	3048	2983
   query98	222	209	197	197
   query99	1748	1264	1253	1253
   Total cold run time: 305429 ms
   Total hot run time: 172916 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2249213714

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2249213739

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2230820173

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 30.72 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 925e87fbe4afaa020d13390eaff25ae0873c496b, data reload: false
   
   query1	0.04	0.03	0.03
   query2	0.08	0.04	0.03
   query3	0.23	0.06	0.04
   query4	1.68	0.07	0.08
   query5	0.50	0.50	0.49
   query6	1.13	0.73	0.73
   query7	0.02	0.02	0.02
   query8	0.06	0.04	0.04
   query9	0.56	0.51	0.50
   query10	0.54	0.53	0.53
   query11	0.15	0.11	0.11
   query12	0.15	0.13	0.13
   query13	0.59	0.58	0.59
   query14	0.75	0.79	0.77
   query15	0.85	0.81	0.82
   query16	0.37	0.37	0.36
   query17	1.04	1.03	1.04
   query18	0.25	0.22	0.22
   query19	1.91	1.64	1.80
   query20	0.01	0.01	0.01
   query21	15.41	0.74	0.65
   query22	4.84	6.65	1.91
   query23	18.31	1.42	1.33
   query24	2.16	0.23	0.21
   query25	0.17	0.09	0.09
   query26	0.31	0.22	0.21
   query27	0.46	0.23	0.24
   query28	13.27	1.01	0.99
   query29	12.63	3.28	3.27
   query30	0.26	0.06	0.06
   query31	2.87	0.41	0.40
   query32	3.27	0.48	0.48
   query33	2.92	2.88	2.88
   query34	17.17	4.40	4.37
   query35	4.38	4.42	4.45
   query36	0.65	0.50	0.49
   query37	0.19	0.16	0.16
   query38	0.15	0.16	0.15
   query39	0.04	0.03	0.03
   query40	0.15	0.12	0.12
   query41	0.09	0.04	0.05
   query42	0.06	0.06	0.05
   query43	0.05	0.04	0.04
   Total cold run time: 110.72 s
   Total hot run time: 30.72 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2230195303

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232441340

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 171915 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 0cb96a202a8a924fd65b8ce7f7423e63770c7e10, data reload: false
   
   query1	914	367	366	366
   query2	6469	1875	1764	1764
   query3	6717	221	225	221
   query4	28418	17430	17149	17149
   query5	4206	486	473	473
   query6	256	191	160	160
   query7	4594	288	284	284
   query8	239	200	201	200
   query9	8445	2418	2394	2394
   query10	454	314	284	284
   query11	11443	9977	9998	9977
   query12	133	86	85	85
   query13	1643	371	370	370
   query14	10206	7764	6944	6944
   query15	228	168	175	168
   query16	7794	318	322	318
   query17	1793	558	542	542
   query18	1953	284	280	280
   query19	191	152	163	152
   query20	94	84	84	84
   query21	204	131	130	130
   query22	4174	4115	3924	3924
   query23	33768	33245	32900	32900
   query24	12085	2939	2911	2911
   query25	682	385	389	385
   query26	1774	155	151	151
   query27	2908	275	281	275
   query28	7722	1990	2005	1990
   query29	1129	644	629	629
   query30	288	151	148	148
   query31	953	763	736	736
   query32	95	59	57	57
   query33	795	318	302	302
   query34	954	482	496	482
   query35	705	599	582	582
   query36	1092	946	914	914
   query37	290	81	80	80
   query38	2858	2726	2785	2726
   query39	868	809	802	802
   query40	275	129	122	122
   query41	52	48	48	48
   query42	124	101	103	101
   query43	486	458	442	442
   query44	1191	752	740	740
   query45	192	165	163	163
   query46	1089	737	758	737
   query47	1860	1758	1762	1758
   query48	364	292	298	292
   query49	1230	453	423	423
   query50	792	409	402	402
   query51	6950	6832	6753	6753
   query52	108	89	99	89
   query53	367	300	299	299
   query54	988	458	453	453
   query55	77	78	75	75
   query56	305	294	304	294
   query57	1166	1054	1037	1037
   query58	264	250	371	250
   query59	2859	2643	2618	2618
   query60	314	272	276	272
   query61	95	96	97	96
   query62	823	651	663	651
   query63	322	289	285	285
   query64	10491	2265	7417	2265
   query65	3177	3098	3119	3098
   query66	1383	333	329	329
   query67	15529	14898	15052	14898
   query68	8890	572	569	569
   query69	752	438	360	360
   query70	1374	1144	1108	1108
   query71	549	285	284	284
   query72	9172	5474	6126	5474
   query73	1695	333	326	326
   query74	6128	5662	5608	5608
   query75	5578	2652	2657	2652
   query76	5572	985	906	906
   query77	796	306	320	306
   query78	10619	9582	8895	8895
   query79	12233	543	533	533
   query80	1796	464	474	464
   query81	587	222	223	222
   query82	393	133	133	133
   query83	335	165	163	163
   query84	269	84	86	84
   query85	1154	353	299	299
   query86	343	297	289	289
   query87	3410	3090	3062	3062
   query88	4512	2382	2388	2382
   query89	499	385	387	385
   query90	2298	193	192	192
   query91	132	103	102	102
   query92	63	50	50	50
   query93	7065	513	505	505
   query94	1275	220	209	209
   query95	424	315	311	311
   query96	635	274	270	270
   query97	3205	3046	3010	3010
   query98	213	207	194	194
   query99	1545	1239	1264	1239
   Total cold run time: 315918 ms
   Total hot run time: 171915 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232753577

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 172193 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit b2ecef09beb2ef9b22f974b1b08a09653d8f1002, data reload: false
   
   query1	905	387	373	373
   query2	6873	1884	1839	1839
   query3	6654	217	226	217
   query4	28445	17358	17645	17358
   query5	4205	486	468	468
   query6	265	180	168	168
   query7	4603	294	286	286
   query8	246	197	197	197
   query9	8412	2415	2399	2399
   query10	451	293	274	274
   query11	12472	10001	10186	10001
   query12	136	84	85	84
   query13	1655	371	376	371
   query14	10585	7913	7750	7750
   query15	247	169	169	169
   query16	7492	323	319	319
   query17	1783	529	514	514
   query18	1935	267	270	267
   query19	201	148	147	147
   query20	86	84	83	83
   query21	203	130	125	125
   query22	4199	3871	3895	3871
   query23	33854	32981	33240	32981
   query24	11049	2894	2782	2782
   query25	629	365	381	365
   query26	1083	143	147	143
   query27	2764	269	271	269
   query28	7586	2004	1990	1990
   query29	871	627	599	599
   query30	287	149	149	149
   query31	959	754	754	754
   query32	98	51	52	51
   query33	767	284	288	284
   query34	963	479	483	479
   query35	684	571	573	571
   query36	1064	906	920	906
   query37	139	81	80	80
   query38	2894	2756	2741	2741
   query39	907	825	801	801
   query40	208	121	124	121
   query41	48	43	47	43
   query42	121	99	102	99
   query43	503	472	463	463
   query44	1166	735	722	722
   query45	188	161	161	161
   query46	1084	737	734	734
   query47	1822	1740	1750	1740
   query48	356	290	287	287
   query49	1046	432	408	408
   query50	775	393	401	393
   query51	6873	6790	6791	6790
   query52	102	92	91	91
   query53	353	297	288	288
   query54	886	435	450	435
   query55	74	76	73	73
   query56	286	268	276	268
   query57	1145	1059	1045	1045
   query58	257	280	246	246
   query59	2758	2590	2620	2590
   query60	299	267	270	267
   query61	95	94	92	92
   query62	841	657	650	650
   query63	317	293	292	292
   query64	9794	2182	7443	2182
   query65	3150	3108	3078	3078
   query66	852	332	329	329
   query67	15422	14888	14635	14635
   query68	5266	548	559	548
   query69	618	426	343	343
   query70	1166	1117	1113	1113
   query71	480	274	271	271
   query72	6966	5836	5238	5238
   query73	761	322	329	322
   query74	6100	5615	5702	5615
   query75	3550	2715	2691	2691
   query76	3628	952	947	947
   query77	663	302	312	302
   query78	10419	9074	8949	8949
   query79	1204	512	519	512
   query80	1930	478	464	464
   query81	597	224	229	224
   query82	303	138	130	130
   query83	278	161	168	161
   query84	269	87	87	87
   query85	1015	303	303	303
   query86	350	331	306	306
   query87	3282	3058	3092	3058
   query88	3697	2385	2396	2385
   query89	472	379	390	379
   query90	1923	200	195	195
   query91	127	103	98	98
   query92	73	52	49	49
   query93	1672	508	492	492
   query94	1180	219	212	212
   query95	408	309	312	309
   query96	597	273	270	270
   query97	3212	3025	3050	3025
   query98	217	200	192	192
   query99	1696	1256	1261	1256
   Total cold run time: 283591 ms
   Total hot run time: 172193 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37896:
URL: https://github.com/apache/doris/pull/37896#issuecomment-2232447201

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 30.68 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 0cb96a202a8a924fd65b8ce7f7423e63770c7e10, data reload: false
   
   query1	0.04	0.03	0.03
   query2	0.08	0.04	0.04
   query3	0.23	0.04	0.05
   query4	1.68	0.08	0.07
   query5	0.49	0.49	0.50
   query6	1.13	0.72	0.72
   query7	0.03	0.01	0.01
   query8	0.05	0.05	0.05
   query9	0.54	0.48	0.49
   query10	0.54	0.53	0.54
   query11	0.15	0.11	0.12
   query12	0.14	0.12	0.13
   query13	0.60	0.59	0.59
   query14	0.78	0.78	0.78
   query15	0.87	0.80	0.81
   query16	0.37	0.36	0.37
   query17	1.04	1.01	1.03
   query18	0.24	0.22	0.24
   query19	1.79	1.76	1.79
   query20	0.01	0.00	0.00
   query21	15.40	0.74	0.65
   query22	4.11	7.71	1.89
   query23	18.23	1.34	1.29
   query24	2.16	0.24	0.22
   query25	0.16	0.08	0.08
   query26	0.30	0.20	0.21
   query27	0.45	0.23	0.23
   query28	13.24	1.01	1.00
   query29	12.65	3.34	3.37
   query30	0.26	0.07	0.05
   query31	2.87	0.38	0.38
   query32	3.29	0.47	0.46
   query33	2.96	2.94	2.89
   query34	16.91	4.39	4.36
   query35	4.47	4.38	4.38
   query36	0.66	0.48	0.47
   query37	0.19	0.16	0.16
   query38	0.15	0.15	0.15
   query39	0.04	0.03	0.04
   query40	0.15	0.13	0.13
   query41	0.10	0.05	0.04
   query42	0.05	0.04	0.05
   query43	0.04	0.04	0.03
   Total cold run time: 109.64 s
   Total hot run time: 30.68 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](column nullable) Optimization for ColumnNullable serialization [doris]

Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #37896:
URL: https://github.com/apache/doris/pull/37896


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org