You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "morningman (via GitHub)" <gi...@apache.org> on 2024/10/21 06:42:12 UTC

[PR] [enhance](parquet) support reading brotli compressed parquet file #41875 [doris]

morningman opened a new pull request, #42177:
URL: https://github.com/apache/doris/pull/42177

   cherry pick from #41875


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [enhance](parquet) support reading brotli compressed parquet file #41875 [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #42177:
URL: https://github.com/apache/doris/pull/42177#issuecomment-2425719878

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
   See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [enhance](parquet) support reading brotli compressed parquet file #41875 [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #42177:
URL: https://github.com/apache/doris/pull/42177#issuecomment-2425814410

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 40151 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 01992356b7fabac7c29629f7177c0006ce95d8ac, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17586	7328	7238	7238
   q2	2051	154	144	144
   q3	10737	1064	1092	1064
   q4	10533	704	708	704
   q5	7719	2795	2722	2722
   q6	236	150	147	147
   q7	1002	634	615	615
   q8	9337	1894	1902	1894
   q9	6564	6418	6307	6307
   q10	6984	2259	2312	2259
   q11	442	242	240	240
   q12	424	221	214	214
   q13	17779	2949	2951	2949
   q14	255	220	210	210
   q15	545	511	497	497
   q16	656	607	594	594
   q17	958	507	544	507
   q18	7145	6612	6515	6515
   q19	1876	1005	918	918
   q20	585	283	270	270
   q21	3891	3201	3166	3166
   q22	1067	1007	977	977
   Total cold run time: 108372 ms
   Total hot run time: 40151 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	7330	7246	7216	7216
   q2	315	222	227	222
   q3	2874	2821	2835	2821
   q4	1977	1737	1769	1737
   q5	5624	5662	5673	5662
   q6	224	140	148	140
   q7	2211	1767	1780	1767
   q8	3321	3483	3502	3483
   q9	8779	8892	8825	8825
   q10	3518	3488	3500	3488
   q11	572	494	498	494
   q12	773	609	605	605
   q13	16614	3166	3098	3098
   q14	314	287	282	282
   q15	558	524	506	506
   q16	713	657	659	657
   q17	1852	1616	1597	1597
   q18	8114	7799	7411	7411
   q19	2207	1460	1379	1379
   q20	2131	1826	1837	1826
   q21	5278	5171	5200	5171
   q22	1117	1062	978	978
   Total cold run time: 76416 ms
   Total hot run time: 59365 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [enhance](parquet) support reading brotli compressed parquet file #41875 [doris]

Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman commented on PR #42177:
URL: https://github.com/apache/doris/pull/42177#issuecomment-2425719811

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [enhance](parquet) support reading brotli compressed parquet file #41875 [doris]

Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman merged PR #42177:
URL: https://github.com/apache/doris/pull/42177


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [enhance](parquet) support reading brotli compressed parquet file #41875 [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #42177:
URL: https://github.com/apache/doris/pull/42177#issuecomment-2425839165

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 193577 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 01992356b7fabac7c29629f7177c0006ce95d8ac, data reload: false
   
   query1	1255	927	893	893
   query2	6250	2107	2086	2086
   query3	10802	3815	3775	3775
   query4	67140	28715	23329	23329
   query5	5474	468	462	462
   query6	455	162	167	162
   query7	6143	312	303	303
   query8	296	217	211	211
   query9	9540	2672	2664	2664
   query10	511	281	280	280
   query11	18067	15168	15645	15168
   query12	158	98	101	98
   query13	1607	496	448	448
   query14	11370	7325	7285	7285
   query15	227	174	176	174
   query16	7254	517	563	517
   query17	1058	570	552	552
   query18	1837	299	305	299
   query19	193	148	149	148
   query20	114	103	113	103
   query21	211	103	106	103
   query22	4534	4191	4322	4191
   query23	34224	33888	33480	33480
   query24	5725	2847	2869	2847
   query25	518	416	399	399
   query26	665	167	166	166
   query27	1676	296	297	296
   query28	4203	2507	2483	2483
   query29	674	424	430	424
   query30	233	155	155	155
   query31	1005	794	796	794
   query32	71	53	55	53
   query33	469	293	293	293
   query34	894	513	489	489
   query35	869	735	743	735
   query36	1046	951	939	939
   query37	148	94	92	92
   query38	3966	3889	3828	3828
   query39	1482	1437	1427	1427
   query40	197	100	100	100
   query41	45	46	46	46
   query42	116	101	95	95
   query43	527	500	495	495
   query44	1142	777	787	777
   query45	203	168	164	164
   query46	1121	705	712	705
   query47	1948	1847	1867	1847
   query48	456	364	348	348
   query49	729	410	401	401
   query50	832	422	443	422
   query51	7346	6946	6767	6767
   query52	107	89	95	89
   query53	261	182	185	182
   query54	592	458	479	458
   query55	77	77	77	77
   query56	270	250	242	242
   query57	1202	1113	1102	1102
   query58	215	231	228	228
   query59	3274	3034	2869	2869
   query60	281	261	265	261
   query61	102	99	97	97
   query62	773	672	662	662
   query63	210	183	183	183
   query64	1438	622	589	589
   query65	3274	3156	3182	3156
   query66	711	333	318	318
   query67	15627	15354	15229	15229
   query68	4377	528	555	528
   query69	666	286	281	281
   query70	1176	1138	1136	1136
   query71	432	271	275	271
   query72	7913	3831	3808	3808
   query73	768	336	335	335
   query74	10161	8878	8897	8878
   query75	4332	2620	2641	2620
   query76	3563	862	839	839
   query77	767	287	283	283
   query78	10014	9184	9259	9184
   query79	6580	578	575	575
   query80	1437	436	449	436
   query81	580	244	238	238
   query82	908	145	141	141
   query83	393	135	137	135
   query84	299	73	79	73
   query85	1690	286	276	276
   query86	457	292	291	291
   query87	4432	4349	4254	4254
   query88	5446	2384	2392	2384
   query89	411	301	285	285
   query90	2118	184	194	184
   query91	138	104	106	104
   query92	61	49	49	49
   query93	5633	535	529	529
   query94	1071	280	280	280
   query95	341	246	246	246
   query96	643	284	277	277
   query97	3347	3140	3117	3117
   query98	216	192	191	191
   query99	1671	1289	1318	1289
   Total cold run time: 337481 ms
   Total hot run time: 193577 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org