You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "BePPPower (via GitHub)" <gi...@apache.org> on 2024/06/18 12:50:37 UTC

[PR] [Fix](export/outfile) Support compression when exporting data to Parquet / ORC. [doris]

BePPPower opened a new pull request, #36490:
URL: https://github.com/apache/doris/pull/36490

   ## Proposed changes
   
   Issue Number: close #xxx
   
   When using Export/Outfile, we can use properties `orc.compression` and `parquet.compression` to specify the compression method.
   
   Currently, Parquet file format supports `SNAPPY`, `GZIP`, `BROTLI`, `ZSTD`, `LZ4`, `LZO`, `BZ2` and `UNCOMPRESSED` compression methods, default value is `SNAPPY`.
   
    Orc file format supports `PLAIN`, `SNAPPY`, `ZLIB`, and `ZSTD` compression methods, default value is `ZLIB`.  
   
   
   
   <!--Describe your changes.-->
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](export/outfile) Support compression when exporting data to Parquet / ORC. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36490:
URL: https://github.com/apache/doris/pull/36490#issuecomment-2176225039

   TeamCity be ut coverage result:
    Function Coverage: 36.47% (9002/24684) 
    Line Coverage: 28.01% (73733/263227)
    Region Coverage: 27.48% (38296/139346)
    Branch Coverage: 24.18% (19517/80706)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/cebb761ccee17ee658d0f9693ca9e1b4a6bc4da2_cebb761ccee17ee658d0f9693ca9e1b4a6bc4da2/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](export/outfile) Support compression when exporting data to Parquet / ORC. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36490:
URL: https://github.com/apache/doris/pull/36490#issuecomment-2176027099

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
   See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](export/outfile) Support compression when exporting data to Parquet / ORC. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36490:
URL: https://github.com/apache/doris/pull/36490#issuecomment-2185746631

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 173432 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 479ac42bc2f6a50c979cad39b10b7f0b0b82eac2, data reload: false
   
   query1	938	405	374	374
   query2	6423	2423	2224	2224
   query3	6617	214	220	214
   query4	18873	17403	17228	17228
   query5	3537	471	459	459
   query6	245	164	163	163
   query7	4584	291	287	287
   query8	307	283	290	283
   query9	8387	2385	2349	2349
   query10	569	299	262	262
   query11	10568	10020	10130	10020
   query12	109	86	85	85
   query13	1632	367	370	367
   query14	11382	6257	7802	6257
   query15	244	184	187	184
   query16	7761	280	273	273
   query17	1542	568	537	537
   query18	1972	279	286	279
   query19	207	152	159	152
   query20	91	83	81	81
   query21	204	134	126	126
   query22	4437	4171	3996	3996
   query23	33866	33620	33658	33620
   query24	11259	2933	2905	2905
   query25	660	408	407	407
   query26	1184	162	158	158
   query27	2355	331	327	327
   query28	6180	2107	2106	2106
   query29	930	640	654	640
   query30	247	163	159	159
   query31	973	767	777	767
   query32	101	57	57	57
   query33	779	309	309	309
   query34	1014	478	493	478
   query35	768	657	651	651
   query36	1150	968	982	968
   query37	148	75	74	74
   query38	2927	2863	2823	2823
   query39	938	836	872	836
   query40	221	134	131	131
   query41	66	59	54	54
   query42	113	99	101	99
   query43	589	541	539	539
   query44	1208	741	736	736
   query45	196	171	164	164
   query46	1076	719	723	719
   query47	1890	1789	1772	1772
   query48	373	304	299	299
   query49	866	415	429	415
   query50	769	400	383	383
   query51	6867	6737	6758	6737
   query52	108	96	97	96
   query53	363	290	293	290
   query54	917	448	446	446
   query55	76	73	75	73
   query56	311	276	274	274
   query57	1114	1041	1079	1041
   query58	343	237	244	237
   query59	3429	3271	2997	2997
   query60	300	260	266	260
   query61	92	107	87	87
   query62	586	440	443	440
   query63	319	289	286	286
   query64	8720	2281	1732	1732
   query65	3156	3081	3109	3081
   query66	739	327	333	327
   query67	15761	14905	14875	14875
   query68	8504	549	574	549
   query69	698	480	427	427
   query70	1222	1047	1105	1047
   query71	555	269	269	269
   query72	9072	5856	5842	5842
   query73	1776	326	324	324
   query74	5989	5520	5550	5520
   query75	5335	2633	2678	2633
   query76	5139	970	951	951
   query77	780	302	304	302
   query78	10577	9980	9749	9749
   query79	8459	514	512	512
   query80	998	470	503	470
   query81	548	227	223	223
   query82	760	108	101	101
   query83	346	170	171	170
   query84	269	85	89	85
   query85	1372	276	269	269
   query86	409	332	318	318
   query87	3295	3105	3063	3063
   query88	4449	2467	2490	2467
   query89	530	382	385	382
   query90	1907	191	186	186
   query91	128	134	102	102
   query92	61	49	50	49
   query93	6418	512	506	506
   query94	1124	189	191	189
   query95	401	311	317	311
   query96	597	271	267	267
   query97	3181	3059	3038	3038
   query98	211	197	203	197
   query99	1143	847	839	839
   Total cold run time: 292929 ms
   Total hot run time: 173432 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](export/outfile) Support compression when exporting data to Parquet / ORC. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36490:
URL: https://github.com/apache/doris/pull/36490#issuecomment-2182018700

   TeamCity be ut coverage result:
    Function Coverage: 36.46% (9006/24699) 
    Line Coverage: 28.01% (73864/263707)
    Region Coverage: 27.48% (38359/139584)
    Branch Coverage: 24.18% (19553/80850)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/0b4b8584a384fd8883ff6d197e5d2d078443a302_0b4b8584a384fd8883ff6d197e5d2d078443a302/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](export/outfile) Support compression when exporting data to Parquet / ORC. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36490:
URL: https://github.com/apache/doris/pull/36490#issuecomment-2185730728

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 40777 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 479ac42bc2f6a50c979cad39b10b7f0b0b82eac2, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17923	5125	4366	4366
   q2	2023	190	187	187
   q3	10535	1157	1161	1157
   q4	10208	825	809	809
   q5	7446	2723	2661	2661
   q6	219	135	137	135
   q7	958	602	608	602
   q8	9233	2083	2080	2080
   q9	9072	6579	6492	6492
   q10	8948	3698	3754	3698
   q11	457	235	236	235
   q12	445	227	231	227
   q13	18803	3025	3003	3003
   q14	263	229	220	220
   q15	519	467	467	467
   q16	522	378	379	378
   q17	974	754	665	665
   q18	8098	7546	7547	7546
   q19	4891	1536	1437	1437
   q20	664	307	312	307
   q21	4917	3774	3980	3774
   q22	397	331	333	331
   Total cold run time: 117515 ms
   Total hot run time: 40777 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4402	4231	4262	4231
   q2	389	268	272	268
   q3	3094	2956	2940	2940
   q4	2012	1711	1703	1703
   q5	5532	5521	5480	5480
   q6	225	142	138	138
   q7	2278	1827	1877	1827
   q8	3259	3493	3422	3422
   q9	8715	8776	8814	8776
   q10	4126	3836	3818	3818
   q11	599	512	529	512
   q12	817	639	658	639
   q13	15920	3208	3172	3172
   q14	317	286	275	275
   q15	528	488	479	479
   q16	513	442	437	437
   q17	1820	1545	1524	1524
   q18	8169	7903	7796	7796
   q19	2292	1509	1734	1509
   q20	3055	1889	1881	1881
   q21	5251	5045	4859	4859
   q22	821	575	566	566
   Total cold run time: 74134 ms
   Total hot run time: 56252 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](export/outfile) Support compression when exporting data to Parquet / ORC. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36490:
URL: https://github.com/apache/doris/pull/36490#issuecomment-2182020717

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 172088 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 0b4b8584a384fd8883ff6d197e5d2d078443a302, data reload: false
   
   query1	929	392	369	369
   query2	6467	2371	2318	2318
   query3	6649	209	219	209
   query4	19512	17427	17432	17427
   query5	4200	488	476	476
   query6	255	164	162	162
   query7	4588	300	291	291
   query8	318	295	305	295
   query9	8553	2415	2397	2397
   query10	621	313	290	290
   query11	10704	10037	10155	10037
   query12	143	90	85	85
   query13	1661	349	351	349
   query14	10295	6755	7586	6755
   query15	228	198	183	183
   query16	7816	265	261	261
   query17	1912	539	532	532
   query18	1941	275	273	273
   query19	202	156	154	154
   query20	96	84	84	84
   query21	212	131	128	128
   query22	4255	4200	4035	4035
   query23	33782	32939	33049	32939
   query24	11919	2812	2885	2812
   query25	638	357	363	357
   query26	1649	158	156	156
   query27	2946	301	312	301
   query28	7159	2082	2059	2059
   query29	1035	622	599	599
   query30	286	158	152	152
   query31	954	746	742	742
   query32	92	56	55	55
   query33	774	293	291	291
   query34	938	484	459	459
   query35	761	637	610	610
   query36	1093	938	952	938
   query37	158	70	70	70
   query38	2892	2750	2748	2748
   query39	841	786	789	786
   query40	285	123	129	123
   query41	56	60	56	56
   query42	127	97	102	97
   query43	581	539	541	539
   query44	1219	717	731	717
   query45	197	164	169	164
   query46	1095	726	697	697
   query47	1846	1790	1778	1778
   query48	365	287	296	287
   query49	1146	406	401	401
   query50	753	386	376	376
   query51	6838	6909	6734	6734
   query52	106	91	90	90
   query53	355	287	291	287
   query54	990	430	439	430
   query55	74	74	72	72
   query56	276	304	261	261
   query57	1126	1078	1054	1054
   query58	265	246	249	246
   query59	3554	3182	3076	3076
   query60	295	277	268	268
   query61	90	90	90	90
   query62	650	454	441	441
   query63	324	288	298	288
   query64	9908	2301	1718	1718
   query65	3162	3125	3121	3121
   query66	1379	347	346	346
   query67	15686	15011	15018	15011
   query68	4598	533	527	527
   query69	464	302	307	302
   query70	1182	1099	1081	1081
   query71	409	272	271	271
   query72	7190	5692	4942	4942
   query73	735	321	316	316
   query74	5954	5566	5497	5497
   query75	3473	2642	2670	2642
   query76	2820	944	968	944
   query77	441	301	296	296
   query78	10241	9944	9771	9771
   query79	2706	513	497	497
   query80	1137	471	457	457
   query81	587	215	221	215
   query82	937	103	107	103
   query83	238	191	169	169
   query84	229	86	90	86
   query85	1468	292	269	269
   query86	444	340	322	322
   query87	3243	3120	3105	3105
   query88	3761	2359	2333	2333
   query89	471	371	387	371
   query90	1818	190	185	185
   query91	127	97	100	97
   query92	64	48	51	48
   query93	1869	510	491	491
   query94	1219	187	188	187
   query95	396	305	325	305
   query96	580	264	269	264
   query97	3231	3057	2999	2999
   query98	222	274	208	208
   query99	1172	836	856	836
   Total cold run time: 275648 ms
   Total hot run time: 172088 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](export/outfile) Support compression when exporting data to Parquet / ORC. [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on code in PR #36490:
URL: https://github.com/apache/doris/pull/36490#discussion_r1644421767


##########
be/src/pipeline/exec/result_sink_operator.h:
##########
@@ -17,6 +17,9 @@
 
 #pragma once
 
+#include <gen_cpp/PlanNodes_types.h>

Review Comment:
   warning: 'gen_cpp/PlanNodes_types.h' file not found [clang-diagnostic-error]
   ```cpp
   #include <gen_cpp/PlanNodes_types.h>
            ^
   ```
   



##########
be/src/pipeline/exec/result_sink_operator.h:
##########
@@ -17,6 +17,9 @@
 
 #pragma once
 
+#include <gen_cpp/PlanNodes_types.h>
+#include <stdint.h>

Review Comment:
   warning: inclusion of deprecated C++ header 'stdint.h'; consider using 'cstdint' instead [modernize-deprecated-headers]
   
   ```suggestion
   #include <cstdint>
   ```
   



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](export/outfile) Support compression when exporting data to Parquet / ORC. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36490:
URL: https://github.com/apache/doris/pull/36490#issuecomment-2182025232

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 31.21 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 0b4b8584a384fd8883ff6d197e5d2d078443a302, data reload: false
   
   query1	0.04	0.03	0.03
   query2	0.08	0.04	0.04
   query3	0.23	0.05	0.04
   query4	1.68	0.07	0.06
   query5	0.51	0.49	0.49
   query6	1.15	0.73	0.72
   query7	0.02	0.01	0.01
   query8	0.05	0.05	0.04
   query9	0.57	0.51	0.49
   query10	0.56	0.54	0.55
   query11	0.15	0.11	0.11
   query12	0.15	0.12	0.13
   query13	0.59	0.59	0.60
   query14	0.78	0.77	0.79
   query15	0.85	0.81	0.81
   query16	0.37	0.35	0.36
   query17	0.98	0.98	0.97
   query18	0.24	0.23	0.22
   query19	1.84	1.74	1.77
   query20	0.01	0.00	0.01
   query21	15.42	0.65	0.66
   query22	3.92	7.29	2.55
   query23	18.26	1.43	1.29
   query24	2.13	0.24	0.22
   query25	0.16	0.09	0.09
   query26	0.28	0.18	0.18
   query27	0.08	0.08	0.08
   query28	13.24	1.02	0.99
   query29	12.60	3.31	3.32
   query30	0.26	0.06	0.06
   query31	2.86	0.38	0.38
   query32	3.28	0.47	0.47
   query33	2.89	2.89	2.91
   query34	17.05	4.37	4.37
   query35	4.49	4.49	4.52
   query36	0.66	0.45	0.47
   query37	0.20	0.16	0.16
   query38	0.15	0.14	0.15
   query39	0.04	0.04	0.03
   query40	0.18	0.14	0.15
   query41	0.10	0.06	0.05
   query42	0.06	0.04	0.06
   query43	0.05	0.04	0.05
   Total cold run time: 109.21 s
   Total hot run time: 31.21 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](export/outfile) Support compression when exporting data to Parquet / ORC. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36490:
URL: https://github.com/apache/doris/pull/36490#issuecomment-2185754838

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 31.09 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 479ac42bc2f6a50c979cad39b10b7f0b0b82eac2, data reload: false
   
   query1	0.03	0.03	0.04
   query2	0.07	0.04	0.04
   query3	0.22	0.05	0.05
   query4	1.71	0.07	0.07
   query5	0.51	0.47	0.50
   query6	1.15	0.73	0.72
   query7	0.01	0.01	0.02
   query8	0.05	0.04	0.04
   query9	0.53	0.50	0.51
   query10	0.53	0.55	0.55
   query11	0.15	0.11	0.12
   query12	0.15	0.12	0.12
   query13	0.60	0.58	0.60
   query14	0.76	0.80	0.78
   query15	0.83	0.82	0.81
   query16	0.37	0.37	0.37
   query17	1.03	1.00	1.06
   query18	0.22	0.25	0.23
   query19	1.86	1.72	1.76
   query20	0.02	0.01	0.01
   query21	15.40	0.65	0.64
   query22	3.75	7.07	2.34
   query23	18.33	1.33	1.26
   query24	1.88	0.28	0.23
   query25	0.16	0.08	0.09
   query26	0.26	0.18	0.17
   query27	0.08	0.08	0.07
   query28	13.22	1.02	1.00
   query29	12.61	3.34	3.30
   query30	0.25	0.06	0.07
   query31	2.84	0.40	0.38
   query32	3.28	0.48	0.46
   query33	2.90	2.87	2.90
   query34	17.15	4.48	4.41
   query35	4.47	4.54	4.54
   query36	0.67	0.48	0.48
   query37	0.19	0.17	0.15
   query38	0.16	0.15	0.15
   query39	0.05	0.03	0.04
   query40	0.16	0.14	0.17
   query41	0.09	0.04	0.05
   query42	0.05	0.04	0.04
   query43	0.04	0.05	0.04
   Total cold run time: 108.79 s
   Total hot run time: 31.09 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](export/outfile) Support compression when exporting data to Parquet / ORC. [doris]

Posted by "BePPPower (via GitHub)" <gi...@apache.org>.
BePPPower commented on PR #36490:
URL: https://github.com/apache/doris/pull/36490#issuecomment-2176026587

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](export/outfile) Support compression when exporting data to Parquet / ORC. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36490:
URL: https://github.com/apache/doris/pull/36490#issuecomment-2182011139

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 39967 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 0b4b8584a384fd8883ff6d197e5d2d078443a302, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17619	4978	4297	4297
   q2	2024	200	207	200
   q3	10452	1160	1005	1005
   q4	10198	811	801	801
   q5	7469	2715	2761	2715
   q6	222	137	134	134
   q7	973	622	598	598
   q8	9234	2096	2080	2080
   q9	9042	6478	6432	6432
   q10	8960	3723	3739	3723
   q11	453	244	236	236
   q12	443	230	227	227
   q13	18898	2964	2959	2959
   q14	303	246	220	220
   q15	518	484	511	484
   q16	537	389	381	381
   q17	975	655	758	655
   q18	8139	7458	7527	7458
   q19	1680	1452	1561	1452
   q20	665	322	331	322
   q21	4932	3254	3328	3254
   q22	396	334	338	334
   Total cold run time: 114132 ms
   Total hot run time: 39967 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4318	4217	4208	4208
   q2	372	268	268	268
   q3	3036	2724	2762	2724
   q4	1912	1634	1639	1634
   q5	5267	5267	5288	5267
   q6	210	124	126	124
   q7	2138	1722	1727	1722
   q8	3236	3342	3309	3309
   q9	8436	8398	8421	8398
   q10	3912	3685	3623	3623
   q11	588	475	520	475
   q12	752	599	629	599
   q13	17365	2989	3013	2989
   q14	276	265	282	265
   q15	522	476	458	458
   q16	480	409	409	409
   q17	1797	1489	1472	1472
   q18	7559	7569	7441	7441
   q19	1679	1595	1459	1459
   q20	1985	1749	1772	1749
   q21	4950	4672	4727	4672
   q22	654	567	590	567
   Total cold run time: 71444 ms
   Total hot run time: 53832 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](export/outfile) Support compression when exporting data to Parquet / ORC. [doris]

Posted by "BePPPower (via GitHub)" <gi...@apache.org>.
BePPPower commented on PR #36490:
URL: https://github.com/apache/doris/pull/36490#issuecomment-2185610203

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org