You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "morningman (via GitHub)" <gi...@apache.org> on 2024/10/21 06:42:12 UTC
[PR] [enhance](parquet) support reading brotli compressed parquet file #41875 [doris]
morningman opened a new pull request, #42177:
URL: https://github.com/apache/doris/pull/42177
cherry pick from #41875
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](parquet) support reading brotli compressed parquet file #41875 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #42177:
URL: https://github.com/apache/doris/pull/42177#issuecomment-2425719878
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](parquet) support reading brotli compressed parquet file #41875 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #42177:
URL: https://github.com/apache/doris/pull/42177#issuecomment-2425814410
<details>
<summary>TPC-H: <b>Total hot run time: 40151 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 01992356b7fabac7c29629f7177c0006ce95d8ac, data reload: false
------ Round 1 ----------------------------------
q1 17586 7328 7238 7238
q2 2051 154 144 144
q3 10737 1064 1092 1064
q4 10533 704 708 704
q5 7719 2795 2722 2722
q6 236 150 147 147
q7 1002 634 615 615
q8 9337 1894 1902 1894
q9 6564 6418 6307 6307
q10 6984 2259 2312 2259
q11 442 242 240 240
q12 424 221 214 214
q13 17779 2949 2951 2949
q14 255 220 210 210
q15 545 511 497 497
q16 656 607 594 594
q17 958 507 544 507
q18 7145 6612 6515 6515
q19 1876 1005 918 918
q20 585 283 270 270
q21 3891 3201 3166 3166
q22 1067 1007 977 977
Total cold run time: 108372 ms
Total hot run time: 40151 ms
----- Round 2, with runtime_filter_mode=off -----
q1 7330 7246 7216 7216
q2 315 222 227 222
q3 2874 2821 2835 2821
q4 1977 1737 1769 1737
q5 5624 5662 5673 5662
q6 224 140 148 140
q7 2211 1767 1780 1767
q8 3321 3483 3502 3483
q9 8779 8892 8825 8825
q10 3518 3488 3500 3488
q11 572 494 498 494
q12 773 609 605 605
q13 16614 3166 3098 3098
q14 314 287 282 282
q15 558 524 506 506
q16 713 657 659 657
q17 1852 1616 1597 1597
q18 8114 7799 7411 7411
q19 2207 1460 1379 1379
q20 2131 1826 1837 1826
q21 5278 5171 5200 5171
q22 1117 1062 978 978
Total cold run time: 76416 ms
Total hot run time: 59365 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](parquet) support reading brotli compressed parquet file #41875 [doris]
Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman commented on PR #42177:
URL: https://github.com/apache/doris/pull/42177#issuecomment-2425719811
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](parquet) support reading brotli compressed parquet file #41875 [doris]
Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman merged PR #42177:
URL: https://github.com/apache/doris/pull/42177
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](parquet) support reading brotli compressed parquet file #41875 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #42177:
URL: https://github.com/apache/doris/pull/42177#issuecomment-2425839165
<details>
<summary>TPC-DS: <b>Total hot run time: 193577 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 01992356b7fabac7c29629f7177c0006ce95d8ac, data reload: false
query1 1255 927 893 893
query2 6250 2107 2086 2086
query3 10802 3815 3775 3775
query4 67140 28715 23329 23329
query5 5474 468 462 462
query6 455 162 167 162
query7 6143 312 303 303
query8 296 217 211 211
query9 9540 2672 2664 2664
query10 511 281 280 280
query11 18067 15168 15645 15168
query12 158 98 101 98
query13 1607 496 448 448
query14 11370 7325 7285 7285
query15 227 174 176 174
query16 7254 517 563 517
query17 1058 570 552 552
query18 1837 299 305 299
query19 193 148 149 148
query20 114 103 113 103
query21 211 103 106 103
query22 4534 4191 4322 4191
query23 34224 33888 33480 33480
query24 5725 2847 2869 2847
query25 518 416 399 399
query26 665 167 166 166
query27 1676 296 297 296
query28 4203 2507 2483 2483
query29 674 424 430 424
query30 233 155 155 155
query31 1005 794 796 794
query32 71 53 55 53
query33 469 293 293 293
query34 894 513 489 489
query35 869 735 743 735
query36 1046 951 939 939
query37 148 94 92 92
query38 3966 3889 3828 3828
query39 1482 1437 1427 1427
query40 197 100 100 100
query41 45 46 46 46
query42 116 101 95 95
query43 527 500 495 495
query44 1142 777 787 777
query45 203 168 164 164
query46 1121 705 712 705
query47 1948 1847 1867 1847
query48 456 364 348 348
query49 729 410 401 401
query50 832 422 443 422
query51 7346 6946 6767 6767
query52 107 89 95 89
query53 261 182 185 182
query54 592 458 479 458
query55 77 77 77 77
query56 270 250 242 242
query57 1202 1113 1102 1102
query58 215 231 228 228
query59 3274 3034 2869 2869
query60 281 261 265 261
query61 102 99 97 97
query62 773 672 662 662
query63 210 183 183 183
query64 1438 622 589 589
query65 3274 3156 3182 3156
query66 711 333 318 318
query67 15627 15354 15229 15229
query68 4377 528 555 528
query69 666 286 281 281
query70 1176 1138 1136 1136
query71 432 271 275 271
query72 7913 3831 3808 3808
query73 768 336 335 335
query74 10161 8878 8897 8878
query75 4332 2620 2641 2620
query76 3563 862 839 839
query77 767 287 283 283
query78 10014 9184 9259 9184
query79 6580 578 575 575
query80 1437 436 449 436
query81 580 244 238 238
query82 908 145 141 141
query83 393 135 137 135
query84 299 73 79 73
query85 1690 286 276 276
query86 457 292 291 291
query87 4432 4349 4254 4254
query88 5446 2384 2392 2384
query89 411 301 285 285
query90 2118 184 194 184
query91 138 104 106 104
query92 61 49 49 49
query93 5633 535 529 529
query94 1071 280 280 280
query95 341 246 246 246
query96 643 284 277 277
query97 3347 3140 3117 3117
query98 216 192 191 191
query99 1671 1289 1318 1289
Total cold run time: 337481 ms
Total hot run time: 193577 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org