You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "wyxxxcat (via GitHub)" <gi...@apache.org> on 2025/11/17 06:17:25 UTC
[PR] [fix](snapshot) Disable chunked encoding for s3 client [doris]
wyxxxcat opened a new pull request, #58078:
URL: https://github.com/apache/doris/pull/58078
### What problem does this PR solve?
Issue Number: close #xxx
Related PR: #xxx
Problem Summary:
### Release note
None
### Check List (For Author)
- Test <!-- At least one of them must be included. -->
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason <!-- Add your reason? -->
- Behavior changed:
- [ ] No.
- [ ] Yes. <!-- Explain the behavior change -->
- Does this need documentation?
- [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg: https://github.com/apache/doris-website/pull/1214 -->
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR should merge into -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](snapshot) Disable chunked encoding for s3 client [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #58078:
URL: https://github.com/apache/doris/pull/58078#issuecomment-3540275649
<details>
<summary>TPC-DS: <b>Total hot run time: 188071 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dcaa473fb3030498b76c0576ce5cf0e2c15a2e0d, data reload: false
query1 1014 396 387 387
query2 6547 1679 1675 1675
query3 6751 242 225 225
query4 26447 23292 23340 23292
query5 4399 659 523 523
query6 361 245 236 236
query7 4658 502 314 314
query8 310 262 259 259
query9 8683 2959 2914 2914
query10 474 346 307 307
query11 15820 15053 14975 14975
query12 186 125 119 119
query13 1675 565 439 439
query14 11245 9215 9154 9154
query15 199 187 171 171
query16 7669 664 535 535
query17 1234 749 600 600
query18 2020 417 333 333
query19 211 198 182 182
query20 134 124 122 122
query21 214 133 114 114
query22 3949 4056 3972 3972
query23 33696 33004 32764 32764
query24 8129 2357 2367 2357
query25 610 525 468 468
query26 1240 273 171 171
query27 2751 501 355 355
query28 4395 2265 2227 2227
query29 787 625 489 489
query30 299 230 194 194
query31 916 820 711 711
query32 93 81 82 81
query33 582 383 341 341
query34 783 836 522 522
query35 830 841 811 811
query36 952 1005 919 919
query37 130 113 97 97
query38 3495 3498 3496 3496
query39 1460 1430 1419 1419
query40 228 134 126 126
query41 64 60 61 60
query42 130 119 118 118
query43 500 476 450 450
query44 1249 798 797 797
query45 186 185 169 169
query46 892 992 636 636
query47 1766 1814 1709 1709
query48 384 438 317 317
query49 774 487 414 414
query50 640 672 409 409
query51 3861 4022 3804 3804
query52 117 120 106 106
query53 246 278 206 206
query54 322 326 308 308
query55 90 98 93 93
query56 344 338 375 338
query57 1187 1203 1117 1117
query58 305 291 296 291
query59 2518 2603 2450 2450
query60 368 385 357 357
query61 161 160 159 159
query62 804 731 694 694
query63 235 201 197 197
query64 4534 1317 1009 1009
query65 4003 3950 3952 3950
query66 1129 478 366 366
query67 15086 15145 14933 14933
query68 5478 914 647 647
query69 519 357 305 305
query70 1351 1298 1264 1264
query71 447 363 338 338
query72 5667 4983 4723 4723
query73 636 555 361 361
query74 8909 9183 8607 8607
query75 3276 3232 2806 2806
query76 3299 1118 735 735
query77 521 407 341 341
query78 9541 9738 8936 8936
query79 2164 847 618 618
query80 791 598 522 522
query81 525 260 224 224
query82 398 158 137 137
query83 275 254 245 245
query84 255 113 91 91
query85 899 484 438 438
query86 408 308 286 286
query87 3694 3647 3594 3594
query88 2827 2278 2245 2245
query89 381 331 298 298
query90 1929 236 233 233
query91 163 164 135 135
query92 92 79 73 73
query93 1937 1003 687 687
query94 735 430 323 323
query95 431 344 334 334
query96 485 596 281 281
query97 2869 2947 2867 2867
query98 246 221 213 213
query99 1318 1400 1311 1311
Total cold run time: 269937 ms
Total hot run time: 188071 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](snapshot) Disable chunked encoding for s3 client [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #58078:
URL: https://github.com/apache/doris/pull/58078#issuecomment-3540154005
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
Please clearly describe your PR:
1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](snapshot) Disable chunked encoding for s3 client [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #58078:
URL: https://github.com/apache/doris/pull/58078#issuecomment-3540288908
<details>
<summary>ClickBench: <b>Total hot run time: 27.5 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dcaa473fb3030498b76c0576ce5cf0e2c15a2e0d, data reload: false
query1 0.06 0.05 0.05
query2 0.10 0.05 0.05
query3 0.26 0.09 0.08
query4 1.61 0.12 0.11
query5 0.27 0.26 0.25
query6 1.18 0.66 0.64
query7 0.03 0.03 0.03
query8 0.05 0.04 0.04
query9 0.58 0.52 0.50
query10 0.57 0.56 0.57
query11 0.16 0.11 0.11
query12 0.16 0.11 0.12
query13 0.62 0.60 0.60
query14 1.01 1.00 0.99
query15 0.85 0.83 0.83
query16 0.40 0.40 0.40
query17 1.03 1.02 1.02
query18 0.22 0.20 0.20
query19 1.89 1.79 1.84
query20 0.01 0.01 0.01
query21 15.48 0.22 0.14
query22 5.01 0.07 0.04
query23 15.67 0.25 0.10
query24 3.28 0.68 0.46
query25 0.08 0.06 0.06
query26 0.16 0.14 0.14
query27 0.06 0.06 0.06
query28 4.54 1.18 0.97
query29 12.64 3.81 3.18
query30 0.28 0.13 0.11
query31 2.82 0.59 0.38
query32 3.23 0.55 0.46
query33 3.01 3.04 3.10
query34 15.93 5.19 4.58
query35 4.62 4.62 4.56
query36 0.67 0.50 0.50
query37 0.10 0.06 0.06
query38 0.07 0.04 0.04
query39 0.03 0.02 0.03
query40 0.17 0.14 0.15
query41 0.08 0.03 0.04
query42 0.04 0.04 0.03
query43 0.04 0.04 0.03
Total cold run time: 99.07 s
Total hot run time: 27.5 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](snapshot) Disable chunked encoding for s3 client [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #58078:
URL: https://github.com/apache/doris/pull/58078#issuecomment-3540246888
<details>
<summary>TPC-H: <b>Total hot run time: 35101 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dcaa473fb3030498b76c0576ce5cf0e2c15a2e0d, data reload: false
------ Round 1 ----------------------------------
q1 17620 5245 5040 5040
q2 2048 307 203 203
q3 10240 1282 693 693
q4 10223 909 362 362
q5 7492 2432 2320 2320
q6 193 179 138 138
q7 920 775 617 617
q8 9357 1550 1118 1118
q9 6815 5137 5188 5137
q10 7376 2206 1796 1796
q11 499 312 293 293
q12 344 390 252 252
q13 17995 3748 3080 3080
q14 246 249 217 217
q15 606 518 519 518
q16 1017 1035 948 948
q17 627 895 385 385
q18 7746 7677 7869 7677
q19 1448 998 539 539
q20 362 349 227 227
q21 4414 3792 2482 2482
q22 1152 1073 1059 1059
Total cold run time: 108740 ms
Total hot run time: 35101 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5434 5433 5332 5332
q2 245 335 231 231
q3 2434 2944 2442 2442
q4 1435 1850 1449 1449
q5 4525 4386 4469 4386
q6 211 188 168 168
q7 2055 1898 1733 1733
q8 2522 2686 2530 2530
q9 7326 7300 6719 6719
q10 2896 3067 2657 2657
q11 578 512 485 485
q12 628 711 585 585
q13 3322 3660 3064 3064
q14 263 285 259 259
q15 535 496 506 496
q16 1018 1047 1007 1007
q17 1117 1452 1362 1362
q18 7188 7147 7002 7002
q19 764 718 762 718
q20 1892 1954 1795 1795
q21 5008 4351 4228 4228
q22 1106 1034 987 987
Total cold run time: 52502 ms
Total hot run time: 49635 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](snapshot) Disable chunked encoding for s3 client [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #58078:
URL: https://github.com/apache/doris/pull/58078#issuecomment-3540344016
# FE UT Coverage Report
Increment line coverage ` 0.00% (0/3)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/58078_dcaa473fb3030498b76c0576ce5cf0e2c15a2e0d/fe_increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/58078_dcaa473fb3030498b76c0576ce5cf0e2c15a2e0d/fe_report/index.html)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](snapshot) Disable chunked encoding for s3 client [doris]
Posted by "wyxxxcat (via GitHub)" <gi...@apache.org>.
wyxxxcat commented on PR #58078:
URL: https://github.com/apache/doris/pull/58078#issuecomment-3540154635
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](snapshot) Disable chunked encoding for s3 client [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #58078:
URL: https://github.com/apache/doris/pull/58078#issuecomment-3545009756
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](snapshot) Disable chunked encoding for s3 client [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #58078:
URL: https://github.com/apache/doris/pull/58078#issuecomment-3545612888
# FE Regression Coverage Report
Increment line coverage ` 0.00% (0/3)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/58078_dcaa473fb3030498b76c0576ce5cf0e2c15a2e0d_merge_fe/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/58078_dcaa473fb3030498b76c0576ce5cf0e2c15a2e0d_merge_fe/report/index.html)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](snapshot) Disable chunked encoding for s3 client [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #58078:
URL: https://github.com/apache/doris/pull/58078
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](snapshot) Disable chunked encoding for s3 client [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #58078:
URL: https://github.com/apache/doris/pull/58078#issuecomment-3545009808
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org