You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "xylaaaaa (via GitHub)" <gi...@apache.org> on 2026/02/24 09:47:41 UTC
[PR] [feature](iceberg) support fs.s3a aliases for S3/MinIO storage props [doris]
xylaaaaa opened a new pull request, #60809:
URL: https://github.com/apache/doris/pull/60809
## Summary
- support fs.s3a.* aliases for S3Properties and MinioProperties
- map endpoint/region/ak/sk/session token/path-style/connection settings
- add tests for fs.s3a alias parsing and backend property mapping
## Validation
- local Ozone S3 gateway read/write verified
- FE full test build is currently blocked by unrelated workspace compile errors
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](iceberg) support fs.s3a aliases for S3/MinIO storage props [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #60809:
URL: https://github.com/apache/doris/pull/60809#issuecomment-3950666325
<details>
<summary>TPC-H: <b>Total hot run time: 28737 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e2aa86e50f5211ef126ea2e11d7c7031969cacaa, data reload: false
------ Round 1 ----------------------------------
============================================
q1 17674 4518 4288 4288
q2 q3 10661 774 516 516
q4 4688 356 251 251
q5 7553 1167 1007 1007
q6 169 173 144 144
q7 775 840 655 655
q8 9277 1437 1285 1285
q9 4836 4756 4692 4692
q10 6814 1860 1638 1638
q11 483 258 251 251
q12 726 560 465 465
q13 17760 4200 3418 3418
q14 228 226 217 217
q15 941 786 783 783
q16 750 724 678 678
q17 710 846 428 428
q18 5883 5346 5353 5346
q19 1143 967 591 591
q20 489 480 387 387
q21 4630 1917 1439 1439
q22 406 347 258 258
Total cold run time: 96596 ms
Total hot run time: 28737 ms
----- Round 2, with runtime_filter_mode=off -----
============================================
q1 4606 4710 4518 4518
q2 q3 1809 2209 1775 1775
q4 855 1186 775 775
q5 4076 4407 4325 4325
q6 180 181 141 141
q7 1775 1632 1523 1523
q8 2472 2709 2557 2557
q9 7594 7409 7365 7365
q10 2670 2810 2459 2459
q11 523 436 425 425
q12 543 587 444 444
q13 3956 4568 3568 3568
q14 285 292 277 277
q15 880 819 808 808
q16 722 759 721 721
q17 1177 1574 1332 1332
q18 7208 6787 6577 6577
q19 867 805 881 805
q20 2123 2130 2030 2030
q21 3924 3547 3312 3312
q22 475 464 457 457
Total cold run time: 48720 ms
Total hot run time: 46194 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](iceberg) support fs.s3a aliases for S3/MinIO storage props [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #60809:
URL: https://github.com/apache/doris/pull/60809#issuecomment-3950739471
<details>
<summary>TPC-DS: <b>Total hot run time: 183375 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e2aa86e50f5211ef126ea2e11d7c7031969cacaa, data reload: false
query5 4800 645 503 503
query6 323 223 203 203
query7 4214 458 275 275
query8 339 232 252 232
query9 8731 2707 2727 2707
query10 539 393 347 347
query11 16972 17544 17220 17220
query12 200 136 124 124
query13 1388 472 350 350
query14 6944 3592 3045 3045
query14_1 3124 3299 2861 2861
query15 209 196 182 182
query16 1047 518 454 454
query17 1467 756 650 650
query18 2811 474 382 382
query19 239 216 189 189
query20 151 129 134 129
query21 229 148 118 118
query22 5587 5625 4942 4942
query23 17190 16810 16547 16547
query23_1 16680 16730 16704 16704
query24 7323 1607 1215 1215
query24_1 1234 1206 1238 1206
query25 570 486 429 429
query26 1250 273 158 158
query27 2712 468 329 329
query28 4437 1871 1856 1856
query29 801 550 454 454
query30 310 246 210 210
query31 896 743 659 659
query32 82 74 67 67
query33 505 333 281 281
query34 907 913 558 558
query35 642 662 585 585
query36 1089 1149 977 977
query37 137 99 88 88
query38 2946 2907 2826 2826
query39 911 888 835 835
query39_1 815 831 823 823
query40 234 149 132 132
query41 63 58 58 58
query42 102 104 104 104
query43 386 387 357 357
query44
query45 208 187 186 186
query46 884 967 608 608
query47 2111 2139 2048 2048
query48 315 309 233 233
query49 613 448 374 374
query50 672 275 222 222
query51 4106 4074 4048 4048
query52 107 104 94 94
query53 284 332 277 277
query54 294 274 267 267
query55 91 81 81 81
query56 321 312 312 312
query57 1370 1346 1276 1276
query58 329 270 276 270
query59 2603 2697 2530 2530
query60 332 324 328 324
query61 153 146 143 143
query62 628 594 539 539
query63 302 278 269 269
query64 4811 1259 990 990
query65
query66 1392 459 347 347
query67 16376 16513 16252 16252
query68
query69 402 308 285 285
query70 986 960 992 960
query71 338 303 296 296
query72 2737 2624 2361 2361
query73 540 560 317 317
query74 9992 9901 9724 9724
query75 2868 2749 2469 2469
query76 2290 1029 654 654
query77 361 372 305 305
query78 11182 11367 10725 10725
query79 2791 788 621 621
query80 1776 609 530 530
query81 564 274 249 249
query82 989 150 113 113
query83 333 257 240 240
query84 251 118 91 91
query85 882 480 416 416
query86 431 307 301 301
query87 3116 3118 2974 2974
query88 3512 2640 2631 2631
query89 423 360 343 343
query90 2032 180 169 169
query91 159 150 130 130
query92 75 84 69 69
query93 1205 820 501 501
query94 641 320 310 310
query95 579 387 305 305
query96 633 508 227 227
query97 2445 2497 2411 2411
query98 238 226 209 209
query99 1030 1019 922 922
Total cold run time: 257315 ms
Total hot run time: 183375 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](iceberg) support fs.s3a aliases for S3/MinIO storage props [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #60809:
URL: https://github.com/apache/doris/pull/60809#issuecomment-3951619848
# FE Regression Coverage Report
Increment line coverage ` 100% (0/0)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/60809_e2aa86e50f5211ef126ea2e11d7c7031969cacaa_merge_fe/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/60809_e2aa86e50f5211ef126ea2e11d7c7031969cacaa_merge_fe/report/index.html)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](iceberg) support fs.s3a aliases for S3/MinIO storage props [doris]
Posted by "Thearas (via GitHub)" <gi...@apache.org>.
Thearas commented on PR #60809:
URL: https://github.com/apache/doris/pull/60809#issuecomment-3950417131
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
Please clearly describe your PR:
1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](iceberg) support fs.s3a aliases for S3/MinIO storage props [doris]
Posted by "xylaaaaa (via GitHub)" <gi...@apache.org>.
xylaaaaa commented on PR #60809:
URL: https://github.com/apache/doris/pull/60809#issuecomment-3950424728
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org