You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "0AyanamiRei (via GitHub)" <gi...@apache.org> on 2025/10/24 08:48:27 UTC
[PR] [fix](broker-load) Fix the COLUMNS FROM PATH feature（in 3.0） [doris]
0AyanamiRei opened a new pull request, #57310:
URL: https://github.com/apache/doris/pull/57310
### What problem does this PR solve?
Issue Number: close #xxx
Related PR: [#xxx ](https://github.com/apache/doris/pull/57309)
Problem Summary:
### Release note
None
### Check List (For Author)
- Test <!-- At least one of them must be included. -->
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason <!-- Add your reason? -->
- Behavior changed:
- [ ] No.
- [ ] Yes. <!-- Explain the behavior change -->
- Does this need documentation?
- [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg: https://github.com/apache/doris-website/pull/1214 -->
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR should merge into -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](broker-load) Fix the COLUMNS FROM PATH feature（in 3.0） [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #57310:
URL: https://github.com/apache/doris/pull/57310#issuecomment-3442199913
<details>
<summary>ClickBench: <b>Total hot run time: 29.74 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0139dc04da1385ad5e88f915b4038748fbb5a6de, data reload: false
query1 0.03 0.03 0.03
query2 0.08 0.03 0.03
query3 0.23 0.06 0.07
query4 1.64 0.11 0.11
query5 0.52 0.52 0.52
query6 1.13 0.73 0.72
query7 0.02 0.02 0.01
query8 0.04 0.03 0.03
query9 0.58 0.51 0.53
query10 0.55 0.55 0.56
query11 0.14 0.10 0.11
query12 0.14 0.11 0.10
query13 0.61 0.59 0.59
query14 0.78 0.82 0.79
query15 0.85 0.84 0.83
query16 0.39 0.41 0.40
query17 1.02 1.06 1.04
query18 0.25 0.23 0.23
query19 1.89 1.83 1.78
query20 0.02 0.02 0.01
query21 15.39 0.58 0.57
query22 2.21 2.10 1.88
query23 16.85 1.00 0.83
query24 3.71 0.28 1.93
query25 0.26 0.07 0.04
query26 0.36 0.14 0.14
query27 0.05 0.04 0.05
query28 9.73 0.51 0.49
query29 12.60 3.26 3.25
query30 0.25 0.06 0.06
query31 2.87 0.39 0.39
query32 3.24 0.46 0.46
query33 3.00 3.00 3.03
query34 16.76 4.53 4.50
query35 4.55 4.58 4.60
query36 0.66 0.47 0.50
query37 0.08 0.06 0.06
query38 0.04 0.04 0.04
query39 0.03 0.03 0.03
query40 0.16 0.13 0.12
query41 0.09 0.02 0.03
query42 0.03 0.02 0.02
query43 0.03 0.03 0.03
Total cold run time: 103.86 s
Total hot run time: 29.74 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](broker-load) Fix the COLUMNS FROM PATH feature（in 3.0） [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #57310:
URL: https://github.com/apache/doris/pull/57310#issuecomment-3442165240
<details>
<summary>TPC-DS: <b>Total hot run time: 192758 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0139dc04da1385ad5e88f915b4038748fbb5a6de, data reload: false
query1 965 399 406 399
query2 6266 1920 1853 1853
query3 8689 203 196 196
query4 33834 23538 23900 23538
query5 3647 468 437 437
query6 279 185 176 176
query7 4208 308 319 308
query8 291 214 227 214
query9 9288 2570 2574 2570
query10 447 274 273 273
query11 18132 15605 15277 15277
query12 160 103 104 103
query13 1552 437 433 433
query14 11843 6762 6660 6660
query15 254 173 178 173
query16 7323 518 549 518
query17 1569 605 577 577
query18 1281 350 324 324
query19 252 170 164 164
query20 125 116 117 116
query21 214 107 108 107
query22 4646 4430 4593 4430
query23 35262 34729 34046 34046
query24 12252 2918 2919 2918
query25 686 443 437 437
query26 1758 173 170 170
query27 3115 355 373 355
query28 7787 2202 2145 2145
query29 953 467 462 462
query30 265 160 162 160
query31 1045 858 855 855
query32 104 60 59 59
query33 763 300 323 300
query34 1025 535 514 514
query35 864 753 724 724
query36 1080 959 948 948
query37 219 65 68 65
query38 4092 3996 4037 3996
query39 1554 1515 1495 1495
query40 256 108 103 103
query41 50 49 48 48
query42 114 98 99 98
query43 506 494 490 490
query44 1286 807 812 807
query45 194 172 166 166
query46 1182 746 729 729
query47 2012 1918 1953 1918
query48 476 384 377 377
query49 1012 412 406 406
query50 825 433 437 433
query51 7525 7225 7261 7225
query52 113 93 91 91
query53 258 189 190 189
query54 1238 506 481 481
query55 78 78 76 76
query56 260 260 245 245
query57 1334 1216 1210 1210
query58 228 216 220 216
query59 3280 3067 3160 3067
query60 290 266 259 259
query61 107 112 106 106
query62 855 683 714 683
query63 221 187 188 187
query64 5037 669 641 641
query65 3378 3316 3319 3316
query66 1222 294 303 294
query67 16372 15821 15786 15786
query68 5151 580 575 575
query69 437 262 264 262
query70 1188 1078 1160 1078
query71 353 266 256 256
query72 6150 4033 3992 3992
query73 754 349 365 349
query74 10425 9347 9183 9183
query75 3382 2665 2671 2665
query76 3103 1134 995 995
query77 380 271 273 271
query78 10511 9573 9552 9552
query79 1131 610 589 589
query80 742 443 435 435
query81 498 219 224 219
query82 643 90 88 88
query83 169 153 155 153
query84 237 87 80 80
query85 1444 316 295 295
query86 436 272 308 272
query87 4375 4236 4211 4211
query88 4058 2398 2378 2378
query89 400 292 282 282
query90 2108 197 186 186
query91 209 152 153 152
query92 63 52 53 52
query93 1938 555 544 544
query94 870 305 296 296
query95 363 264 262 262
query96 612 277 276 276
query97 3331 3186 3189 3186
query98 215 204 202 202
query99 1521 1280 1305 1280
Total cold run time: 304995 ms
Total hot run time: 192758 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](broker-load) Fix the COLUMNS FROM PATH feature（in 3.0） [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #57310:
URL: https://github.com/apache/doris/pull/57310#issuecomment-3441894872
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
Please clearly describe your PR:
1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](broker-load) Fix the COLUMNS FROM PATH feature（in 3.0） [doris]
Posted by "0AyanamiRei (via GitHub)" <gi...@apache.org>.
0AyanamiRei commented on PR #57310:
URL: https://github.com/apache/doris/pull/57310#issuecomment-3441973226
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](broker-load) Fix the COLUMNS FROM PATH feature（in 3.0） [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #57310:
URL: https://github.com/apache/doris/pull/57310#issuecomment-3442099898
<details>
<summary>TPC-H: <b>Total hot run time: 39898 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0139dc04da1385ad5e88f915b4038748fbb5a6de, data reload: false
------ Round 1 ----------------------------------
q1 17637 7640 6623 6623
q2 2048 193 174 174
q3 10644 1136 1198 1136
q4 10543 704 756 704
q5 7747 2919 2855 2855
q6 212 129 131 129
q7 995 620 611 611
q8 9601 1999 2030 1999
q9 8570 6393 6433 6393
q10 7060 2239 2298 2239
q11 461 254 264 254
q12 404 210 211 210
q13 17796 3014 3006 3006
q14 235 201 202 201
q15 528 462 457 457
q16 492 380 372 372
q17 980 521 606 521
q18 7059 6775 6701 6701
q19 1405 1100 1022 1022
q20 474 199 205 199
q21 3869 3176 3100 3100
q22 1109 1002 992 992
Total cold run time: 109869 ms
Total hot run time: 39898 ms
----- Round 2, with runtime_filter_mode=off -----
q1 6695 6549 6582 6549
q2 334 235 233 233
q3 3101 2911 2885 2885
q4 2065 1762 1809 1762
q5 5737 5745 5747 5745
q6 217 133 132 132
q7 2230 1791 1778 1778
q8 3388 3548 3426 3426
q9 8880 8842 8830 8830
q10 3560 3537 3565 3537
q11 604 507 496 496
q12 793 597 622 597
q13 3920 3164 3235 3164
q14 307 275 263 263
q15 518 477 491 477
q16 485 446 437 437
q17 1845 1626 1580 1580
q18 8243 7748 7584 7584
q19 1680 1698 1592 1592
q20 2137 1894 1889 1889
q21 5361 4960 5098 4960
q22 1203 1060 1040 1040
Total cold run time: 63303 ms
Total hot run time: 58956 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](broker-load) Fix the COLUMNS FROM PATH feature（in 3.0） [doris]
Posted by "0AyanamiRei (via GitHub)" <gi...@apache.org>.
0AyanamiRei closed pull request #57310: [fix](broker-load) Fix the COLUMNS FROM PATH feature（in 3.0）
URL: https://github.com/apache/doris/pull/57310
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](broker-load) Fix the COLUMNS FROM PATH feature（in 3.0） [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #57310:
URL: https://github.com/apache/doris/pull/57310#issuecomment-3442360986
# FE UT Coverage Report
Increment line coverage ` 40.00% (2/5)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/57310_0139dc04da1385ad5e88f915b4038748fbb5a6de/fe_increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/57310_0139dc04da1385ad5e88f915b4038748fbb5a6de/fe_report/index.html)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org