You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "jacktengg (via GitHub)" <gi...@apache.org> on 2025/11/19 06:57:52 UTC
[PR] [fix](local shuffle) set enable_local_shuffle var needForward = true [doris]
jacktengg opened a new pull request, #58143:
URL: https://github.com/apache/doris/pull/58143
### What problem does this PR solve?
Issue Number: close #xxx
Related PR: #xxx
Problem Summary:
### Release note
None
### Check List (For Author)
- Test <!-- At least one of them must be included. -->
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason <!-- Add your reason? -->
- Behavior changed:
- [ ] No.
- [ ] Yes. <!-- Explain the behavior change -->
- Does this need documentation?
- [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg: https://github.com/apache/doris-website/pull/1214 -->
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR should merge into -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](local shuffle) set enable_local_shuffle var needForward = true [doris]
Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #58143:
URL: https://github.com/apache/doris/pull/58143
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](local shuffle) set enable_local_shuffle var needForward = true [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #58143:
URL: https://github.com/apache/doris/pull/58143#issuecomment-3551221889
<details>
<summary>TPC-DS: <b>Total hot run time: 188975 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 59ea6aa0438b9df9fdad2a0ae9bc02f0c9f365f4, data reload: false
query1 1035 418 389 389
query2 6564 1705 1678 1678
query3 6756 231 233 231
query4 25992 22947 22821 22821
query5 4428 660 537 537
query6 369 259 250 250
query7 4657 504 319 319
query8 311 262 262 262
query9 8699 2954 2962 2954
query10 483 358 315 315
query11 15876 15005 14817 14817
query12 183 124 121 121
query13 1686 568 437 437
query14 10391 9365 9454 9365
query15 210 185 178 178
query16 7168 672 516 516
query17 1053 767 627 627
query18 1995 430 338 338
query19 211 215 184 184
query20 126 126 121 121
query21 217 132 118 118
query22 4089 4074 4086 4074
query23 33947 33016 32908 32908
query24 8184 2354 2379 2354
query25 618 533 472 472
query26 1254 277 174 174
query27 2746 492 371 371
query28 4371 2259 2258 2258
query29 836 629 506 506
query30 299 219 198 198
query31 898 811 718 718
query32 92 87 85 85
query33 591 388 362 362
query34 800 854 525 525
query35 822 845 772 772
query36 944 1014 912 912
query37 131 119 96 96
query38 3491 3529 3508 3508
query39 1475 1401 1453 1401
query40 240 140 124 124
query41 62 61 59 59
query42 133 118 117 117
query43 485 502 468 468
query44 1262 813 806 806
query45 189 179 176 176
query46 889 994 661 661
query47 1750 1810 1710 1710
query48 387 443 333 333
query49 765 503 416 416
query50 654 696 414 414
query51 3876 3886 3861 3861
query52 125 124 112 112
query53 258 271 216 216
query54 361 338 310 310
query55 101 97 90 90
query56 362 347 370 347
query57 1182 1178 1124 1124
query58 309 310 284 284
query59 2528 2643 2561 2561
query60 374 369 360 360
query61 195 166 161 161
query62 806 699 671 671
query63 239 202 205 202
query64 4521 1281 1009 1009
query65 4050 3930 3936 3930
query66 1192 438 342 342
query67 15093 15116 15134 15116
query68 5823 960 645 645
query69 502 342 301 301
query70 1364 1236 1282 1236
query71 451 358 334 334
query72 5935 4970 5075 4970
query73 678 626 375 375
query74 8946 9033 8891 8891
query75 3254 3278 2769 2769
query76 3232 1137 755 755
query77 520 415 342 342
query78 9395 9454 8772 8772
query79 1725 858 616 616
query80 650 601 541 541
query81 510 261 233 233
query82 227 164 138 138
query83 274 263 263 263
query84 298 114 92 92
query85 887 493 457 457
query86 382 328 286 286
query87 3784 3675 3627 3627
query88 2837 2289 2276 2276
query89 392 338 302 302
query90 1844 243 239 239
query91 196 187 156 156
query92 90 83 79 79
query93 1154 1009 690 690
query94 672 421 355 355
query95 435 356 356 356
query96 484 611 284 284
query97 2838 2977 2846 2846
query98 244 224 220 220
query99 1321 1431 1277 1277
Total cold run time: 267730 ms
Total hot run time: 188975 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](local shuffle) set enable_local_shuffle var needForward = true [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #58143:
URL: https://github.com/apache/doris/pull/58143#issuecomment-3551191496
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](local shuffle) set enable_local_shuffle var needForward = true [doris]
Posted by "jacktengg (via GitHub)" <gi...@apache.org>.
jacktengg commented on PR #58143:
URL: https://github.com/apache/doris/pull/58143#issuecomment-3551092712
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](local shuffle) set enable_local_shuffle var needForward = true [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #58143:
URL: https://github.com/apache/doris/pull/58143#issuecomment-3551238178
<details>
<summary>ClickBench: <b>Total hot run time: 27.59 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 59ea6aa0438b9df9fdad2a0ae9bc02f0c9f365f4, data reload: false
query1 0.06 0.06 0.05
query2 0.10 0.05 0.05
query3 0.26 0.08 0.08
query4 1.60 0.11 0.11
query5 0.26 0.25 0.24
query6 1.20 0.65 0.64
query7 0.04 0.03 0.02
query8 0.06 0.04 0.04
query9 0.58 0.52 0.52
query10 0.57 0.57 0.57
query11 0.16 0.11 0.11
query12 0.16 0.13 0.12
query13 0.62 0.60 0.59
query14 1.01 1.01 1.00
query15 0.84 0.82 0.83
query16 0.40 0.40 0.39
query17 1.05 1.03 1.02
query18 0.22 0.20 0.20
query19 1.86 1.78 1.86
query20 0.02 0.01 0.01
query21 15.48 0.20 0.13
query22 5.06 0.06 0.05
query23 15.74 0.25 0.10
query24 3.31 0.61 0.91
query25 0.07 0.08 0.07
query26 0.15 0.13 0.13
query27 0.05 0.06 0.05
query28 5.38 1.16 0.95
query29 12.58 3.83 3.20
query30 0.29 0.14 0.12
query31 2.82 0.59 0.38
query32 3.24 0.57 0.47
query33 3.06 3.04 3.04
query34 15.65 5.16 4.54
query35 4.56 4.56 4.54
query36 0.69 0.50 0.49
query37 0.10 0.07 0.07
query38 0.06 0.04 0.04
query39 0.03 0.04 0.03
query40 0.17 0.13 0.14
query41 0.09 0.03 0.04
query42 0.04 0.03 0.03
query43 0.05 0.04 0.03
Total cold run time: 99.74 s
Total hot run time: 27.59 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](local shuffle) set enable_local_shuffle var needForward = true [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #58143:
URL: https://github.com/apache/doris/pull/58143#issuecomment-3551174490
<details>
<summary>TPC-H: <b>Total hot run time: 34378 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 59ea6aa0438b9df9fdad2a0ae9bc02f0c9f365f4, data reload: false
------ Round 1 ----------------------------------
q1 17619 5118 4963 4963
q2 2051 310 209 209
q3 10256 1295 732 732
q4 10236 949 377 377
q5 7592 2470 2301 2301
q6 178 166 134 134
q7 944 739 622 622
q8 9338 1275 1067 1067
q9 6973 5353 5392 5353
q10 6828 2239 1809 1809
q11 523 312 276 276
q12 334 363 237 237
q13 17781 3637 3053 3053
q14 233 228 216 216
q15 566 515 496 496
q16 1002 1010 955 955
q17 588 870 355 355
q18 7392 7085 7123 7085
q19 1079 954 550 550
q20 367 349 226 226
q21 3997 3263 2374 2374
q22 1067 1019 988 988
Total cold run time: 106944 ms
Total hot run time: 34378 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4950 4964 5097 4964
q2 322 387 322 322
q3 2141 2676 2327 2327
q4 1339 1759 1368 1368
q5 4208 4433 4659 4433
q6 216 178 135 135
q7 2017 1965 1867 1867
q8 2671 2666 2565 2565
q9 7427 7620 7522 7522
q10 3133 3261 2801 2801
q11 591 547 514 514
q12 676 795 642 642
q13 3658 3977 3345 3345
q14 294 314 283 283
q15 562 527 500 500
q16 1092 1090 1070 1070
q17 1216 1606 1376 1376
q18 8122 7754 7575 7575
q19 795 858 1063 858
q20 2038 2092 1925 1925
q21 5133 4340 4233 4233
q22 1110 1048 1000 1000
Total cold run time: 53711 ms
Total hot run time: 51625 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](local shuffle) set enable_local_shuffle var needForward = true [doris]
Posted by "Thearas (via GitHub)" <gi...@apache.org>.
Thearas commented on PR #58143:
URL: https://github.com/apache/doris/pull/58143#issuecomment-3551092516
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
Please clearly describe your PR:
1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](local shuffle) set enable_local_shuffle var needForward = true [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #58143:
URL: https://github.com/apache/doris/pull/58143#issuecomment-3551191359
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org