You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "Gabriel39 (via GitHub)" <gi...@apache.org> on 2023/12/06 10:09:51 UTC
[PR] [pipelineX](bug) Fix hash partition shuffle [doris]
Gabriel39 opened a new pull request, #28071:
URL: https://github.com/apache/doris/pull/28071
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix hash partition shuffle [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28071:
URL: https://github.com/apache/doris/pull/28071#issuecomment-1842595148
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix hash partition shuffle [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 merged PR #28071:
URL: https://github.com/apache/doris/pull/28071
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix hash partition shuffle [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28071:
URL: https://github.com/apache/doris/pull/28071#issuecomment-1842634037
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.6 seconds
stream load tsv: 575 seconds loaded 74807831229 Bytes, about 124 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 33 seconds loaded 861443392 Bytes, about 24 MB/s
insert into select: 29.0 seconds inserted 10000000 Rows, about 344K ops/s
storage size: 17163372165 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix hash partition shuffle [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28071:
URL: https://github.com/apache/doris/pull/28071#issuecomment-1842583426
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix hash partition shuffle [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28071:
URL: https://github.com/apache/doris/pull/28071#issuecomment-1842815147
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit c61975ad5d075311c9fa42a75ff076eab621f649, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4725 4417 4438 4417
q2 361 145 157 145
q3 1446 1201 1207 1201
q4 1125 904 882 882
q5 3163 3170 3138 3138
q6 251 130 127 127
q7 996 507 490 490
q8 2206 2211 2178 2178
q9 6657 6684 6643 6643
q10 3194 3262 3265 3262
q11 330 210 213 210
q12 354 207 207 207
q13 4544 3824 3818 3818
q14 243 211 211 211
q15 574 532 528 528
q16 447 387 383 383
q17 1006 584 565 565
q18 7570 6969 6985 6969
q19 1509 1337 1386 1337
q20 491 355 333 333
q21 3069 2672 2680 2672
q22 354 289 296 289
Total cold run time: 44615 ms
Total hot run time: 40005 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4416 4367 4392 4367
q2 261 164 169 164
q3 3509 3510 3506 3506
q4 2384 2377 2373 2373
q5 5726 5728 5720 5720
q6 241 120 122 120
q7 2391 1878 1912 1878
q8 3513 3511 3517 3511
q9 9008 8965 8954 8954
q10 3877 4001 4001 4001
q11 501 389 377 377
q12 758 595 611 595
q13 4295 3548 3530 3530
q14 273 258 259 258
q15 568 523 513 513
q16 501 444 483 444
q17 1865 1842 1851 1842
q18 8675 8337 8362 8337
q19 1703 1729 1748 1729
q20 2241 1972 1951 1951
q21 6518 6146 6115 6115
q22 485 417 416 416
Total cold run time: 63709 ms
Total hot run time: 60701 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix hash partition shuffle [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28071:
URL: https://github.com/apache/doris/pull/28071#issuecomment-1842594674
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix hash partition shuffle [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #28071:
URL: https://github.com/apache/doris/pull/28071#issuecomment-1842585684
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix hash partition shuffle [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28071:
URL: https://github.com/apache/doris/pull/28071#issuecomment-1842594735
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org