You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "Gabriel39 (via GitHub)" <gi...@apache.org> on 2023/11/22 06:07:45 UTC
[PR] [pipelineX](bug) Fix query timeout due to broadcast [doris]
Gabriel39 opened a new pull request, #27398:
URL: https://github.com/apache/doris/pull/27398
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix query timeout due to broadcast [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27398:
URL: https://github.com/apache/doris/pull/27398#issuecomment-1822574858
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix query timeout due to broadcast [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27398:
URL: https://github.com/apache/doris/pull/27398#issuecomment-1822187840
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit 7939f0e43fd3510fd613a127a1bf241991492a56, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4889 4659 4636 4636
q2 350 163 159 159
q3 2039 1898 1899 1898
q4 1371 1218 1259 1218
q5 3966 3949 3997 3949
q6 244 131 126 126
q7 1410 890 903 890
q8 2735 2781 2756 2756
q9 9832 9492 9839 9492
q10 3454 3531 3547 3531
q11 381 243 238 238
q12 439 290 294 290
q13 4567 3775 3838 3775
q14 315 302 290 290
q15 583 533 529 529
q16 663 584 580 580
q17 1124 974 939 939
q18 7734 7354 7355 7354
q19 1656 1657 1641 1641
q20 549 300 292 292
q21 4322 3926 3941 3926
q22 480 373 368 368
Total cold run time: 53103 ms
Total hot run time: 48877 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4576 4577 4556 4556
q2 346 237 260 237
q3 4009 3986 4003 3986
q4 2710 2681 2682 2681
q5 9603 9571 9536 9536
q6 242 124 125 124
q7 3034 2462 2478 2462
q8 4442 4453 4435 4435
q9 13161 13052 13070 13052
q10 4110 4186 4213 4186
q11 781 643 708 643
q12 973 808 806 806
q13 4281 3642 3599 3599
q14 383 343 351 343
q15 589 525 528 525
q16 727 665 681 665
q17 3930 3982 3862 3862
q18 9498 8971 9089 8971
q19 1788 1765 1761 1761
q20 2426 2070 2046 2046
q21 8876 8723 8409 8409
q22 931 827 787 787
Total cold run time: 81416 ms
Total hot run time: 77672 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix query timeout due to broadcast [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #27398:
URL: https://github.com/apache/doris/pull/27398#issuecomment-1822168089
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix query timeout due to broadcast [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27398:
URL: https://github.com/apache/doris/pull/27398#issuecomment-1822574796
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix query timeout due to broadcast [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 merged PR #27398:
URL: https://github.com/apache/doris/pull/27398
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix query timeout due to broadcast [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #27398:
URL: https://github.com/apache/doris/pull/27398#issuecomment-1822319128
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix query timeout due to broadcast [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27398:
URL: https://github.com/apache/doris/pull/27398#issuecomment-1822198975
TeamCity be ut coverage result:
Function Coverage: 36.56% (8450/23111)
Line Coverage: 28.86% (68717/238098)
Region Coverage: 27.83% (35540/127714)
Branch Coverage: 24.58% (18127/73756)
Coverage Report: http://coverage.selectdb-in.cc/coverage/7939f0e43fd3510fd613a127a1bf241991492a56_7939f0e43fd3510fd613a127a1bf241991492a56/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix query timeout due to broadcast [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27398:
URL: https://github.com/apache/doris/pull/27398#issuecomment-1822173452
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix query timeout due to broadcast [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27398:
URL: https://github.com/apache/doris/pull/27398#issuecomment-1822508131
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.62 seconds
stream load tsv: 569 seconds loaded 74807831229 Bytes, about 125 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.7 seconds inserted 10000000 Rows, about 348K ops/s
storage size: 17099052318 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix query timeout due to broadcast [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27398:
URL: https://github.com/apache/doris/pull/27398#issuecomment-1822249759
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix query timeout due to broadcast [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #27398:
URL: https://github.com/apache/doris/pull/27398#issuecomment-1822246150
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix query timeout due to broadcast [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27398:
URL: https://github.com/apache/doris/pull/27398#issuecomment-1822555439
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit e8247ac2522325f201e567acece9aeb0d76986a4, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4878 4678 4663 4663
q2 355 163 154 154
q3 2018 1916 1934 1916
q4 1405 1300 1278 1278
q5 3964 3964 3990 3964
q6 241 130 133 130
q7 1419 890 888 888
q8 2694 2765 2745 2745
q9 9862 9574 9504 9504
q10 3445 3555 3556 3555
q11 381 250 249 249
q12 436 294 290 290
q13 4583 3824 3832 3824
q14 315 278 286 278
q15 589 545 525 525
q16 660 581 583 581
q17 1125 969 930 930
q18 7750 7325 7497 7325
q19 1666 1660 1671 1660
q20 524 303 313 303
q21 4389 3955 3978 3955
q22 477 383 372 372
Total cold run time: 53176 ms
Total hot run time: 49089 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4570 4591 4562 4562
q2 357 240 282 240
q3 4007 4008 3986 3986
q4 2717 2703 2694 2694
q5 9594 9543 9655 9543
q6 241 122 126 122
q7 2991 2448 2512 2448
q8 4401 4420 4453 4420
q9 13148 13143 13135 13135
q10 4107 4213 4206 4206
q11 795 654 649 649
q12 980 812 830 812
q13 4311 3551 3595 3551
q14 384 355 340 340
q15 584 523 526 523
q16 759 668 688 668
q17 3856 3891 3868 3868
q18 9561 8975 9024 8975
q19 1847 1778 1764 1764
q20 2383 2063 2059 2059
q21 8820 8550 8448 8448
q22 909 844 775 775
Total cold run time: 81322 ms
Total hot run time: 77788 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix query timeout due to broadcast [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27398:
URL: https://github.com/apache/doris/pull/27398#issuecomment-1822197300
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.52 seconds
stream load tsv: 566 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.8 seconds inserted 10000000 Rows, about 347K ops/s
storage size: 17101361004 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](bug) Fix query timeout due to broadcast [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27398:
URL: https://github.com/apache/doris/pull/27398#issuecomment-1822327310
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org