You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "BiteTheDDDDt (via GitHub)" <gi...@apache.org> on 2023/11/16 12:08:45 UTC
[PR] [Chore](status) catch some error status on storage [doris]
BiteTheDDDDt opened a new pull request, #27132:
URL: https://github.com/apache/doris/pull/27132
## Proposed changes
catch some error status on storage
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Chore](status) catch some error status on storage [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27132:
URL: https://github.com/apache/doris/pull/27132#issuecomment-1815686182
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit 32e6545ccb0e981941ccf4bb4112c9ca4db6abe1, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4952 4692 4717 4692
q2 374 180 159 159
q3 2070 1911 1918 1911
q4 1372 1272 1253 1253
q5 3988 3966 4013 3966
q6 252 128 132 128
q7 1408 874 887 874
q8 2768 2796 2781 2781
q9 9692 9750 9545 9545
q10 3479 3512 3531 3512
q11 383 245 253 245
q12 439 292 291 291
q13 4581 3788 3797 3788
q14 320 288 292 288
q15 584 529 528 528
q16 664 586 584 584
q17 1150 976 925 925
q18 7847 7338 7446 7338
q19 1700 1684 1651 1651
q20 527 296 290 290
q21 4430 3970 3953 3953
q22 476 374 375 374
Total cold run time: 53456 ms
Total hot run time: 49076 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4599 4613 4573 4573
q2 343 242 285 242
q3 3994 3996 4004 3996
q4 2705 2706 2711 2706
q5 9646 9657 9643 9643
q6 241 126 126 126
q7 2591 2323 2241 2241
q8 4444 4441 4444 4441
q9 13250 13059 13087 13059
q10 4094 4220 4179 4179
q11 778 670 625 625
q12 987 830 834 830
q13 4263 3643 3586 3586
q14 392 344 343 343
q15 584 518 532 518
q16 734 674 667 667
q17 3862 3863 3857 3857
q18 9664 9146 9148 9146
q19 1824 1805 1792 1792
q20 2411 2070 2047 2047
q21 8846 8623 8378 8378
q22 945 807 769 769
Total cold run time: 81197 ms
Total hot run time: 77764 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Chore](status) catch some error status on storage [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27132:
URL: https://github.com/apache/doris/pull/27132#issuecomment-1814514613
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.08 seconds
stream load tsv: 571 seconds loaded 74807831229 Bytes, about 124 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 30.3 seconds inserted 10000000 Rows, about 330K ops/s
storage size: 17099081532 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Chore](status) catch some error status on storage [doris]
Posted by "BiteTheDDDDt (via GitHub)" <gi...@apache.org>.
BiteTheDDDDt commented on PR #27132:
URL: https://github.com/apache/doris/pull/27132#issuecomment-1814320309
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Chore](status) catch some error status on storage [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27132:
URL: https://github.com/apache/doris/pull/27132#issuecomment-1815584804
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Chore](status) catch some error status on storage [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27132:
URL: https://github.com/apache/doris/pull/27132#issuecomment-1814432883
TeamCity be ut coverage result:
Function Coverage: 36.76% (8412/22883)
Line Coverage: 29.28% (68405/233638)
Region Coverage: 27.88% (35374/126886)
Branch Coverage: 24.63% (18065/73356)
Coverage Report: http://coverage.selectdb-in.cc/coverage/f24ab5fd0abd0b2645235e98d766513c48568483_f24ab5fd0abd0b2645235e98d766513c48568483/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Chore](status) catch some error status on storage [doris]
Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei commented on PR #27132:
URL: https://github.com/apache/doris/pull/27132#issuecomment-1815584751
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Chore](status) catch some error status on storage [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27132:
URL: https://github.com/apache/doris/pull/27132#issuecomment-1815692712
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.67 seconds
stream load tsv: 561 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.7 seconds inserted 10000000 Rows, about 348K ops/s
storage size: 17100736524 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Chore](status) catch some error status on storage [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27132:
URL: https://github.com/apache/doris/pull/27132#issuecomment-1815584830
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Chore](status) catch some error status on storage [doris]
Posted by "BiteTheDDDDt (via GitHub)" <gi...@apache.org>.
BiteTheDDDDt merged PR #27132:
URL: https://github.com/apache/doris/pull/27132
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Chore](status) catch some error status on storage [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27132:
URL: https://github.com/apache/doris/pull/27132#issuecomment-1814328488
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Chore](status) catch some error status on storage [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27132:
URL: https://github.com/apache/doris/pull/27132#issuecomment-1814495332
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit f24ab5fd0abd0b2645235e98d766513c48568483, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4914 4668 4676 4668
q2 354 169 163 163
q3 2034 1983 1918 1918
q4 1397 1318 1287 1287
q5 3942 3931 4026 3931
q6 248 130 126 126
q7 1401 881 893 881
q8 2757 2781 2771 2771
q9 9689 9648 9547 9547
q10 3488 3495 3511 3495
q11 385 247 237 237
q12 444 301 292 292
q13 4568 3784 3771 3771
q14 313 294 278 278
q15 574 533 531 531
q16 669 586 581 581
q17 1135 959 885 885
q18 7784 7417 7359 7359
q19 1671 1688 1668 1668
q20 582 328 270 270
q21 4373 3987 3987 3987
q22 465 378 380 378
Total cold run time: 53187 ms
Total hot run time: 49024 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4596 4582 4573 4573
q2 339 226 263 226
q3 4004 3979 3983 3979
q4 2694 2685 2683 2683
q5 9567 9652 9621 9621
q6 243 124 124 124
q7 2609 2258 2253 2253
q8 4434 4471 4438 4438
q9 13135 13079 13044 13044
q10 4084 4173 4176 4173
q11 780 711 652 652
q12 987 815 824 815
q13 4285 3558 3566 3558
q14 388 344 355 344
q15 584 511 521 511
q16 753 682 671 671
q17 3909 3770 3892 3770
q18 9634 9056 8917 8917
q19 1825 1787 1757 1757
q20 2400 2082 2036 2036
q21 8735 8641 8552 8552
q22 937 785 843 785
Total cold run time: 80922 ms
Total hot run time: 77482 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Chore](status) catch some error status on storage [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27132:
URL: https://github.com/apache/doris/pull/27132#issuecomment-1815661977
TeamCity be ut coverage result:
Function Coverage: 36.75% (8410/22883)
Line Coverage: 29.28% (68404/233638)
Region Coverage: 27.87% (35366/126886)
Branch Coverage: 24.63% (18069/73356)
Coverage Report: http://coverage.selectdb-in.cc/coverage/32e6545ccb0e981941ccf4bb4112c9ca4db6abe1_32e6545ccb0e981941ccf4bb4112c9ca4db6abe1/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Chore](status) catch some error status on storage [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27132:
URL: https://github.com/apache/doris/pull/27132#issuecomment-1815591799
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org