You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "yujun777 (via GitHub)" <gi...@apache.org> on 2023/11/16 02:42:40 UTC
[PR] [fix](fe ut) fix unstable ut DecommissionTest [doris]
yujun777 opened a new pull request, #27082:
URL: https://github.com/apache/doris/pull/27082
After decommission a be, its 600 tablets will relocate to other three backends.
tolerate a tiny unbalance between the tablet num of the three backends;
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe ut) fix unstable ut DecommissionTest [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27082:
URL: https://github.com/apache/doris/pull/27082#issuecomment-1814081551
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.01 seconds
stream load tsv: 566 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.8 seconds inserted 10000000 Rows, about 347K ops/s
storage size: 17100100282 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe ut) fix unstable ut DecommissionTest [doris]
Posted by "yujun777 (via GitHub)" <gi...@apache.org>.
yujun777 commented on PR #27082:
URL: https://github.com/apache/doris/pull/27082#issuecomment-1815662256
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe ut) fix unstable ut DecommissionTest [doris]
Posted by "yujun777 (via GitHub)" <gi...@apache.org>.
yujun777 commented on PR #27082:
URL: https://github.com/apache/doris/pull/27082#issuecomment-1813850522
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe ut) fix unstable ut DecommissionTest [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27082:
URL: https://github.com/apache/doris/pull/27082#issuecomment-1815745146
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit bea09ea46915dbf921e70b27e141752b333c1b9a, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4943 4653 4661 4653
q2 356 156 140 140
q3 2065 1950 1967 1950
q4 1386 1271 1275 1271
q5 3960 3960 3994 3960
q6 250 132 133 132
q7 1382 880 873 873
q8 2774 2785 2772 2772
q9 9891 9587 9538 9538
q10 3473 3550 3543 3543
q11 383 236 245 236
q12 436 298 300 298
q13 4584 3859 3812 3812
q14 323 300 294 294
q15 597 537 527 527
q16 661 588 598 588
q17 1134 981 910 910
q18 7752 7365 7452 7365
q19 1661 1707 1652 1652
q20 564 325 326 325
q21 4397 3946 4038 3946
q22 466 375 378 375
Total cold run time: 53438 ms
Total hot run time: 49160 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4606 4563 4577 4563
q2 333 218 252 218
q3 4005 4010 3991 3991
q4 2721 2712 2703 2703
q5 9657 9678 9668 9668
q6 248 124 127 124
q7 2579 2237 2254 2237
q8 4455 4454 4442 4442
q9 13122 13022 13126 13022
q10 4074 4181 4192 4181
q11 808 643 663 643
q12 970 821 819 819
q13 4290 3624 3574 3574
q14 383 358 349 349
q15 577 522 516 516
q16 729 670 668 668
q17 3875 3850 3835 3835
q18 9514 9124 9282 9124
q19 1819 1794 1771 1771
q20 2390 2055 2062 2055
q21 8882 8588 8292 8292
q22 897 821 803 803
Total cold run time: 80934 ms
Total hot run time: 77598 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe ut) fix unstable ut DecommissionTest [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27082:
URL: https://github.com/apache/doris/pull/27082#issuecomment-1815665628
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe ut) fix unstable ut DecommissionTest [doris]
Posted by "yujun777 (via GitHub)" <gi...@apache.org>.
yujun777 commented on PR #27082:
URL: https://github.com/apache/doris/pull/27082#issuecomment-1814031871
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe ut) fix unstable ut DecommissionTest [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #27082:
URL: https://github.com/apache/doris/pull/27082
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe ut) fix unstable ut DecommissionTest [doris]
Posted by "yujun777 (via GitHub)" <gi...@apache.org>.
yujun777 commented on PR #27082:
URL: https://github.com/apache/doris/pull/27082#issuecomment-1813852055
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe ut) fix unstable ut DecommissionTest [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27082:
URL: https://github.com/apache/doris/pull/27082#issuecomment-1814142868
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit bea09ea46915dbf921e70b27e141752b333c1b9a, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4970 4674 4662 4662
q2 358 147 145 145
q3 2039 2000 1932 1932
q4 1396 1273 1262 1262
q5 3966 3970 4012 3970
q6 253 129 132 129
q7 1387 870 871 870
q8 2743 2802 2764 2764
q9 10136 9599 9541 9541
q10 3459 3508 3531 3508
q11 378 250 248 248
q12 433 289 294 289
q13 4590 3831 3802 3802
q14 334 283 291 283
q15 585 537 531 531
q16 676 582 580 580
q17 1145 946 930 930
q18 7853 7383 7498 7383
q19 1686 1676 1713 1676
q20 544 342 323 323
q21 4350 4014 3953 3953
q22 475 373 374 373
Total cold run time: 53756 ms
Total hot run time: 49154 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4607 4571 4578 4571
q2 343 226 257 226
q3 4017 3998 4017 3998
q4 2702 2699 2684 2684
q5 9666 9694 9590 9590
q6 251 122 119 119
q7 2605 2309 2301 2301
q8 4447 4440 4448 4440
q9 13276 13172 13266 13172
q10 4085 4191 4190 4190
q11 806 649 685 649
q12 982 816 820 816
q13 4283 3564 3560 3560
q14 391 349 358 349
q15 582 518 538 518
q16 754 686 709 686
q17 3814 3892 3857 3857
q18 9640 9075 9056 9056
q19 1842 1817 1771 1771
q20 2410 2065 2042 2042
q21 8961 8628 8737 8628
q22 905 852 817 817
Total cold run time: 81369 ms
Total hot run time: 78040 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe ut) fix unstable ut DecommissionTest [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27082:
URL: https://github.com/apache/doris/pull/27082#issuecomment-1815667092
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe ut) fix unstable ut DecommissionTest [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27082:
URL: https://github.com/apache/doris/pull/27082#issuecomment-1815745258
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.68 seconds
stream load tsv: 582 seconds loaded 74807831229 Bytes, about 122 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.2 seconds inserted 10000000 Rows, about 354K ops/s
storage size: 17099394639 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org