You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "wuwenchi (via GitHub)" <gi...@apache.org> on 2024/09/12 03:09:44 UTC
[PR] [bugfix](hive)Handle exceptions when submitting tasks fails to prevent dead loop [doris]
wuwenchi opened a new pull request, #40708:
URL: https://github.com/apache/doris/pull/40708
## Proposed changes
When the thread pool is full, an exception will be thrown and we need to handle this exception
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfix](hive)Handle exceptions when submitting tasks fails to prevent dead loop [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40708:
URL: https://github.com/apache/doris/pull/40708#issuecomment-2345179005
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfix](hive)Handle exceptions when submitting tasks fails to prevent dead loop [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40708:
URL: https://github.com/apache/doris/pull/40708#issuecomment-2345204643
<details>
<summary>TPC-DS: <b>Total hot run time: 194766 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 97fab69fa700eca751183efd5cfb17248eb75fae, data reload: false
query1 806 391 374 374
query2 6108 1733 1724 1724
query3 5765 219 225 219
query4 27283 24096 24095 24095
query5 3586 536 537 536
query6 248 163 163 163
query7 4368 295 300 295
query8 280 226 229 226
query9 7977 2432 2439 2432
query10 447 285 293 285
query11 16365 15505 15590 15505
query12 165 101 102 101
query13 1474 402 387 387
query14 9759 6753 6984 6753
query15 221 173 172 172
query16 6281 456 478 456
query17 1236 554 552 552
query18 1738 299 285 285
query19 194 142 176 142
query20 118 112 107 107
query21 175 104 104 104
query22 4404 4163 4347 4163
query23 34460 33747 33705 33705
query24 9341 3122 3079 3079
query25 620 377 398 377
query26 1431 156 153 153
query27 2542 281 277 277
query28 5998 2031 1996 1996
query29 904 430 403 403
query30 255 159 152 152
query31 987 784 808 784
query32 97 59 59 59
query33 639 310 301 301
query34 924 471 485 471
query35 883 725 730 725
query36 1060 901 917 901
query37 170 95 78 78
query38 4047 3916 3882 3882
query39 1462 1443 1399 1399
query40 252 114 113 113
query41 48 48 46 46
query42 120 95 98 95
query43 498 468 437 437
query44 1195 770 752 752
query45 200 169 175 169
query46 1102 838 803 803
query47 1878 1791 1802 1791
query48 364 299 287 287
query49 870 465 450 450
query50 905 440 456 440
query51 7056 6956 6797 6797
query52 98 94 89 89
query53 256 183 190 183
query54 631 465 468 465
query55 80 72 73 72
query56 286 273 257 257
query57 1231 1103 1097 1097
query58 237 244 277 244
query59 2656 2564 2627 2564
query60 294 275 266 266
query61 108 99 100 99
query62 863 673 682 673
query63 235 193 184 184
query64 4085 706 656 656
query65 3256 3171 3195 3171
query66 1190 339 344 339
query67 15909 15558 15462 15462
query68 2760 877 850 850
query69 438 340 351 340
query70 1168 1186 1169 1169
query71 368 362 348 348
query72 5239 3543 3509 3509
query73 599 586 586 586
query74 9147 9069 8990 8990
query75 3149 3018 3038 3018
query76 1402 877 889 877
query77 470 424 431 424
query78 9440 9296 9227 9227
query79 923 883 886 883
query80 884 875 854 854
query81 454 265 266 265
query82 270 273 276 273
query83 207 202 200 200
query84 260 115 113 113
query85 724 469 471 469
query86 326 291 337 291
query87 4462 4454 4342 4342
query88 4131 4061 4202 4061
query89 390 377 370 370
query90 1376 326 335 326
query91 125 126 127 126
query92 81 80 78 78
query93 1058 1062 1053 1053
query94 607 386 398 386
query95 474 422 427 422
query96 478 472 467 467
query97 3138 3106 3097 3097
query98 234 233 227 227
query99 1601 1311 1306 1306
Total cold run time: 267104 ms
Total hot run time: 194766 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfix](hive)Handle exceptions when submitting tasks fails to prevent dead loop [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40708:
URL: https://github.com/apache/doris/pull/40708#issuecomment-2345209335
<details>
<summary>ClickBench: <b>Total hot run time: 30.77 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 97fab69fa700eca751183efd5cfb17248eb75fae, data reload: false
query1 0.05 0.05 0.04
query2 0.08 0.04 0.04
query3 0.23 0.05 0.05
query4 1.68 0.06 0.07
query5 0.50 0.50 0.50
query6 1.13 0.73 0.74
query7 0.01 0.01 0.02
query8 0.05 0.04 0.05
query9 0.59 0.54 0.53
query10 0.59 0.61 0.62
query11 0.16 0.12 0.12
query12 0.15 0.14 0.13
query13 0.63 0.61 0.60
query14 1.53 1.47 1.44
query15 0.91 0.89 0.89
query16 0.37 0.36 0.36
query17 1.06 1.06 1.01
query18 0.16 0.16 0.17
query19 1.92 1.76 1.81
query20 0.01 0.02 0.01
query21 15.40 0.68 0.67
query22 4.60 8.05 1.15
query23 17.90 1.24 1.37
query24 2.28 0.23 0.22
query25 0.18 0.08 0.08
query26 0.28 0.17 0.18
query27 0.08 0.08 0.08
query28 13.16 1.01 0.99
query29 12.51 3.33 3.30
query30 0.24 0.06 0.05
query31 2.89 0.43 0.42
query32 3.22 0.50 0.51
query33 3.06 3.05 3.05
query34 15.42 4.33 4.32
query35 4.34 4.33 4.35
query36 0.69 0.49 0.50
query37 0.19 0.16 0.16
query38 0.17 0.15 0.15
query39 0.04 0.04 0.04
query40 0.17 0.14 0.13
query41 0.09 0.05 0.06
query42 0.06 0.05 0.05
query43 0.05 0.05 0.04
Total cold run time: 108.83 s
Total hot run time: 30.77 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfix](hive)Handle exceptions when submitting tasks fails to prevent dead loop [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40708:
URL: https://github.com/apache/doris/pull/40708#issuecomment-2345194927
<details>
<summary>TPC-H: <b>Total hot run time: 39855 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 97fab69fa700eca751183efd5cfb17248eb75fae, data reload: false
------ Round 1 ----------------------------------
q1 17601 4435 4238 4238
q2 2047 187 187 187
q3 10617 1417 1346 1346
q4 10444 965 1061 965
q5 7697 3212 3154 3154
q6 226 137 136 136
q7 1033 640 622 622
q8 9650 2020 1979 1979
q9 7093 6313 6314 6313
q10 7094 2464 2505 2464
q11 447 248 244 244
q12 416 225 223 223
q13 17785 3001 3048 3001
q14 285 265 253 253
q15 545 483 477 477
q16 543 439 417 417
q17 996 950 941 941
q18 7599 6852 6798 6798
q19 1380 1237 1235 1235
q20 601 325 323 323
q21 3921 3542 3538 3538
q22 1091 1001 1013 1001
Total cold run time: 109111 ms
Total hot run time: 39855 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4213 4181 4168 4168
q2 346 237 231 231
q3 2946 2901 2932 2901
q4 1967 1977 1963 1963
q5 5458 5402 5391 5391
q6 215 129 128 128
q7 2036 1684 1690 1684
q8 3258 3328 3300 3300
q9 8507 8426 8499 8426
q10 3363 3443 3415 3415
q11 559 467 472 467
q12 777 573 567 567
q13 12664 3033 3014 3014
q14 298 263 281 263
q15 520 482 482 482
q16 495 441 449 441
q17 1783 1711 1746 1711
q18 7868 7498 7504 7498
q19 1719 1692 1690 1690
q20 2021 1819 1815 1815
q21 5520 5379 5410 5379
q22 1109 979 984 979
Total cold run time: 67642 ms
Total hot run time: 55913 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfix](hive)Handle exceptions when submitting tasks fails to prevent dead loop [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #40708:
URL: https://github.com/apache/doris/pull/40708#issuecomment-2345563683
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfix](hive)Handle exceptions when submitting tasks fails to prevent dead loop [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #40708:
URL: https://github.com/apache/doris/pull/40708#issuecomment-2345563754
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfix](hive)Handle exceptions when submitting tasks fails to prevent dead loop [doris]
Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman merged PR #40708:
URL: https://github.com/apache/doris/pull/40708
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfix](hive)Handle exceptions when submitting tasks fails to prevent dead loop [doris]
Posted by "wuwenchi (via GitHub)" <gi...@apache.org>.
wuwenchi commented on PR #40708:
URL: https://github.com/apache/doris/pull/40708#issuecomment-2345179360
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org