You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "mrhhsg (via GitHub)" <gi...@apache.org> on 2024/06/05 15:34:50 UTC
[PR] [fix](fe) avoid setting the value of batch_size excessively high [doris]
mrhhsg opened a new pull request, #35941:
URL: https://github.com/apache/doris/pull/35941
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe) avoid setting the value of batch_size excessively high [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #35941:
URL: https://github.com/apache/doris/pull/35941#issuecomment-2151528304
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe) avoid setting the value of batch_size excessively high [doris]
Posted by "mrhhsg (via GitHub)" <gi...@apache.org>.
mrhhsg commented on PR #35941:
URL: https://github.com/apache/doris/pull/35941#issuecomment-2150373153
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe) avoid setting the value of batch_size excessively high [doris]
Posted by "mrhhsg (via GitHub)" <gi...@apache.org>.
mrhhsg merged PR #35941:
URL: https://github.com/apache/doris/pull/35941
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe) avoid setting the value of batch_size excessively high [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35941:
URL: https://github.com/apache/doris/pull/35941#issuecomment-2150471314
<details>
<summary>TPC-DS: <b>Total hot run time: 172408 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b778827c91e6051a9b5f454297cbea1526a11084, data reload: false
query1 919 378 376 376
query2 6438 2470 2292 2292
query3 6652 209 208 208
query4 19506 17202 17108 17108
query5 4129 476 470 470
query6 249 161 159 159
query7 4605 291 289 289
query8 302 281 298 281
query9 8581 2353 2348 2348
query10 445 298 300 298
query11 10541 9970 9911 9911
query12 128 85 82 82
query13 1624 376 369 369
query14 10193 7569 7705 7569
query15 234 190 181 181
query16 7714 271 265 265
query17 1606 531 506 506
query18 1892 266 270 266
query19 191 149 169 149
query20 89 79 84 79
query21 208 130 129 129
query22 4275 4079 3897 3897
query23 33761 33025 32926 32926
query24 11275 2888 2858 2858
query25 629 359 356 356
query26 1171 154 154 154
query27 2611 325 321 321
query28 7001 2028 2018 2018
query29 876 624 600 600
query30 288 151 152 151
query31 961 743 748 743
query32 98 54 54 54
query33 766 292 302 292
query34 943 487 472 472
query35 775 603 600 600
query36 1071 940 941 940
query37 150 70 69 69
query38 2900 2758 2727 2727
query39 869 783 798 783
query40 197 122 120 120
query41 58 51 54 51
query42 115 98 102 98
query43 586 558 525 525
query44 1263 744 758 744
query45 193 164 163 163
query46 1062 741 713 713
query47 1843 1737 1753 1737
query48 384 296 298 296
query49 1077 410 410 410
query50 787 385 390 385
query51 6791 6632 6661 6632
query52 104 94 92 92
query53 361 295 322 295
query54 917 465 442 442
query55 75 73 74 73
query56 275 256 266 256
query57 1126 1037 1043 1037
query58 243 241 241 241
query59 3255 3102 3094 3094
query60 284 271 275 271
query61 89 87 89 87
query62 660 444 439 439
query63 328 289 287 287
query64 8972 2225 1692 1692
query65 3182 3119 3068 3068
query66 796 336 336 336
query67 15067 14864 14950 14864
query68 4573 563 565 563
query69 477 335 312 312
query70 1109 1134 1154 1134
query71 395 276 266 266
query72 6988 5327 5633 5327
query73 756 335 329 329
query74 5967 5516 5458 5458
query75 3413 2660 2667 2660
query76 2266 891 915 891
query77 461 307 299 299
query78 10205 10045 9679 9679
query79 2412 521 516 516
query80 1163 468 456 456
query81 586 224 229 224
query82 863 103 101 101
query83 238 168 169 168
query84 246 86 88 86
query85 1268 327 322 322
query86 466 313 325 313
query87 3286 3050 3109 3050
query88 4338 2465 2441 2441
query89 484 393 393 393
query90 1752 198 195 195
query91 138 110 109 109
query92 70 51 51 51
query93 1573 514 506 506
query94 1198 198 198 198
query95 407 324 324 324
query96 594 272 272 272
query97 3175 2991 3031 2991
query98 226 215 192 192
query99 1380 855 838 838
Total cold run time: 269229 ms
Total hot run time: 172408 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe) avoid setting the value of batch_size excessively high [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #35941:
URL: https://github.com/apache/doris/pull/35941#issuecomment-2151528336
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe) avoid setting the value of batch_size excessively high [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35941:
URL: https://github.com/apache/doris/pull/35941#issuecomment-2150373007
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe) avoid setting the value of batch_size excessively high [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35941:
URL: https://github.com/apache/doris/pull/35941#issuecomment-2150450297
<details>
<summary>TPC-H: <b>Total hot run time: 41566 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b778827c91e6051a9b5f454297cbea1526a11084, data reload: false
------ Round 1 ----------------------------------
q1 17622 4299 4330 4299
q2 2025 185 187 185
q3 10479 1234 1153 1153
q4 10220 770 872 770
q5 7484 2692 2702 2692
q6 226 135 137 135
q7 966 612 603 603
q8 9240 2170 2101 2101
q9 9024 6737 6734 6734
q10 9553 3910 3859 3859
q11 429 235 251 235
q12 554 233 219 219
q13 17421 3269 3107 3107
q14 257 216 226 216
q15 519 471 461 461
q16 476 390 387 387
q17 954 578 609 578
q18 8428 7826 7788 7788
q19 7607 1347 1359 1347
q20 633 326 314 314
q21 5213 4049 4068 4049
q22 388 336 334 334
Total cold run time: 119718 ms
Total hot run time: 41566 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4631 4421 4395 4395
q2 383 274 271 271
q3 3161 3052 2722 2722
q4 1912 1614 1692 1614
q5 5482 5506 5659 5506
q6 224 129 125 125
q7 2192 1812 1853 1812
q8 3195 3337 3351 3337
q9 8591 8689 8730 8689
q10 4033 3686 3652 3652
q11 583 497 497 497
q12 799 639 630 630
q13 16018 3097 3177 3097
q14 295 266 280 266
q15 504 495 478 478
q16 487 425 435 425
q17 1811 1509 1487 1487
q18 7978 7310 7433 7310
q19 1692 1617 1576 1576
q20 2091 1773 1787 1773
q21 4919 4826 4736 4736
q22 612 520 537 520
Total cold run time: 71593 ms
Total hot run time: 54918 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](fe) avoid setting the value of batch_size excessively high [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35941:
URL: https://github.com/apache/doris/pull/35941#issuecomment-2150481544
<details>
<summary>ClickBench: <b>Total hot run time: 30.16 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b778827c91e6051a9b5f454297cbea1526a11084, data reload: false
query1 0.04 0.03 0.03
query2 0.08 0.03 0.04
query3 0.23 0.05 0.06
query4 1.66 0.08 0.07
query5 0.50 0.48 0.49
query6 1.12 0.73 0.72
query7 0.02 0.01 0.01
query8 0.05 0.04 0.04
query9 0.53 0.49 0.48
query10 0.55 0.54 0.54
query11 0.16 0.11 0.10
query12 0.15 0.12 0.11
query13 0.59 0.59 0.61
query14 0.77 0.76 0.79
query15 0.83 0.81 0.81
query16 0.36 0.37 0.36
query17 0.95 0.96 0.96
query18 0.22 0.26 0.21
query19 1.82 1.69 1.65
query20 0.01 0.02 0.01
query21 15.62 0.65 0.64
query22 3.89 7.78 1.86
query23 18.34 1.39 1.22
query24 2.14 0.22 0.20
query25 0.16 0.08 0.08
query26 0.26 0.17 0.17
query27 0.08 0.08 0.08
query28 13.23 1.02 0.99
query29 13.50 3.31 3.26
query30 0.24 0.05 0.06
query31 2.89 0.38 0.38
query32 3.28 0.47 0.46
query33 2.91 2.91 2.91
query34 17.18 4.41 4.40
query35 4.48 4.46 4.62
query36 0.66 0.45 0.46
query37 0.17 0.14 0.15
query38 0.14 0.12 0.14
query39 0.05 0.03 0.03
query40 0.16 0.14 0.16
query41 0.09 0.04 0.04
query42 0.06 0.05 0.04
query43 0.03 0.03 0.04
Total cold run time: 110.2 s
Total hot run time: 30.16 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org