You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "w41ter (via GitHub)" <gi...@apache.org> on 2024/01/22 06:45:25 UTC
[PR] [feature](merge-cloud) Add warn log filenum quota flags for glog 0.6.0 [doris]
w41ter opened a new pull request, #30213:
URL: https://github.com/apache/doris/pull/30213
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add warn log filenum quota flags for glog 0.6.0 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30213:
URL: https://github.com/apache/doris/pull/30213#issuecomment-1903383035
<details>
<summary>TPC-H: <b>Total hot run time: 39158 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4da1a5104ba55f68d53fa92698591e9fc69ec5fe, data reload: false
------ Round 1 ----------------------------------
q1 17589 5263 5276 5263
q2 2049 144 139 139
q3 10636 1171 1188 1171
q4 10256 780 847 780
q5 7752 3238 3172 3172
q6 199 123 124 123
q7 848 505 485 485
q8 9227 1898 1971 1898
q9 7304 6382 6384 6382
q10 8233 3106 3024 3024
q11 409 215 212 212
q12 356 190 191 190
q13 17999 3386 3390 3386
q14 243 216 217 216
q15 544 505 506 505
q16 430 392 380 380
q17 946 559 520 520
q18 7558 6976 6924 6924
q19 1559 1409 1342 1342
q20 583 312 287 287
q21 2840 2475 2454 2454
q22 373 305 305 305
Total cold run time: 107933 ms
Total hot run time: 39158 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5641 5275 5178 5178
q2 331 219 217 217
q3 3267 3253 3282 3253
q4 2071 2064 2084 2064
q5 6099 5958 5969 5958
q6 201 117 125 117
q7 2324 1838 1972 1838
q8 3232 3387 3406 3387
q9 8923 8777 8991 8777
q10 3916 3879 3837 3837
q11 555 469 455 455
q12 820 606 670 606
q13 16924 3174 3185 3174
q14 305 256 265 256
q15 562 500 503 500
q16 520 477 469 469
q17 2392 1821 1823 1821
q18 9456 11643 9606 9606
q19 19408 1565 1551 1551
q20 4602 1952 1919 1919
q21 15360 5386 5369 5369
q22 2371 540 569 540
Total cold run time: 109280 ms
Total hot run time: 60892 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add warn log filenum quota flags for glog 0.6.0 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30213:
URL: https://github.com/apache/doris/pull/30213#issuecomment-1903389877
TeamCity be ut coverage result:
Function Coverage: 36.78% (8676/23587)
Line Coverage: 28.80% (70817/245853)
Region Coverage: 27.69% (36532/131928)
Branch Coverage: 24.42% (18705/76590)
Coverage Report: http://coverage.selectdb-in.cc/coverage/4da1a5104ba55f68d53fa92698591e9fc69ec5fe_4da1a5104ba55f68d53fa92698591e9fc69ec5fe/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add warn log filenum quota flags for glog 0.6.0 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30213:
URL: https://github.com/apache/doris/pull/30213#issuecomment-1903400896
<details>
<summary>ClickBench: <b>Total hot run time: 30.54 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4da1a5104ba55f68d53fa92698591e9fc69ec5fe, data reload: false
query1 0.04 0.03 0.03
query2 0.06 0.02 0.02
query3 0.22 0.04 0.05
query4 1.70 0.07 0.07
query5 0.54 0.52 0.52
query6 1.28 0.64 0.64
query7 0.02 0.01 0.01
query8 0.04 0.03 0.03
query9 0.55 0.49 0.49
query10 0.57 0.55 0.56
query11 0.12 0.10 0.09
query12 0.11 0.10 0.10
query13 0.60 0.62 0.61
query14 0.80 0.82 0.80
query15 0.78 0.78 0.77
query16 0.36 0.37 0.39
query17 1.01 1.01 1.03
query18 0.24 0.23 0.25
query19 1.90 1.77 1.74
query20 0.02 0.01 0.01
query21 15.43 0.57 0.57
query22 2.51 3.36 1.60
query23 17.49 0.78 0.81
query24 2.24 1.01 0.90
query25 0.46 0.32 0.12
query26 0.35 0.15 0.14
query27 0.06 0.05 0.06
query28 11.99 0.79 0.76
query29 12.49 3.25 3.12
query30 0.56 0.49 0.49
query31 2.78 0.36 0.35
query32 3.37 0.47 0.50
query33 3.20 3.26 3.23
query34 15.78 4.32 4.25
query35 4.32 4.36 4.27
query36 1.11 1.07 1.07
query37 0.06 0.05 0.05
query38 0.04 0.03 0.03
query39 0.02 0.01 0.02
query40 0.15 0.12 0.12
query41 0.07 0.02 0.01
query42 0.02 0.01 0.01
query43 0.02 0.01 0.02
Total cold run time: 105.48 s
Total hot run time: 30.54 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add warn log filenum quota flags for glog 0.6.0 [doris]
Posted by "w41ter (via GitHub)" <gi...@apache.org>.
w41ter commented on PR #30213:
URL: https://github.com/apache/doris/pull/30213#issuecomment-1903360191
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add warn log filenum quota flags for glog 0.6.0 [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30213:
URL: https://github.com/apache/doris/pull/30213#issuecomment-1903540945
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add warn log filenum quota flags for glog 0.6.0 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30213:
URL: https://github.com/apache/doris/pull/30213#issuecomment-1903395039
<details>
<summary>TPC-DS: <b>Total hot run time: 175705 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4da1a5104ba55f68d53fa92698591e9fc69ec5fe, data reload: false
query1 925 330 326 326
query2 6562 1852 1765 1765
query3 6703 200 204 200
query4 32810 22353 22119 22119
query5 4464 442 349 349
query6 243 173 157 157
query7 4601 269 259 259
query8 222 183 176 176
query9 8409 2520 2506 2506
query10 427 223 220 220
query11 16615 15632 15516 15516
query12 125 68 68 68
query13 1683 378 377 377
query14 10597 6942 6875 6875
query15 207 179 180 179
query16 5780 256 251 251
query17 947 470 468 468
query18 1787 260 252 252
query19 176 130 132 130
query20 73 71 71 71
query21 188 132 125 125
query22 4846 4725 4627 4627
query23 31583 31164 30815 30815
query24 12483 2814 2808 2808
query25 579 319 314 314
query26 1815 149 146 146
query27 3211 286 284 284
query28 7103 1828 1824 1824
query29 2062 625 629 625
query30 288 136 138 136
query31 928 741 759 741
query32 74 49 48 48
query33 706 219 217 217
query34 1160 467 461 461
query35 864 761 764 761
query36 1327 1200 1186 1186
query37 89 57 57 57
query38 3313 3247 3204 3204
query39 1321 1268 1257 1257
query40 342 86 87 86
query41 38 36 35 35
query42 88 81 85 81
query43 497 472 459 459
query44 1080 685 688 685
query45 190 180 183 180
query46 1069 666 652 652
query47 1604 1557 1494 1494
query48 399 308 309 308
query49 1209 293 287 287
query50 683 302 323 302
query51 5351 5172 5220 5172
query52 97 76 76 76
query53 314 251 254 251
query54 248 183 179 179
query55 89 75 76 75
query56 182 169 167 167
query57 1045 933 941 933
query58 192 169 168 168
query59 2977 2649 2730 2649
query60 212 188 180 180
query61 88 82 83 82
query62 617 344 333 333
query63 281 247 264 247
query64 6125 1750 1785 1750
query65 3318 3265 3238 3238
query66 1393 327 314 314
query67 15874 15295 14865 14865
query68 12414 538 511 511
query69 607 297 292 292
query70 1692 1408 1435 1408
query71 552 228 207 207
query72 4846 2819 2842 2819
query73 2669 320 320 320
query74 6878 6325 6390 6325
query75 4995 2361 2343 2343
query76 6659 1035 981 981
query77 654 238 254 238
query78 9555 8846 8654 8654
query79 987 514 500 500
query80 532 319 317 317
query81 445 209 203 203
query82 200 80 76 76
query83 145 122 116 116
query84 269 68 69 68
query85 1059 347 329 329
query86 385 386 372 372
query87 3464 3376 3273 3273
query88 3118 2177 2177 2177
query89 424 358 349 349
query90 1973 187 184 184
query91 158 123 123 123
query92 53 44 43 43
query93 1328 452 420 420
query94 1225 162 155 155
query95 506 449 445 445
query96 627 328 323 323
query97 4260 4114 4137 4114
query98 217 181 180 180
query99 1089 692 728 692
Total cold run time: 296883 ms
Total hot run time: 175705 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add warn log filenum quota flags for glog 0.6.0 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30213:
URL: https://github.com/apache/doris/pull/30213#issuecomment-1903404417
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 4da1a5104ba55f68d53fa92698591e9fc69ec5fe with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 14.3 seconds inserted 10000000 Rows, about 699K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add warn log filenum quota flags for glog 0.6.0 [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30213:
URL: https://github.com/apache/doris/pull/30213#issuecomment-1903369186
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add warn log filenum quota flags for glog 0.6.0 [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30213:
URL: https://github.com/apache/doris/pull/30213#issuecomment-1903541017
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](merge-cloud) Add warn log filenum quota flags for glog 0.6.0 [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #30213:
URL: https://github.com/apache/doris/pull/30213
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org