You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "ByteYue (via GitHub)" <gi...@apache.org> on 2024/03/28 11:28:41 UTC
[PR] [bugfx](Cloud) Add refresh hdfs vault logic && check whether latest fs is nullptr [doris]
ByteYue opened a new pull request, #32981:
URL: https://github.com/apache/doris/pull/32981
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfx](Cloud) Add refresh hdfs vault logic && check whether latest fs is nullptr [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32981:
URL: https://github.com/apache/doris/pull/32981#issuecomment-2024973766
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfx](Cloud) Add refresh hdfs vault logic && check whether latest fs is nullptr [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #32981:
URL: https://github.com/apache/doris/pull/32981
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfx](Cloud) Add refresh hdfs vault logic && check whether latest fs is nullptr [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32981:
URL: https://github.com/apache/doris/pull/32981#issuecomment-2025261704
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfx](Cloud) Add refresh hdfs vault logic && check whether latest fs is nullptr [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32981:
URL: https://github.com/apache/doris/pull/32981#issuecomment-2025009575
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfx](Cloud) Add refresh hdfs vault logic && check whether latest fs is nullptr [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32981:
URL: https://github.com/apache/doris/pull/32981#issuecomment-2025040094
<details>
<summary>TPC-H: <b>Total hot run time: 37676 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 58c337da579ef9a95a4e5e7597585f7b6b84cd4e, data reload: false
------ Round 1 ----------------------------------
q1 17608 4221 4112 4112
q2 2106 159 151 151
q3 11221 1212 1238 1212
q4 10589 742 774 742
q5 7710 3003 2934 2934
q6 206 128 128 128
q7 988 528 509 509
q8 9646 2035 2035 2035
q9 7054 6449 6384 6384
q10 8475 3495 3545 3495
q11 435 223 220 220
q12 425 201 190 190
q13 17804 2847 2890 2847
q14 255 202 197 197
q15 508 474 449 449
q16 490 373 372 372
q17 948 557 629 557
q18 7087 6536 6396 6396
q19 1563 1441 1375 1375
q20 540 264 256 256
q21 3590 2930 2823 2823
q22 351 294 292 292
Total cold run time: 109599 ms
Total hot run time: 37676 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4049 4062 4036 4036
q2 329 236 230 230
q3 2974 2843 2840 2840
q4 1859 1564 1567 1564
q5 5228 5249 5231 5231
q6 198 116 117 116
q7 1741 1362 1343 1343
q8 3197 3318 3269 3269
q9 8436 8429 8381 8381
q10 3819 3764 3766 3764
q11 545 457 454 454
q12 730 529 569 529
q13 11999 2878 2847 2847
q14 295 240 244 240
q15 493 455 468 455
q16 461 411 417 411
q17 1735 1492 1482 1482
q18 7329 7217 7117 7117
q19 1599 1424 1557 1424
q20 1882 1723 1721 1721
q21 4612 4711 4573 4573
q22 529 438 458 438
Total cold run time: 64039 ms
Total hot run time: 52465 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfx](Cloud) Add refresh hdfs vault logic && check whether latest fs is nullptr [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32981:
URL: https://github.com/apache/doris/pull/32981#issuecomment-2025079133
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 58c337da579ef9a95a4e5e7597585f7b6b84cd4e with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 13.7 seconds inserted 10000000 Rows, about 729K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfx](Cloud) Add refresh hdfs vault logic && check whether latest fs is nullptr [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32981:
URL: https://github.com/apache/doris/pull/32981#issuecomment-2024969910
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfx](Cloud) Add refresh hdfs vault logic && check whether latest fs is nullptr [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32981:
URL: https://github.com/apache/doris/pull/32981#issuecomment-2025507023
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfx](Cloud) Add refresh hdfs vault logic && check whether latest fs is nullptr [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32981:
URL: https://github.com/apache/doris/pull/32981#issuecomment-2025122218
TeamCity be ut coverage result:
Function Coverage: 35.62% (8837/24808)
Line Coverage: 27.32% (72399/264970)
Region Coverage: 26.55% (37553/141424)
Branch Coverage: 23.36% (19152/81992)
Coverage Report: http://coverage.selectdb-in.cc/coverage/58c337da579ef9a95a4e5e7597585f7b6b84cd4e_58c337da579ef9a95a4e5e7597585f7b6b84cd4e/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfx](Cloud) Add refresh hdfs vault logic && check whether latest fs is nullptr [doris]
Posted by "ByteYue (via GitHub)" <gi...@apache.org>.
ByteYue commented on PR #32981:
URL: https://github.com/apache/doris/pull/32981#issuecomment-2024967679
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfx](Cloud) Add refresh hdfs vault logic && check whether latest fs is nullptr [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32981:
URL: https://github.com/apache/doris/pull/32981#issuecomment-2024960741
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfx](Cloud) Add refresh hdfs vault logic && check whether latest fs is nullptr [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32981:
URL: https://github.com/apache/doris/pull/32981#issuecomment-2025065448
<details>
<summary>TPC-DS: <b>Total hot run time: 181123 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 58c337da579ef9a95a4e5e7597585f7b6b84cd4e, data reload: false
query1 945 365 358 358
query2 6528 2122 1934 1934
query3 6703 218 215 215
query4 31961 21386 21283 21283
query5 4314 395 385 385
query6 267 173 172 172
query7 4640 290 294 290
query8 235 179 183 179
query9 9264 2335 2303 2303
query10 546 252 254 252
query11 14855 14208 14271 14208
query12 135 95 94 94
query13 1633 421 431 421
query14 9697 7927 7439 7439
query15 243 178 185 178
query16 8170 261 258 258
query17 1947 579 554 554
query18 2106 300 290 290
query19 276 160 159 159
query20 91 88 87 87
query21 202 126 124 124
query22 4980 4804 4789 4789
query23 33799 32606 32905 32606
query24 12181 2863 2871 2863
query25 655 383 391 383
query26 1797 156 168 156
query27 3079 318 324 318
query28 7762 1882 1908 1882
query29 1048 641 613 613
query30 307 149 152 149
query31 995 734 726 726
query32 96 55 62 55
query33 761 260 266 260
query34 1103 480 480 480
query35 912 701 690 690
query36 1003 903 913 903
query37 270 65 63 63
query38 3590 3447 3422 3422
query39 1582 1549 1539 1539
query40 294 109 108 108
query41 49 48 53 48
query42 105 94 97 94
query43 480 449 461 449
query44 1249 760 725 725
query45 290 247 263 247
query46 1117 693 690 690
query47 1933 1825 1847 1825
query48 441 369 362 362
query49 1238 342 342 342
query50 768 374 369 369
query51 6759 6592 6654 6592
query52 99 97 96 96
query53 350 274 278 274
query54 325 244 236 236
query55 84 80 76 76
query56 251 230 242 230
query57 1195 1135 1120 1120
query58 232 208 210 208
query59 2804 2616 2648 2616
query60 268 237 255 237
query61 115 114 117 114
query62 665 444 435 435
query63 309 275 277 275
query64 6391 4021 4024 4021
query65 3100 3040 3023 3023
query66 1411 376 357 357
query67 15385 14804 14845 14804
query68 9245 533 539 533
query69 683 382 389 382
query70 1319 1176 1119 1119
query71 526 262 268 262
query72 6816 2534 2339 2339
query73 1657 329 314 314
query74 6760 6423 6288 6288
query75 3843 2216 2208 2208
query76 5751 909 906 906
query77 642 264 256 256
query78 10774 10213 10132 10132
query79 10042 537 529 529
query80 1502 381 371 371
query81 480 222 216 216
query82 230 84 87 84
query83 218 148 146 146
query84 292 79 86 79
query85 1057 313 299 299
query86 346 296 309 296
query87 3740 3546 3510 3510
query88 4796 2340 2320 2320
query89 485 385 362 362
query90 2042 178 180 178
query91 171 137 140 137
query92 59 48 47 47
query93 5961 500 490 490
query94 1320 176 174 174
query95 401 309 309 309
query96 619 277 270 270
query97 2650 2493 2501 2493
query98 223 209 205 205
query99 1030 833 816 816
Total cold run time: 314065 ms
Total hot run time: 181123 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [bugfx](Cloud) Add refresh hdfs vault logic && check whether latest fs is nullptr [doris]
Posted by "ByteYue (via GitHub)" <gi...@apache.org>.
ByteYue commented on PR #32981:
URL: https://github.com/apache/doris/pull/32981#issuecomment-2025001385
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org