You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "uchenily (via GitHub)" <gi...@apache.org> on 2025/11/26 10:57:01 UTC
[PR] [chore](load) Not log unnecessary stack information [doris]
uchenily opened a new pull request, #58420:
URL: https://github.com/apache/doris/pull/58420
### What problem does this PR solve?
`stream_load_recorder_manager_last_fetch_key` key not found is not a fatal issue here, no need to log the following stack information
```
W20251126 17:32:35.140445 2054603 status.h:439] meet error status: [NOT_FOUND]Key not found: stream_load_recorder_manager_last_fetch_key
0# doris::StreamLoadRecorder::get(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*, bool) at /data11/chen/doris-la
test/be/src/common/status.h:494
1# doris::StreamLoadRecorderManager::_load_last_fetch_key() at /opt/ldb_toolchain/bin/../lib/gcc/x86_64-pc-linux-gnu/15/include/g++-v15/bits/basic_string.h:239
2# doris::StreamLoadRecorderManager::start() at /opt/ldb_toolchain/bin/../lib/gcc/x86_64-pc-linux-gnu/15/include/g++-v15/bits/std_thread.h:103
3# doris::ExecEnv::_init(std::vector<doris::StorePath, std::allocator<doris::StorePath> > const&, std::vector<doris::StorePath, std::allocator<doris::StorePath> > const&, std::set<std::__cxx11::basic_string<char, std::char_traits<char
>, std::allocator<char> >, std::less<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&) at /data11/chen/
doris-latest/be/src/runtime/exec_env_init.cpp:406
4# doris::ExecEnv::init(doris::ExecEnv*, std::vector<doris::StorePath, std::allocator<doris::StorePath> > const&, std::vector<doris::StorePath, std::allocator<doris::StorePath> > const&, std::set<std::__cxx11::basic_string<char, std::
char_traits<char>, std::allocator<char> >, std::less<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&) at /data11/chen/doris-latest/be/src/runtime/exec_env_init.cpp:188
5# main at /data11/chen/doris-latest/be/src/service/doris_main.cpp:0
6# __libc_start_main
7# _start
I20251126 17:32:35.140537 2054603 stream_load_recorder_manager.cpp:75] No stream load recorder manager last fetch key found in RocksDB, starting from beginning
```
Issue Number: close #xxx
Related PR: #xxx
Problem Summary:
### Release note
None
### Check List (For Author)
- Test <!-- At least one of them must be included. -->
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason <!-- Add your reason? -->
- Behavior changed:
- [ ] No.
- [ ] Yes. <!-- Explain the behavior change -->
- Does this need documentation?
- [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg: https://github.com/apache/doris-website/pull/1214 -->
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR should merge into -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](load) Not log unnecessary stack information [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #58420:
URL: https://github.com/apache/doris/pull/58420#issuecomment-3588347695
# BE Regression && UT Coverage Report
Increment line coverage `100.00% (1/1)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/58420_cc08aba11a073473f158b8af1f841e59d6350fc9_merge/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/58420_cc08aba11a073473f158b8af1f841e59d6350fc9_merge/report/index.html)
| Category | Coverage |
|-------------------|--------------------|
| Function Coverage | 71.38% (24429/34225) |
| Line Coverage | 57.80% (253896/439277) |
| Region Coverage | 52.89% (211392/399709) |
| Branch Coverage | 54.40% (90335/166054) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](load) Not log unnecessary stack information [doris]
Posted by "uchenily (via GitHub)" <gi...@apache.org>.
uchenily commented on PR #58420:
URL: https://github.com/apache/doris/pull/58420#issuecomment-3583769543
run p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](load) Not log unnecessary stack information [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #58420:
URL: https://github.com/apache/doris/pull/58420#issuecomment-3588332942
# BE UT Coverage Report
Increment line coverage `0.00% (0/1)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/cc08aba11a073473f158b8af1f841e59d6350fc9_cc08aba11a073473f158b8af1f841e59d6350fc9/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/cc08aba11a073473f158b8af1f841e59d6350fc9_cc08aba11a073473f158b8af1f841e59d6350fc9/report/index.html)
| Category | Coverage |
|-------------------|--------------------|
| Function Coverage | 52.89% (18503/34987) |
| Line Coverage | 38.42% (169488/441096) |
| Region Coverage | 33.27% (131723/395967) |
| Branch Coverage | 34.19% (56678/165779) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](load) Not log unnecessary stack information [doris]
Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb merged PR #58420:
URL: https://github.com/apache/doris/pull/58420
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](load) Not log unnecessary stack information [doris]
Posted by "uchenily (via GitHub)" <gi...@apache.org>.
uchenily commented on PR #58420:
URL: https://github.com/apache/doris/pull/58420#issuecomment-3580770557
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](load) Not log unnecessary stack information [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #58420:
URL: https://github.com/apache/doris/pull/58420#issuecomment-3588233695
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](load) Not log unnecessary stack information [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #58420:
URL: https://github.com/apache/doris/pull/58420#issuecomment-3581163816
<details>
<summary>TPC-DS: <b>Total hot run time: 184063 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cc08aba11a073473f158b8af1f841e59d6350fc9, data reload: false
query1 1049 401 397 397
query2 6578 1587 1582 1582
query3 6753 233 221 221
query4 26504 22947 22479 22479
query5 4428 614 476 476
query6 346 250 236 236
query7 4653 491 306 306
query8 319 294 261 261
query9 8717 2582 2558 2558
query10 525 364 314 314
query11 15504 14784 14484 14484
query12 170 118 116 116
query13 1700 612 452 452
query14 10682 8930 8949 8930
query15 215 200 183 183
query16 7278 689 529 529
query17 1270 794 673 673
query18 2010 434 356 356
query19 214 215 187 187
query20 135 143 129 129
query21 232 154 117 117
query22 3980 4199 3849 3849
query23 33087 32182 32175 32175
query24 8441 2419 2428 2419
query25 651 552 484 484
query26 1233 282 165 165
query27 2730 499 350 350
query28 4370 2149 2137 2137
query29 856 652 509 509
query30 317 245 215 215
query31 890 705 631 631
query32 82 73 71 71
query33 602 381 354 354
query34 858 865 536 536
query35 833 843 738 738
query36 936 934 866 866
query37 125 117 86 86
query38 3417 3313 3249 3249
query39 1641 1407 1429 1407
query40 235 139 128 128
query41 65 62 61 61
query42 120 113 113 113
query43 479 460 437 437
query44 1304 764 798 764
query45 202 191 181 181
query46 899 1083 645 645
query47 1827 1695 1644 1644
query48 400 428 357 357
query49 771 490 413 413
query50 654 688 404 404
query51 3859 3925 3959 3925
query52 108 109 101 101
query53 244 262 194 194
query54 319 288 283 283
query55 100 98 98 98
query56 398 311 315 311
query57 1172 1147 1076 1076
query58 298 281 275 275
query59 2317 2513 2384 2384
query60 340 341 346 341
query61 161 156 155 155
query62 797 732 668 668
query63 232 192 190 190
query64 4542 1214 901 901
query65 4083 3957 3983 3957
query66 1187 448 324 324
query67 14806 14881 15124 14881
query68 8312 968 633 633
query69 520 338 302 302
query70 1269 1238 1289 1238
query71 491 333 331 331
query72 6090 4881 4782 4782
query73 676 577 351 351
query74 8527 8806 8275 8275
query75 3944 3335 2796 2796
query76 3699 1118 722 722
query77 811 412 309 309
query78 9610 9664 8852 8852
query79 2597 831 608 608
query80 681 577 498 498
query81 518 266 236 236
query82 470 161 132 132
query83 278 268 260 260
query84 267 122 99 99
query85 943 503 447 447
query86 396 293 282 282
query87 3486 3544 3441 3441
query88 4011 2248 2255 2248
query89 388 325 295 295
query90 1898 233 226 226
query91 181 176 142 142
query92 80 69 68 68
query93 2177 1002 668 668
query94 729 447 331 331
query95 507 398 393 393
query96 507 579 293 293
query97 2924 2966 2900 2900
query98 247 211 208 208
query99 1297 1388 1259 1259
Total cold run time: 274781 ms
Total hot run time: 184063 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](load) Not log unnecessary stack information [doris]
Posted by "Thearas (via GitHub)" <gi...@apache.org>.
Thearas commented on PR #58420:
URL: https://github.com/apache/doris/pull/58420#issuecomment-3580770476
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
Please clearly describe your PR:
1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](load) Not log unnecessary stack information [doris]
Posted by "uchenily (via GitHub)" <gi...@apache.org>.
uchenily commented on PR #58420:
URL: https://github.com/apache/doris/pull/58420#issuecomment-3583768800
run beut
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](load) Not log unnecessary stack information [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #58420:
URL: https://github.com/apache/doris/pull/58420#issuecomment-3588253342
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](load) Not log unnecessary stack information [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #58420:
URL: https://github.com/apache/doris/pull/58420#issuecomment-3581115336
<details>
<summary>TPC-H: <b>Total hot run time: 34424 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cc08aba11a073473f158b8af1f841e59d6350fc9, data reload: false
------ Round 1 ----------------------------------
q1 17587 5051 4951 4951
q2 2040 325 206 206
q3 10261 1317 733 733
q4 10214 825 377 377
q5 7495 2399 2351 2351
q6 189 169 137 137
q7 937 789 639 639
q8 9363 1340 1179 1179
q9 7325 5374 5330 5330
q10 6904 2248 1839 1839
q11 484 303 290 290
q12 390 362 220 220
q13 17784 3671 3062 3062
q14 230 236 207 207
q15 587 509 514 509
q16 1052 1003 962 962
q17 599 877 360 360
q18 7922 7104 7070 7070
q19 1099 942 542 542
q20 351 352 227 227
q21 3768 3233 2276 2276
q22 1019 1007 957 957
Total cold run time: 107600 ms
Total hot run time: 34424 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4925 4955 4930 4930
q2 324 426 309 309
q3 2117 2687 2282 2282
q4 1416 1795 1328 1328
q5 4227 4563 4553 4553
q6 213 172 131 131
q7 2114 1920 1879 1879
q8 2681 2745 2609 2609
q9 7469 7548 7618 7548
q10 3051 3280 2834 2834
q11 590 515 507 507
q12 693 782 624 624
q13 3541 4008 3395 3395
q14 273 306 295 295
q15 587 510 494 494
q16 1100 1123 1092 1092
q17 1194 1529 1417 1417
q18 7901 7636 7822 7636
q19 797 758 854 758
q20 1934 1953 1801 1801
q21 4742 4338 4327 4327
q22 1099 1068 1015 1015
Total cold run time: 52988 ms
Total hot run time: 51764 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](load) Not log unnecessary stack information [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #58420:
URL: https://github.com/apache/doris/pull/58420#issuecomment-3581182241
<details>
<summary>ClickBench: <b>Total hot run time: 27.27 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cc08aba11a073473f158b8af1f841e59d6350fc9, data reload: false
query1 0.05 0.05 0.05
query2 0.09 0.04 0.05
query3 0.25 0.09 0.08
query4 1.60 0.11 0.11
query5 0.28 0.25 0.25
query6 1.16 0.66 0.65
query7 0.03 0.02 0.02
query8 0.05 0.04 0.04
query9 0.59 0.53 0.51
query10 0.58 0.57 0.57
query11 0.17 0.11 0.11
query12 0.15 0.12 0.11
query13 0.62 0.62 0.60
query14 1.00 0.99 0.99
query15 0.84 0.83 0.84
query16 0.39 0.40 0.38
query17 0.99 1.00 1.01
query18 0.21 0.23 0.19
query19 1.88 1.80 1.84
query20 0.01 0.02 0.01
query21 15.44 0.17 0.12
query22 5.12 0.07 0.05
query23 15.66 0.25 0.10
query24 2.59 1.53 0.31
query25 0.07 0.06 0.06
query26 0.14 0.13 0.13
query27 0.08 0.06 0.06
query28 4.22 1.13 0.94
query29 12.58 3.93 3.20
query30 0.27 0.12 0.11
query31 2.82 0.59 0.38
query32 3.23 0.54 0.47
query33 3.00 3.11 3.20
query34 15.91 5.17 4.50
query35 4.55 4.54 4.63
query36 0.68 0.51 0.49
query37 0.10 0.06 0.06
query38 0.06 0.04 0.04
query39 0.04 0.03 0.03
query40 0.17 0.15 0.14
query41 0.08 0.04 0.03
query42 0.04 0.03 0.03
query43 0.05 0.04 0.03
Total cold run time: 97.84 s
Total hot run time: 27.27 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](load) Not log unnecessary stack information [doris]
Posted by "uchenily (via GitHub)" <gi...@apache.org>.
uchenily commented on PR #58420:
URL: https://github.com/apache/doris/pull/58420#issuecomment-3588137815
run beut
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org