You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "wangbo (via GitHub)" <gi...@apache.org> on 2024/01/11 06:01:16 UTC
[PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
wangbo opened a new pull request, #29843:
URL: https://github.com/apache/doris/pull/29843
## Proposed changes
Runtime report query statistics not support BE version > FE version.
```
terminate called after throwing an instance of 'apache::thrift::TApplicationException'
what(): Internal error processing reportExecStatus
*** Query id: 0-0 ***
*** tablet id: 0 ***
*** Aborted at 1704951346 (unix time) try "date -d @1704951346" if you are using GNU date ***
*** Current BE git commitID: ffe215b968 ***
*** SIGABRT unknown detail explain (@0x46e0020cad3) received by PID 2149075 (TID 2152771 OR 0x7f9d3e994700) from PID 2149075; stack trace: ***
0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /mnt/disk2/wangbo/git/res-iso/be/src/common/signal_handler.h:417
1# 0x00007FA489AC9400 in /lib64/libc.so.6
2# __GI_raise in /lib64/libc.so.6
3# __GI_abort in /lib64/libc.so.6
4# __gnu_cxx::__verbose_terminate_handler() [clone .cold] at ../../../../libstdc++-v3/libsupc++/vterminate.cc:75
5# __cxxabiv1::__terminate(void (*)()) at ../../../../libstdc++-v3/libsupc++/eh_terminate.cc:48
6# 0x000055CC3BD10D81 in /mnt/disk2/wangbo/runtime/master/be/lib/doris_be
7# 0x000055CC3BD10ED4 in /mnt/disk2/wangbo/runtime/master/be/lib/doris_be
8# doris::FrontendServiceClient::recv_reportExecStatus(doris::TReportExecStatusResult&) in /mnt/disk2/wangbo/runtime/master/be/lib/doris_be
9# doris::RuntimeQueryStatiticsMgr::report_runtime_query_statistics() at /mnt/disk2/wangbo/git/res-iso/be/src/runtime/runtime_query_statistics_mgr.cpp:89
10# doris::Daemon::report_runtime_query_statistics_thread() at /mnt/disk2/wangbo/git/res-iso/be/src/common/daemon.cpp:360
11# doris::Thread::supervise_thread(void*) at /mnt/disk2/wangbo/git/res-iso/be/src/util/thread.cpp:499
12# start_thread in /lib64/libpthread.so.0
13# __GI___clone in /lib64/libc.so.6
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886763859
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 376505c9fb1da8ba66950b381c38addbc9a9a5c9 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 12.3 seconds inserted 10000000 Rows, about 813K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1887063324
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886379061
<details>
<summary>TPC-H: <b>Total hot run time: 39093 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 844140a8e70484dfdc9db080fd468b9c7aae280f, data reload: false
------ Round 1 ----------------------------------
q1 17879 5009 5003 5003
q2 2038 147 142 142
q3 10692 1143 1239 1143
q4 10813 822 817 817
q5 7990 3216 3277 3216
q6 203 129 127 127
q7 896 545 523 523
q8 9409 2274 2041 2041
q9 7663 6657 6629 6629
q10 8769 3126 3069 3069
q11 421 208 213 208
q12 368 189 192 189
q13 18100 3416 3409 3409
q14 242 215 213 213
q15 578 512 509 509
q16 438 380 382 380
q17 952 555 509 509
q18 7525 6749 6711 6711
q19 1594 1377 1301 1301
q20 513 291 328 291
q21 2775 2361 2416 2361
q22 353 315 302 302
Total cold run time: 110211 ms
Total hot run time: 39093 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5025 4967 4941 4941
q2 314 199 201 199
q3 3338 3311 3306 3306
q4 2256 2244 2249 2244
q5 5821 5823 5822 5822
q6 193 118 119 118
q7 2311 1878 1846 1846
q8 3448 3566 3603 3566
q9 8934 8908 8843 8843
q10 3750 3873 3815 3815
q11 550 419 420 419
q12 802 623 607 607
q13 3913 3219 3248 3219
q14 285 260 275 260
q15 554 521 515 515
q16 522 457 459 457
q17 2047 2019 2008 2008
q18 8765 8401 8291 8291
q19 1610 1613 1601 1601
q20 2161 1930 1928 1928
q21 6108 5664 5700 5664
q22 551 493 473 473
Total cold run time: 63258 ms
Total hot run time: 60142 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886758958
<details>
<summary>ClickBench: <b>Total hot run time: 30.59 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 376505c9fb1da8ba66950b381c38addbc9a9a5c9, data reload: false
query1 0.06 0.06 0.05
query2 0.05 0.03 0.02
query3 0.25 0.10 0.10
query4 1.78 0.12 0.11
query5 0.52 0.52 0.52
query6 1.42 0.63 0.62
query7 0.01 0.01 0.01
query8 0.05 0.03 0.03
query9 0.55 0.50 0.50
query10 0.54 0.54 0.56
query11 0.13 0.09 0.09
query12 0.12 0.10 0.09
query13 0.61 0.60 0.60
query14 0.77 0.78 0.80
query15 0.81 0.82 0.81
query16 0.34 0.36 0.35
query17 0.96 0.98 1.01
query18 0.27 0.24 0.23
query19 1.83 1.74 1.71
query20 0.01 0.01 0.01
query21 15.40 0.56 0.55
query22 2.38 2.32 1.99
query23 17.20 0.90 0.77
query24 16.06 0.60 0.58
query25 2.16 0.16 0.15
query26 0.14 0.13 0.13
query27 0.14 0.14 0.15
query28 6.04 0.81 0.82
query29 12.54 3.22 3.18
query30 0.54 0.47 0.49
query31 2.78 0.35 0.36
query32 3.38 0.48 0.49
query33 3.23 3.22 3.20
query34 15.85 4.20 4.18
query35 4.16 4.20 4.14
query36 1.12 1.05 1.05
query37 0.07 0.05 0.06
query38 0.04 0.02 0.02
query39 0.02 0.02 0.02
query40 0.18 0.13 0.13
query41 0.07 0.02 0.02
query42 0.02 0.01 0.02
query43 0.02 0.02 0.02
Total cold run time: 114.62 s
Total hot run time: 30.59 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886425346
TeamCity be ut coverage result:
Function Coverage: 36.72% (8650/23558)
Line Coverage: 28.75% (70465/245129)
Region Coverage: 27.67% (36408/131589)
Branch Coverage: 24.37% (18628/76424)
Coverage Report: http://coverage.selectdb-in.cc/coverage/844140a8e70484dfdc9db080fd468b9c7aae280f_844140a8e70484dfdc9db080fd468b9c7aae280f/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886749442
<details>
<summary>TPC-DS: <b>Total hot run time: 179621 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 376505c9fb1da8ba66950b381c38addbc9a9a5c9, data reload: false
query1 923 336 334 334
query2 6793 1918 1896 1896
query3 6707 210 201 201
query4 26039 22209 22279 22209
query5 5573 481 483 481
query6 268 184 179 179
query7 4611 282 275 275
query8 238 198 192 192
query9 9158 2706 2849 2706
query10 454 246 241 241
query11 16141 15235 15378 15235
query12 137 79 72 72
query13 1697 396 382 382
query14 11821 7181 7176 7176
query15 272 193 197 193
query16 6456 245 239 239
query17 1945 487 470 470
query18 1944 265 253 253
query19 279 155 143 143
query20 82 80 73 73
query21 203 134 121 121
query22 5270 5081 5104 5081
query23 31687 30742 30849 30742
query24 12393 2853 2818 2818
query25 562 327 313 313
query26 1768 152 161 152
query27 2919 274 279 274
query28 7005 1872 1880 1872
query29 2101 682 653 653
query30 293 139 141 139
query31 977 766 785 766
query32 95 68 64 64
query33 721 250 259 250
query34 1112 454 464 454
query35 880 723 730 723
query36 1427 1305 1284 1284
query37 178 70 70 70
query38 3393 3307 3298 3298
query39 1323 1269 1298 1269
query40 325 97 96 96
query41 38 35 35 35
query42 106 101 96 96
query43 532 507 544 507
query44 1077 704 707 704
query45 213 184 184 184
query46 1058 666 664 664
query47 1622 1566 1626 1566
query48 395 325 315 315
query49 1269 317 316 316
query50 725 314 314 314
query51 5302 5300 5267 5267
query52 109 89 105 89
query53 363 290 289 289
query54 2054 1602 1619 1602
query55 92 91 88 88
query56 210 200 199 199
query57 1052 974 967 967
query58 218 193 196 193
query59 2720 2548 2566 2548
query60 260 235 211 211
query61 82 86 83 83
query62 568 414 394 394
query63 292 291 294 291
query64 5820 1686 1664 1664
query65 3367 3264 3276 3264
query66 1327 333 321 321
query67 15818 15066 15236 15066
query68 12468 535 522 522
query69 663 389 386 386
query70 1698 1581 1465 1465
query71 496 253 230 230
query72 4880 2814 2825 2814
query73 2648 316 310 310
query74 7134 6419 6436 6419
query75 5100 2352 2331 2331
query76 6359 918 1127 918
query77 680 271 280 271
query78 9920 8570 8625 8570
query79 1017 509 487 487
query80 493 336 333 333
query81 420 202 203 202
query82 209 88 86 86
query83 140 125 122 122
query84 279 74 74 74
query85 776 334 319 319
query86 462 376 405 376
query87 3592 3367 3418 3367
query88 3031 2174 2157 2157
query89 460 390 397 390
query90 1790 203 197 197
query91 153 128 143 128
query92 66 55 52 52
query93 992 449 437 437
query94 1141 182 174 174
query95 521 489 469 469
query96 611 307 310 307
query97 4318 4184 4236 4184
query98 207 188 184 184
query99 1056 764 714 714
Total cold run time: 296639 ms
Total hot run time: 179621 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886572387
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886758131
TeamCity be ut coverage result:
Function Coverage: 36.72% (8650/23558)
Line Coverage: 28.74% (70459/245141)
Region Coverage: 27.67% (36407/131593)
Branch Coverage: 24.37% (18629/76428)
Coverage Report: http://coverage.selectdb-in.cc/coverage/376505c9fb1da8ba66950b381c38addbc9a9a5c9_376505c9fb1da8ba66950b381c38addbc9a9a5c9/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "wangbo (via GitHub)" <gi...@apache.org>.
wangbo commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886556869
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886351807
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886604309
TeamCity be ut coverage result:
Function Coverage: 36.71% (8649/23558)
Line Coverage: 28.75% (70474/245130)
Region Coverage: 27.67% (36415/131589)
Branch Coverage: 24.39% (18636/76424)
Coverage Report: http://coverage.selectdb-in.cc/coverage/521d6d662f8e5cfc604444f8b21fd559c1bead29_521d6d662f8e5cfc604444f8b21fd559c1bead29/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886611808
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.59 seconds
stream load tsv: 563 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 21.2 seconds inserted 10000000 Rows, about 471K ops/s
storage size: 17183532361 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1887063403
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886404148
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 844140a8e70484dfdc9db080fd468b9c7aae280f with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 13.7 seconds inserted 10000000 Rows, about 729K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "wangbo (via GitHub)" <gi...@apache.org>.
wangbo commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886343559
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886604839
<details>
<summary>TPC-H: <b>Total hot run time: 38474 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 521d6d662f8e5cfc604444f8b21fd559c1bead29, data reload: false
------ Round 1 ----------------------------------
q1 17971 5001 5030 5001
q2 2022 137 133 133
q3 10691 1092 1185 1092
q4 10246 773 828 773
q5 7768 3211 3129 3129
q6 203 125 124 124
q7 880 502 494 494
q8 9273 1906 2012 1906
q9 7334 6462 6474 6462
q10 8257 3051 3054 3051
q11 420 219 213 213
q12 352 189 191 189
q13 18099 3429 3403 3403
q14 247 215 210 210
q15 549 518 504 504
q16 423 373 379 373
q17 937 498 494 494
q18 7295 6711 6629 6629
q19 1557 1336 1405 1336
q20 558 302 305 302
q21 2794 2368 2380 2368
q22 349 304 288 288
Total cold run time: 108225 ms
Total hot run time: 38474 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4995 4934 4960 4934
q2 310 194 202 194
q3 3327 3295 3293 3293
q4 2221 2227 2228 2227
q5 5774 5767 5779 5767
q6 190 117 117 117
q7 2291 1833 1848 1833
q8 3466 3542 3581 3542
q9 8867 8863 8821 8821
q10 3756 3836 3815 3815
q11 555 432 418 418
q12 775 600 605 600
q13 6708 3232 3208 3208
q14 293 264 264 264
q15 573 516 516 516
q16 504 478 450 450
q17 2034 2015 2025 2015
q18 8766 8275 8290 8275
q19 1597 1596 1601 1596
q20 2159 1924 1916 1916
q21 5956 5542 5711 5542
q22 570 450 449 449
Total cold run time: 65687 ms
Total hot run time: 59792 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886622957
<details>
<summary>TPC-DS: <b>Total hot run time: 178599 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 521d6d662f8e5cfc604444f8b21fd559c1bead29, data reload: false
query1 952 341 340 340
query2 6700 2023 1867 1867
query3 6703 221 216 216
query4 25800 22256 22101 22101
query5 5211 521 498 498
query6 273 183 186 183
query7 4613 287 273 273
query8 240 201 202 201
query9 9170 2784 2848 2784
query10 473 241 259 241
query11 15963 15314 15258 15258
query12 126 79 78 78
query13 1630 366 342 342
query14 11936 7445 7343 7343
query15 237 196 192 192
query16 6462 299 280 280
query17 1840 501 505 501
query18 1945 277 268 268
query19 284 147 138 138
query20 85 81 77 77
query21 185 93 96 93
query22 5053 4976 4915 4915
query23 31774 30990 31017 30990
query24 12257 2839 2855 2839
query25 579 335 337 335
query26 1776 149 150 149
query27 2872 278 277 277
query28 7005 1882 1862 1862
query29 2084 392 395 392
query30 282 142 148 142
query31 1017 778 771 771
query32 97 67 57 57
query33 749 274 269 269
query34 959 444 463 444
query35 864 736 760 736
query36 1426 1318 1235 1235
query37 186 68 68 68
query38 3420 3276 3266 3266
query39 1342 1282 1296 1282
query40 317 95 94 94
query41 37 35 35 35
query42 105 94 93 93
query43 578 560 516 516
query44 1069 711 728 711
query45 209 183 190 183
query46 1053 682 676 676
query47 1655 1523 1584 1523
query48 400 303 318 303
query49 1287 324 321 321
query50 778 341 342 341
query51 5312 5253 5236 5236
query52 95 90 90 90
query53 217 149 162 149
query54 1433 580 596 580
query55 104 85 87 85
query56 222 193 198 193
query57 1028 971 931 931
query58 242 215 215 215
query59 2756 2602 2603 2602
query60 252 236 229 229
query61 83 81 81 81
query62 614 415 404 404
query63 167 169 155 155
query64 5797 1761 1681 1681
query65 3334 3277 3265 3265
query66 1358 340 331 331
query67 15508 15530 15270 15270
query68 12114 556 537 537
query69 545 282 276 276
query70 1758 1588 1610 1588
query71 502 227 226 226
query72 4830 2828 2885 2828
query73 2458 330 316 316
query74 6933 6501 6410 6410
query75 5001 2290 2287 2287
query76 6331 882 1092 882
query77 668 282 274 274
query78 9732 8730 8577 8577
query79 1032 514 508 508
query80 560 355 365 355
query81 454 221 209 209
query82 204 89 93 89
query83 168 141 141 141
query84 264 57 55 55
query85 987 283 286 283
query86 389 347 421 347
query87 3630 3463 3392 3392
query88 3110 2251 2250 2250
query89 336 270 251 251
query90 1854 209 207 207
query91 171 143 141 141
query92 63 60 53 53
query93 1026 498 494 494
query94 788 199 197 197
query95 476 440 422 422
query96 625 323 328 323
query97 4310 4159 4230 4159
query98 209 197 184 184
query99 1001 742 746 742
Total cold run time: 293109 ms
Total hot run time: 178599 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886390582
<details>
<summary>TPC-DS: <b>Total hot run time: 178169 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 844140a8e70484dfdc9db080fd468b9c7aae280f, data reload: false
query1 931 350 331 331
query2 6696 1940 1885 1885
query3 6717 213 209 209
query4 26256 22126 22164 22126
query5 4691 517 535 517
query6 292 181 188 181
query7 4617 288 271 271
query8 236 197 193 193
query9 9222 2761 2777 2761
query10 577 273 259 259
query11 16186 15469 15329 15329
query12 131 86 83 83
query13 1629 337 350 337
query14 11962 7209 7094 7094
query15 237 194 195 194
query16 6503 282 275 275
query17 1863 497 483 483
query18 1969 274 269 269
query19 293 143 137 137
query20 90 84 80 80
query21 196 91 91 91
query22 5271 4883 4995 4883
query23 32001 30926 30897 30897
query24 12397 2834 2806 2806
query25 567 347 343 343
query26 1843 156 150 150
query27 2911 273 289 273
query28 7153 1875 1855 1855
query29 2017 380 390 380
query30 286 145 138 138
query31 1048 774 793 774
query32 96 60 63 60
query33 748 267 270 267
query34 1039 443 435 435
query35 933 745 722 722
query36 1325 1269 1265 1265
query37 184 71 73 71
query38 3392 3324 3262 3262
query39 1335 1289 1283 1283
query40 320 94 91 91
query41 38 35 35 35
query42 103 95 98 95
query43 562 519 529 519
query44 1098 718 719 718
query45 205 184 191 184
query46 1053 651 655 651
query47 1661 1610 1633 1610
query48 398 316 300 300
query49 1286 328 307 307
query50 728 329 319 319
query51 5315 5198 5164 5164
query52 89 90 89 89
query53 227 157 152 152
query54 1384 575 584 575
query55 93 95 88 88
query56 223 202 212 202
query57 1059 938 977 938
query58 245 219 217 217
query59 2744 2593 2571 2571
query60 256 253 244 244
query61 85 85 83 83
query62 609 414 414 414
query63 169 161 154 154
query64 5821 1697 1715 1697
query65 3351 3271 3255 3255
query66 1403 339 326 326
query67 15898 15105 15196 15105
query68 11225 533 540 533
query69 561 272 277 272
query70 1683 1580 1467 1467
query71 513 216 230 216
query72 4904 2861 2836 2836
query73 2075 322 316 316
query74 7060 6527 6519 6519
query75 5196 2263 2261 2261
query76 6331 1074 1076 1074
query77 921 260 281 260
query78 9957 8733 8649 8649
query79 1043 514 494 494
query80 618 343 374 343
query81 447 214 217 214
query82 206 92 87 87
query83 184 139 137 137
query84 271 57 57 57
query85 1017 292 279 279
query86 382 373 361 361
query87 3598 3417 3411 3411
query88 3128 2245 2238 2238
query89 339 257 253 253
query90 2044 205 201 201
query91 163 131 130 130
query92 65 57 53 53
query93 1359 440 479 440
query94 882 200 188 188
query95 492 428 417 417
query96 624 313 318 313
query97 4329 4151 4227 4151
query98 197 196 182 182
query99 1002 755 745 745
Total cold run time: 295079 ms
Total hot run time: 178169 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886401274
<details>
<summary>ClickBench: <b>Total hot run time: 30.35 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 844140a8e70484dfdc9db080fd468b9c7aae280f, data reload: false
query1 0.06 0.06 0.06
query2 0.05 0.02 0.02
query3 0.25 0.12 0.11
query4 1.77 0.14 0.12
query5 0.52 0.51 0.52
query6 1.42 0.62 0.63
query7 0.02 0.01 0.01
query8 0.03 0.02 0.02
query9 0.56 0.50 0.51
query10 0.54 0.53 0.55
query11 0.13 0.09 0.09
query12 0.11 0.10 0.10
query13 0.61 0.60 0.60
query14 0.76 0.82 0.80
query15 0.81 0.80 0.81
query16 0.35 0.36 0.34
query17 0.98 0.99 0.96
query18 0.24 0.25 0.25
query19 1.88 1.80 1.78
query20 0.01 0.01 0.01
query21 15.47 0.60 0.57
query22 2.87 2.32 1.78
query23 17.37 0.92 0.73
query24 16.03 0.59 0.63
query25 2.16 0.15 0.14
query26 0.12 0.13 0.13
query27 0.14 0.15 0.14
query28 6.13 0.83 0.81
query29 12.61 3.17 3.12
query30 0.57 0.48 0.48
query31 2.78 0.35 0.37
query32 3.37 0.48 0.48
query33 3.25 3.18 3.23
query34 15.79 4.18 4.16
query35 4.18 4.17 4.17
query36 1.10 1.04 1.04
query37 0.06 0.04 0.05
query38 0.04 0.03 0.03
query39 0.02 0.02 0.01
query40 0.16 0.13 0.14
query41 0.07 0.02 0.01
query42 0.02 0.02 0.01
query43 0.03 0.02 0.02
Total cold run time: 115.44 s
Total hot run time: 30.35 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886397377
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.77 seconds
stream load tsv: 569 seconds loaded 74807831229 Bytes, about 125 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 21.4 seconds inserted 10000000 Rows, about 467K ops/s
storage size: 17184150557 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886646744
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886729568
<details>
<summary>TPC-H: <b>Total hot run time: 38971 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 376505c9fb1da8ba66950b381c38addbc9a9a5c9, data reload: false
------ Round 1 ----------------------------------
q1 17922 5054 5008 5008
q2 2044 139 134 134
q3 10685 1114 1141 1114
q4 10242 770 825 770
q5 7811 3289 3223 3223
q6 202 124 121 121
q7 890 512 493 493
q8 9264 2006 2051 2006
q9 7438 6505 6487 6487
q10 8252 3094 3065 3065
q11 428 220 199 199
q12 369 193 205 193
q13 18111 3435 3417 3417
q14 240 212 213 212
q15 558 522 506 506
q16 438 380 406 380
q17 963 545 573 545
q18 7391 6768 6676 6676
q19 1588 1432 1380 1380
q20 572 314 304 304
q21 2795 2469 2445 2445
q22 349 305 293 293
Total cold run time: 108552 ms
Total hot run time: 38971 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5011 5009 4938 4938
q2 316 201 200 200
q3 3349 3304 3331 3304
q4 2260 2263 2255 2255
q5 5819 5802 5829 5802
q6 198 118 119 118
q7 2337 1889 1862 1862
q8 3479 3581 3591 3581
q9 8915 8925 8895 8895
q10 3752 3801 3851 3801
q11 543 429 438 429
q12 781 606 607 606
q13 4010 3255 3219 3219
q14 285 260 265 260
q15 562 519 508 508
q16 529 458 447 447
q17 2055 2073 2028 2028
q18 8775 8405 8412 8405
q19 1633 1626 1624 1624
q20 2178 1987 1924 1924
q21 6031 5815 5737 5737
q22 577 445 480 445
Total cold run time: 63395 ms
Total hot run time: 60388 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "wangbo (via GitHub)" <gi...@apache.org>.
wangbo commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886631750
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #29843:
URL: https://github.com/apache/doris/pull/29843
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886631419
<details>
<summary>ClickBench: <b>Total hot run time: 30.69 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 521d6d662f8e5cfc604444f8b21fd559c1bead29, data reload: false
query1 0.07 0.06 0.06
query2 0.06 0.02 0.02
query3 0.25 0.11 0.10
query4 1.78 0.12 0.11
query5 0.52 0.52 0.53
query6 1.38 0.63 0.64
query7 0.01 0.01 0.02
query8 0.04 0.03 0.03
query9 0.56 0.50 0.51
query10 0.55 0.55 0.54
query11 0.13 0.09 0.09
query12 0.12 0.10 0.09
query13 0.62 0.60 0.59
query14 0.78 0.79 0.79
query15 0.80 0.79 0.82
query16 0.35 0.34 0.34
query17 0.97 0.98 0.99
query18 0.25 0.23 0.24
query19 1.83 1.80 1.70
query20 0.01 0.01 0.01
query21 15.41 0.58 0.56
query22 2.72 2.28 2.29
query23 17.09 0.70 0.80
query24 16.16 0.57 0.59
query25 2.16 0.15 0.14
query26 0.13 0.14 0.13
query27 0.14 0.15 0.15
query28 5.85 0.88 0.81
query29 12.60 3.10 3.17
query30 0.57 0.48 0.49
query31 2.78 0.35 0.36
query32 3.38 0.49 0.49
query33 3.22 3.21 3.20
query34 15.66 4.15 4.17
query35 4.18 4.15 4.14
query36 1.11 1.05 1.05
query37 0.06 0.05 0.05
query38 0.04 0.02 0.02
query39 0.02 0.02 0.02
query40 0.16 0.16 0.13
query41 0.06 0.01 0.01
query42 0.02 0.02 0.01
query43 0.02 0.02 0.02
Total cold run time: 114.62 s
Total hot run time: 30.69 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](executor)Fix Grayscale upgrade be code dump when report statistics [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29843:
URL: https://github.com/apache/doris/pull/29843#issuecomment-1886777044
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.58 seconds
stream load tsv: 559 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 21.9 seconds inserted 10000000 Rows, about 456K ops/s
storage size: 17183831012 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org