You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "jacktengg (via GitHub)" <gi...@apache.org> on 2024/01/29 17:04:41 UTC
[PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
jacktengg opened a new pull request, #30538:
URL: https://github.com/apache/doris/pull/30538
## Proposed changes
Issue Number: close #xxx
Improve memory counters for operators, e.g.:
scanner merged:
```
VScanner:
- MemoryUsage: sum , avg , max , min
- FreeBlocks: sum 1.98 GB, avg 42.16 MB, max 75.55 MB, min 14.25 MB
- QueuedBlocks: sum 2.35 GB, avg 50.13 MB, max 81.64 MB, min 27.02 MB
```
scanner:
```
VScanner:
- MemoryUsage:
- FreeBlocks: 15.53 MB
- QueuedBlocks: 36.12 MB
```
hash join sink merged:
```
HASH_JOIN_SINK_OPERATOR (id=44):
- MemoryUsage: sum , avg , max , min
- BuildBlocks: sum 31.28 MB, avg 667.33 KB, max 674.78 KB, min 659.93 KB
- BuildKeyArena: sum 17.19 MB, avg 366.75 KB, max 372.00 KB, min 364.00 KB
- HashTable: sum 9.38 MB, avg 200.15 KB, max 200.96 KB, min 199.35 KB
- PeakMemoryUsage: sum 57.67 MB, avg 1.20 MB, max 1.21 MB, min 1.19 MB
```
hash join sink:
```
HASH_JOIN_SINK_OPERATOR (id=43):
- MemoryUsage:
- BuildBlocks: 681.86 KB
- BuildKeyArena: 376.00 KB
- HashTable: 201.72 KB
- PeakMemoryUsage: 1.23 MB
```
sort sink merged:
```
SORT_SINK_OPERATOR (id=45):
- MemoryUsage: sum , avg , max , min
- PeakMemoryUsage: sum 5.73 MB, avg 122.22 KB, max 129.96 KB, min 114.84 KB
- SortBlocks: sum 5.73 MB, avg 122.22 KB, max 129.96 KB, min 114.84 KB
```
sort sink:
```
SORT_SINK_OPERATOR (id=45):
- MemoryUsage:
- PeakMemoryUsage: 121.77 KB
- SortBlocks: 121.77 KB
```
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "jacktengg (via GitHub)" <gi...@apache.org>.
jacktengg commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1915896309
run pipelinex_p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1916068915
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit c102a6c0e89da6dbb2faa7672a8b59d9dc932ddb with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 13.5 seconds inserted 10000000 Rows, about 740K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1915304937
<details>
<summary>ClickBench: <b>Total hot run time: 31.07 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 805519b3e81a452118fcb1fb1188226d5e9ff708, data reload: false
query1 0.04 0.03 0.02
query2 0.05 0.02 0.02
query3 0.22 0.06 0.06
query4 1.69 0.10 0.10
query5 0.52 0.51 0.52
query6 1.21 0.63 0.64
query7 0.02 0.02 0.01
query8 0.03 0.03 0.03
query9 0.56 0.51 0.51
query10 0.57 0.56 0.58
query11 0.12 0.08 0.08
query12 0.12 0.09 0.09
query13 0.60 0.61 0.60
query14 0.79 0.81 0.81
query15 0.80 0.78 0.77
query16 0.38 0.40 0.39
query17 1.04 1.04 1.04
query18 0.21 0.26 0.23
query19 1.93 1.78 1.81
query20 0.02 0.01 0.01
query21 15.42 0.56 0.56
query22 2.26 2.53 1.55
query23 17.41 0.76 0.81
query24 2.40 1.57 1.29
query25 0.44 0.17 0.07
query26 0.61 0.15 0.14
query27 0.05 0.06 0.05
query28 10.91 0.86 0.83
query29 12.65 3.20 3.20
query30 0.64 0.52 0.53
query31 2.79 0.35 0.36
query32 3.35 0.48 0.48
query33 3.23 3.19 3.31
query34 15.92 4.31 4.23
query35 4.30 4.30 4.30
query36 1.10 1.05 1.08
query37 0.06 0.04 0.04
query38 0.04 0.03 0.03
query39 0.02 0.01 0.02
query40 0.17 0.13 0.13
query41 0.07 0.01 0.02
query42 0.02 0.02 0.01
query43 0.03 0.02 0.02
Total cold run time: 104.81 s
Total hot run time: 31.07 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1916024863
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1916024879
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "jacktengg (via GitHub)" <gi...@apache.org>.
jacktengg commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1916025348
run pipelinex_p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1916032856
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1915203238
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1916053546
<details>
<summary>TPC-H: <b>Total hot run time: 36672 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c102a6c0e89da6dbb2faa7672a8b59d9dc932ddb, data reload: false
------ Round 1 ----------------------------------
q1 17641 4424 4443 4424
q2 2034 137 134 134
q3 10593 923 937 923
q4 4647 730 694 694
q5 7662 2777 2842 2777
q6 183 118 118 118
q7 1160 721 723 721
q8 9252 1973 1993 1973
q9 7207 6282 6326 6282
q10 8084 2457 2391 2391
q11 425 204 196 196
q12 743 265 281 265
q13 18020 3276 3263 3263
q14 267 249 257 249
q15 523 516 497 497
q16 463 395 405 395
q17 927 504 500 500
q18 6704 5987 5848 5848
q19 1560 1452 1382 1382
q20 570 333 323 323
q21 7093 3062 3029 3029
q22 822 317 288 288
Total cold run time: 106580 ms
Total hot run time: 36672 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4471 4398 4362 4362
q2 327 232 230 230
q3 3027 2837 2840 2837
q4 1842 1579 1654 1579
q5 5208 5272 5251 5251
q6 192 115 112 112
q7 2174 1730 1748 1730
q8 3115 3241 3213 3213
q9 8311 8343 8287 8287
q10 5873 3609 3506 3506
q11 534 473 457 457
q12 729 570 595 570
q13 14598 3037 3072 3037
q14 271 255 261 255
q15 534 494 494 494
q16 529 474 458 458
q17 1823 1669 1707 1669
q18 7908 7764 7516 7516
q19 10474 1545 1524 1524
q20 2156 1903 1890 1890
q21 4874 4691 4598 4598
q22 533 457 493 457
Total cold run time: 79503 ms
Total hot run time: 54032 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1916045522
TeamCity be ut coverage result:
Function Coverage: 36.19% (8625/23831)
Line Coverage: 28.26% (70546/249653)
Region Coverage: 27.25% (36399/133554)
Branch Coverage: 24.06% (18657/77558)
Coverage Report: http://coverage.selectdb-in.cc/coverage/c102a6c0e89da6dbb2faa7672a8b59d9dc932ddb_c102a6c0e89da6dbb2faa7672a8b59d9dc932ddb/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1915290810
TeamCity be ut coverage result:
Function Coverage: 36.18% (8621/23827)
Line Coverage: 28.25% (70507/249624)
Region Coverage: 27.24% (36380/133538)
Branch Coverage: 24.04% (18642/77552)
Coverage Report: http://coverage.selectdb-in.cc/coverage/805519b3e81a452118fcb1fb1188226d5e9ff708_805519b3e81a452118fcb1fb1188226d5e9ff708/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "jacktengg (via GitHub)" <gi...@apache.org>.
jacktengg commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1916025633
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1915309435
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 805519b3e81a452118fcb1fb1188226d5e9ff708 with default session variables
Stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 13.5 seconds inserted 10000000 Rows, about 740K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "jacktengg (via GitHub)" <gi...@apache.org>.
jacktengg commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1915181614
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1916062473
<details>
<summary>TPC-DS: <b>Total hot run time: 172729 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c102a6c0e89da6dbb2faa7672a8b59d9dc932ddb, data reload: false
query1 921 333 330 330
query2 6568 1965 1944 1944
query3 6697 199 197 197
query4 26921 22065 22082 22065
query5 4453 353 353 353
query6 256 159 146 146
query7 4622 262 261 261
query8 250 174 178 174
query9 9035 2331 2298 2298
query10 409 201 201 201
query11 16848 15426 15261 15261
query12 129 66 64 64
query13 1701 375 375 375
query14 9252 6573 6452 6452
query15 225 188 191 188
query16 6314 253 243 243
query17 1868 477 459 459
query18 1827 258 257 257
query19 180 126 126 126
query20 73 73 68 68
query21 197 131 132 131
query22 4866 4782 4746 4746
query23 31002 30268 30262 30262
query24 7053 2735 2717 2717
query25 484 315 297 297
query26 818 134 134 134
query27 2473 283 285 283
query28 4032 1886 1855 1855
query29 904 606 629 606
query30 202 135 134 134
query31 900 709 717 709
query32 81 49 52 49
query33 421 212 208 208
query34 810 458 462 458
query35 819 751 783 751
query36 1260 1201 1189 1189
query37 96 59 59 59
query38 3246 3176 3135 3135
query39 1308 1260 1265 1260
query40 194 87 80 80
query41 37 36 33 33
query42 94 80 85 80
query43 478 490 494 490
query44 1089 687 691 687
query45 198 176 174 174
query46 1033 657 643 643
query47 1556 1428 1496 1428
query48 382 302 326 302
query49 624 272 285 272
query50 684 310 304 304
query51 5279 5211 5148 5148
query52 91 80 77 77
query53 346 258 272 258
query54 222 185 178 178
query55 78 72 75 72
query56 177 165 163 163
query57 987 917 885 885
query58 186 145 154 145
query59 2294 2404 2268 2268
query60 198 177 178 177
query61 81 80 80 80
query62 443 370 342 342
query63 289 268 277 268
query64 3485 1742 1712 1712
query65 3289 3217 3217 3217
query66 1088 312 322 312
query67 14637 14500 14214 14214
query68 4002 504 478 478
query69 451 300 317 300
query70 1531 1541 1538 1538
query71 296 210 213 210
query72 3669 2793 2805 2793
query73 678 311 318 311
query74 6596 6243 6258 6243
query75 2769 2335 2297 2297
query76 2937 960 963 960
query77 375 227 222 222
query78 9117 8770 8512 8512
query79 2502 485 493 485
query80 2118 319 313 313
query81 512 200 196 196
query82 711 81 81 81
query83 245 114 118 114
query84 279 78 69 69
query85 1955 342 314 314
query86 508 397 376 376
query87 3409 3295 3313 3295
query88 3580 2202 2167 2167
query89 433 347 364 347
query90 2031 185 188 185
query91 149 120 114 114
query92 52 42 46 42
query93 2475 420 437 420
query94 1348 155 156 155
query95 498 453 449 449
query96 625 310 308 308
query97 4217 4134 4134 4134
query98 216 194 183 183
query99 1000 678 664 664
Total cold run time: 260344 ms
Total hot run time: 172729 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1916066525
<details>
<summary>ClickBench: <b>Total hot run time: 30.44 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c102a6c0e89da6dbb2faa7672a8b59d9dc932ddb, data reload: false
query1 0.04 0.03 0.03
query2 0.06 0.03 0.02
query3 0.23 0.07 0.06
query4 1.65 0.10 0.10
query5 0.56 0.52 0.52
query6 1.19 0.64 0.65
query7 0.01 0.02 0.01
query8 0.04 0.03 0.03
query9 0.55 0.52 0.50
query10 0.56 0.55 0.55
query11 0.12 0.08 0.08
query12 0.11 0.08 0.09
query13 0.60 0.61 0.61
query14 0.78 0.82 0.78
query15 0.79 0.79 0.78
query16 0.37 0.39 0.38
query17 1.01 0.99 1.02
query18 0.21 0.27 0.24
query19 1.90 1.80 1.74
query20 0.02 0.01 0.01
query21 15.41 0.57 0.58
query22 2.45 3.14 1.91
query23 17.37 0.75 0.90
query24 2.54 0.31 1.38
query25 0.31 0.24 0.20
query26 0.44 0.14 0.14
query27 0.05 0.05 0.04
query28 11.59 0.85 0.83
query29 12.59 3.13 3.21
query30 0.61 0.57 0.56
query31 2.78 0.35 0.36
query32 3.32 0.49 0.48
query33 3.21 3.20 3.25
query34 15.69 4.24 4.29
query35 4.38 4.34 4.27
query36 1.09 1.05 1.06
query37 0.07 0.05 0.05
query38 0.03 0.03 0.03
query39 0.02 0.01 0.02
query40 0.16 0.13 0.13
query41 0.07 0.02 0.01
query42 0.03 0.01 0.02
query43 0.03 0.02 0.02
Total cold run time: 105.04 s
Total hot run time: 30.44 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1915295650
<details>
<summary>TPC-DS: <b>Total hot run time: 172244 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 805519b3e81a452118fcb1fb1188226d5e9ff708, data reload: false
query1 939 334 322 322
query2 6570 1851 1904 1851
query3 6732 203 198 198
query4 27119 22072 22023 22023
query5 4451 351 347 347
query6 252 151 164 151
query7 4609 260 248 248
query8 242 170 177 170
query9 8917 2291 2264 2264
query10 411 205 201 201
query11 16607 15301 15528 15301
query12 125 66 59 59
query13 1674 366 364 364
query14 9368 6682 6471 6471
query15 211 175 180 175
query16 6427 248 247 247
query17 1920 485 470 470
query18 1928 265 247 247
query19 173 131 133 131
query20 76 71 67 67
query21 200 128 135 128
query22 4909 4769 4790 4769
query23 31138 30191 30227 30191
query24 8142 2782 2704 2704
query25 544 301 298 298
query26 828 139 134 134
query27 2762 284 283 283
query28 5756 1852 1835 1835
query29 902 601 605 601
query30 284 136 137 136
query31 915 705 716 705
query32 90 51 49 49
query33 447 216 205 205
query34 807 450 450 450
query35 833 786 756 756
query36 1285 1156 1192 1156
query37 91 56 58 56
query38 3307 3196 3174 3174
query39 1298 1247 1241 1241
query40 195 85 81 81
query41 36 35 34 34
query42 90 83 81 81
query43 536 470 483 470
query44 1014 685 678 678
query45 192 178 173 173
query46 1059 641 611 611
query47 1511 1549 1478 1478
query48 378 302 318 302
query49 1105 283 274 274
query50 668 297 302 297
query51 5258 5152 5127 5127
query52 84 80 71 71
query53 327 255 254 254
query54 227 181 182 181
query55 76 72 76 72
query56 179 173 163 163
query57 968 910 925 910
query58 180 157 151 151
query59 2378 2335 2234 2234
query60 198 170 173 170
query61 82 87 79 79
query62 583 362 348 348
query63 270 250 265 250
query64 4001 1716 1706 1706
query65 3302 3238 3178 3178
query66 1136 314 328 314
query67 14483 14127 14556 14127
query68 4092 489 478 478
query69 440 308 303 303
query70 1429 1527 1496 1496
query71 278 216 220 216
query72 3765 2817 2802 2802
query73 684 308 308 308
query74 6738 6216 6336 6216
query75 2774 2356 2324 2324
query76 3001 961 964 961
query77 346 219 218 218
query78 9125 8928 8629 8629
query79 2465 481 477 477
query80 1296 312 301 301
query81 513 194 196 194
query82 874 78 74 74
query83 210 116 115 115
query84 235 71 76 71
query85 1076 316 311 311
query86 463 378 388 378
query87 3421 3307 3284 3284
query88 3816 2167 2148 2148
query89 408 326 369 326
query90 2003 182 177 177
query91 148 116 118 116
query92 55 40 45 40
query93 1759 443 431 431
query94 1184 158 156 156
query95 484 478 439 439
query96 606 318 317 317
query97 4238 4107 4109 4107
query98 198 195 178 178
query99 1063 661 712 661
Total cold run time: 262992 ms
Total hot run time: 172244 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1915201993
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelinex](profile) improve memory counter of pipelineX [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30538:
URL: https://github.com/apache/doris/pull/30538#issuecomment-1915277852
<details>
<summary>TPC-H: <b>Total hot run time: 36868 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 805519b3e81a452118fcb1fb1188226d5e9ff708, data reload: false
------ Round 1 ----------------------------------
q1 17657 4748 4491 4491
q2 2050 138 132 132
q3 10608 924 948 924
q4 4655 685 721 685
q5 7656 2835 2827 2827
q6 187 120 117 117
q7 1123 726 712 712
q8 9260 2015 2018 2015
q9 7260 6320 6353 6320
q10 8120 2432 2466 2432
q11 413 211 194 194
q12 703 267 262 262
q13 18030 3287 3279 3279
q14 277 253 243 243
q15 526 525 482 482
q16 478 405 418 405
q17 946 559 494 494
q18 6764 5959 5862 5862
q19 1573 1372 1317 1317
q20 586 334 342 334
q21 6643 3086 3058 3058
q22 797 294 283 283
Total cold run time: 106312 ms
Total hot run time: 36868 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4521 4427 4394 4394
q2 350 240 234 234
q3 3010 2856 2913 2856
q4 1831 1729 1663 1663
q5 5236 5329 5236 5236
q6 193 112 111 111
q7 2131 1793 1774 1774
q8 3141 3219 3243 3219
q9 8385 8371 8371 8371
q10 5778 3571 3624 3571
q11 560 468 453 453
q12 752 578 599 578
q13 12407 3102 3075 3075
q14 280 260 253 253
q15 545 485 487 485
q16 538 493 484 484
q17 1866 1734 1710 1710
q18 8081 7613 7428 7428
q19 7786 1548 1594 1548
q20 2141 1902 1884 1884
q21 4862 4622 4591 4591
q22 535 462 478 462
Total cold run time: 74929 ms
Total hot run time: 54380 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org