You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "zy-kkk (via GitHub)" <gi...@apache.org> on 2025/12/17 03:28:58 UTC
[PR] [feature](hive) Add memory size metrics for Hive file cache [doris]
zy-kkk opened a new pull request, #59103:
URL: https://github.com/apache/doris/pull/59103
## Summary
Add memory size monitoring for Hive file cache to help diagnose memory usage issues.
- Add `hive_file_cache_memory_bytes` Prometheus metric per catalog
- Add `memory_size_bytes` field to `catalog_meta_cache_statistics` system table
- Implement `getRetainedSizeInBytes()` for `FileCacheKey`, `FileCacheValue`, and `HiveFileStatus`
## Usage
**System table:**
```sql
SELECT * FROM information_schema.catalog_meta_cache_statistics
WHERE cache_name = 'hive_file_cache' and CATALOG_NAME = 'hive' and METRIC_NAME = 'memory_size_bytes';
Prometheus:
curl -s http://localhost:8030/metrics | grep 'hive_file_cache_memory_bytes{catalog="hive"}'
Test
-- Query partition to load cache
SELECT * FROM hive.zyk.partition_table2 WHERE pt1 = '10000';
-- Check memory: 996 bytes
SELECT * FROM information_schema.catalog_meta_cache_statistics WHERE cache_name = 'hive_file_cache' and CATALOG_NAME = 'hive' and METRIC_NAME = 'memory_size_bytes';
+--------------+-----------------+-------------------+--------------+
| CATALOG_NAME | CACHE_NAME | METRIC_NAME | METRIC_VALUE |
+--------------+-----------------+-------------------+--------------+
| hive | hive_file_cache | memory_size_bytes | 996 |
+--------------+-----------------+-------------------+--------------+
-- Query another partition
SELECT * FROM hive.zyk.partition_table2 WHERE pt1 = '10001';
-- Check memory: 1992 bytes (doubled)
SELECT * FROM information_schema.catalog_meta_cache_statistics WHERE cache_name = 'hive_file_cache' and CATALOG_NAME = 'hive' and METRIC_NAME = 'memory_size_bytes';
+--------------+-----------------+-------------------+--------------+
| CATALOG_NAME | CACHE_NAME | METRIC_NAME | METRIC_VALUE |
+--------------+-----------------+-------------------+--------------+
| hive | hive_file_cache | memory_size_bytes | 1992 |
+--------------+-----------------+-------------------+--------------+
-- Refresh catalog
REFRESH CATALOG hive;
-- Check memory: 0 bytes (cleared)
SELECT * FROM information_schema.catalog_meta_cache_statistics WHERE cache_name = 'hive_file_cache' and CATALOG_NAME = 'hive' and METRIC_NAME = 'memory_size_bytes';
+--------------+-----------------+-------------------+--------------+
| CATALOG_NAME | CACHE_NAME | METRIC_NAME | METRIC_VALUE |
+--------------+-----------------+-------------------+--------------+
| hive | hive_file_cache | memory_size_bytes | 0 |
+--------------+-----------------+-------------------+--------------+
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hive) Add memory size metrics for Hive file cache [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59103:
URL: https://github.com/apache/doris/pull/59103#issuecomment-3694832163
<details>
<summary>TPC-DS: <b>Total hot run time: 179389 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 33077752f92e9604c65745ea32375ce276227e10, data reload: false
query5 4881 584 443 443
query6 318 227 234 227
query7 4224 480 288 288
query8 322 256 237 237
query9 8776 2561 2550 2550
query10 533 389 337 337
query11 15503 14874 14872 14872
query12 173 122 116 116
query13 1253 497 404 404
query14 6070 2968 2766 2766
query14_1 2657 2633 2636 2633
query15 221 191 182 182
query16 848 463 456 456
query17 1139 675 580 580
query18 2443 419 334 334
query19 219 221 193 193
query20 115 114 113 113
query21 219 136 114 114
query22 4027 4082 3995 3995
query23 16818 16399 16042 16042
query23_1 16029 16265 16106 16106
query24 7315 1639 1234 1234
query24_1 1216 1194 1251 1194
query25 543 464 405 405
query26 1247 270 165 165
query27 2747 461 305 305
query28 4486 2133 2124 2124
query29 799 584 431 431
query30 309 239 211 211
query31 807 703 622 622
query32 82 66 67 66
query33 527 331 287 287
query34 905 884 526 526
query35 754 792 703 703
query36 879 917 811 811
query37 125 91 87 87
query38 2958 2921 2951 2921
query39 762 739 723 723
query39_1 692 695 714 695
query40 224 136 123 123
query41 66 64 59 59
query42 109 108 106 106
query43 432 430 400 400
query44 1311 744 742 742
query45 192 189 183 183
query46 874 978 610 610
query47 1710 1736 1655 1655
query48 320 316 258 258
query49 644 427 342 342
query50 648 306 229 229
query51 3833 3908 3819 3819
query52 107 107 98 98
query53 319 350 289 289
query54 271 249 235 235
query55 81 74 75 74
query56 284 300 304 300
query57 1162 1159 1101 1101
query58 269 249 242 242
query59 2525 2606 2419 2419
query60 315 305 282 282
query61 163 155 159 155
query62 752 703 661 661
query63 320 288 301 288
query64 4979 1269 969 969
query65 4024 3957 3970 3957
query66 1454 426 314 314
query67 15039 14884 14859 14859
query68 2827 1041 760 760
query69 440 347 314 314
query70 1060 987 998 987
query71 307 305 274 274
query72 6387 5117 5109 5109
query73 510 585 315 315
query74 8642 9037 8760 8760
query75 3138 3170 2802 2802
query76 2885 1151 745 745
query77 364 408 343 343
query78 9482 9576 8804 8804
query79 2379 854 630 630
query80 1674 652 549 549
query81 553 267 231 231
query82 1029 136 101 101
query83 336 252 235 235
query84 248 113 109 109
query85 945 501 462 462
query86 399 298 278 278
query87 3180 3168 3032 3032
query88 3317 2314 2308 2308
query89 467 425 394 394
query90 1971 165 152 152
query91 172 164 142 142
query92 67 71 62 62
query93 1141 901 558 558
query94 539 306 280 280
query95 568 383 297 297
query96 600 480 208 208
query97 2262 2293 2210 2210
query98 215 194 187 187
query99 1343 1355 1232 1232
Total cold run time: 256322 ms
Total hot run time: 179389 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hive) Add memory size metrics for Hive file cache [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59103:
URL: https://github.com/apache/doris/pull/59103#issuecomment-3663548004
<details>
<summary>ClickBench: <b>Total hot run time: 27.33 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4a083b66588313c5fb93f79deac3e5d9d3415aac, data reload: false
query1 0.05 0.04 0.04
query2 0.10 0.05 0.04
query3 0.26 0.09 0.09
query4 1.61 0.11 0.10
query5 0.27 0.24 0.26
query6 1.16 0.66 0.63
query7 0.03 0.03 0.03
query8 0.05 0.04 0.04
query9 0.59 0.51 0.52
query10 0.58 0.54 0.57
query11 0.16 0.10 0.10
query12 0.15 0.11 0.12
query13 0.61 0.60 0.60
query14 1.02 0.98 1.00
query15 0.80 0.80 0.80
query16 0.40 0.42 0.42
query17 1.06 1.06 1.06
query18 0.23 0.21 0.22
query19 1.93 1.80 1.71
query20 0.01 0.01 0.02
query21 15.44 0.30 0.14
query22 4.72 0.05 0.04
query23 16.05 0.27 0.10
query24 1.58 0.54 0.43
query25 0.09 0.10 0.05
query26 0.14 0.13 0.13
query27 0.09 0.06 0.08
query28 5.53 1.21 1.02
query29 12.61 4.11 3.24
query30 0.28 0.13 0.14
query31 2.83 0.65 0.40
query32 3.23 0.55 0.47
query33 3.10 2.98 3.08
query34 16.87 5.18 4.51
query35 4.55 4.63 4.53
query36 0.65 0.50 0.49
query37 0.11 0.06 0.07
query38 0.08 0.05 0.04
query39 0.04 0.03 0.03
query40 0.18 0.15 0.14
query41 0.09 0.04 0.03
query42 0.04 0.04 0.02
query43 0.04 0.03 0.03
Total cold run time: 99.41 s
Total hot run time: 27.33 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hive) Add memory size metrics for Hive file cache [doris]
Posted by "zy-kkk (via GitHub)" <gi...@apache.org>.
zy-kkk commented on PR #59103:
URL: https://github.com/apache/doris/pull/59103#issuecomment-3663479246
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hive) Add memory size metrics for Hive file cache [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #59103:
URL: https://github.com/apache/doris/pull/59103#issuecomment-3694800803
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hive) Add memory size metrics for Hive file cache [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59103:
URL: https://github.com/apache/doris/pull/59103#issuecomment-3694835721
<details>
<summary>ClickBench: <b>Total hot run time: 27.33 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 33077752f92e9604c65745ea32375ce276227e10, data reload: false
query1 0.05 0.04 0.04
query2 0.10 0.04 0.04
query3 0.26 0.09 0.08
query4 1.62 0.11 0.11
query5 0.28 0.27 0.25
query6 1.17 0.64 0.63
query7 0.03 0.02 0.02
query8 0.05 0.04 0.04
query9 0.58 0.49 0.50
query10 0.54 0.56 0.56
query11 0.15 0.11 0.11
query12 0.16 0.13 0.11
query13 0.64 0.61 0.60
query14 0.98 0.98 0.98
query15 0.82 0.79 0.79
query16 0.41 0.40 0.39
query17 0.99 0.99 1.04
query18 0.23 0.21 0.22
query19 1.94 1.90 1.85
query20 0.01 0.01 0.02
query21 15.43 0.28 0.14
query22 4.71 0.05 0.05
query23 15.95 0.28 0.10
query24 1.07 0.44 0.56
query25 0.08 0.06 0.07
query26 0.14 0.13 0.14
query27 0.08 0.05 0.06
query28 4.09 1.21 1.02
query29 12.60 3.96 3.19
query30 0.27 0.14 0.12
query31 2.82 0.64 0.39
query32 3.23 0.54 0.45
query33 2.98 2.98 3.04
query34 16.60 5.20 4.51
query35 4.58 4.54 4.63
query36 0.66 0.50 0.50
query37 0.12 0.07 0.07
query38 0.07 0.04 0.04
query39 0.04 0.02 0.02
query40 0.17 0.14 0.13
query41 0.08 0.03 0.03
query42 0.04 0.04 0.03
query43 0.04 0.04 0.04
Total cold run time: 96.86 s
Total hot run time: 27.33 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hive) Add memory size metrics for Hive file cache [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59103:
URL: https://github.com/apache/doris/pull/59103#issuecomment-3663521249
<details>
<summary>TPC-H: <b>Total hot run time: 36252 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4a083b66588313c5fb93f79deac3e5d9d3415aac, data reload: false
------ Round 1 ----------------------------------
q1 17617 4183 4088 4088
q2 2038 361 240 240
q3 10183 1333 751 751
q4 10218 824 311 311
q5 7518 2136 1939 1939
q6 190 164 138 138
q7 1024 857 716 716
q8 9351 1425 1198 1198
q9 7008 5326 5319 5319
q10 6796 2397 1983 1983
q11 525 316 303 303
q12 668 745 581 581
q13 17755 3640 3090 3090
q14 288 310 279 279
q15 582 535 521 521
q16 694 681 627 627
q17 683 798 556 556
q18 7622 7610 8019 7610
q19 1119 993 659 659
q20 430 385 245 245
q21 4629 4490 4042 4042
q22 1073 1114 1056 1056
Total cold run time: 108011 ms
Total hot run time: 36252 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4427 4243 4241 4241
q2 322 409 316 316
q3 2355 2858 2535 2535
q4 1424 1893 1467 1467
q5 4633 4476 4752 4476
q6 216 170 129 129
q7 2002 1944 1881 1881
q8 2626 2531 2625 2531
q9 7530 7403 7539 7403
q10 3084 3263 2839 2839
q11 603 515 500 500
q12 687 759 545 545
q13 3571 3642 3016 3016
q14 280 297 272 272
q15 525 483 487 483
q16 626 645 601 601
q17 1112 1375 1356 1356
q18 7316 7040 7236 7040
q19 853 832 841 832
q20 1890 2000 1801 1801
q21 4675 4242 4142 4142
q22 1095 1020 1020 1020
Total cold run time: 51852 ms
Total hot run time: 49426 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hive) Add memory size metrics for Hive file cache [doris]
Posted by "zy-kkk (via GitHub)" <gi...@apache.org>.
zy-kkk closed pull request #59103: [feature](hive) Add memory size metrics for Hive file cache
URL: https://github.com/apache/doris/pull/59103
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hive) Add memory size metrics for Hive file cache [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #59103:
URL: https://github.com/apache/doris/pull/59103#issuecomment-3663596590
# FE UT Coverage Report
Increment line coverage ` 21.62% (8/37)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/59103_4a083b66588313c5fb93f79deac3e5d9d3415aac/fe_increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/59103_4a083b66588313c5fb93f79deac3e5d9d3415aac/fe_report/index.html)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hive) Add memory size metrics for Hive file cache [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #59103:
URL: https://github.com/apache/doris/pull/59103#issuecomment-3694931336
# FE Regression Coverage Report
Increment line coverage ` 27.91% (12/43)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/59103_33077752f92e9604c65745ea32375ce276227e10_merge_fe/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/59103_33077752f92e9604c65745ea32375ce276227e10_merge_fe/report/index.html)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hive) Add memory size metrics for Hive file cache [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59103:
URL: https://github.com/apache/doris/pull/59103#issuecomment-3694824577
<details>
<summary>TPC-H: <b>Total hot run time: 35300 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 33077752f92e9604c65745ea32375ce276227e10, data reload: false
------ Round 1 ----------------------------------
q1 17611 4334 4077 4077
q2 2051 368 256 256
q3 10166 1328 736 736
q4 10290 903 323 323
q5 7561 2186 1917 1917
q6 188 170 141 141
q7 1008 891 728 728
q8 9384 1462 1280 1280
q9 7077 5386 5331 5331
q10 6865 2380 1998 1998
q11 555 362 316 316
q12 649 719 571 571
q13 17771 3664 2996 2996
q14 295 303 289 289
q15 590 521 528 521
q16 706 672 636 636
q17 709 802 506 506
q18 7376 7045 6985 6985
q19 1103 972 617 617
q20 410 362 239 239
q21 4181 3871 3866 3866
q22 1032 1016 971 971
Total cold run time: 107578 ms
Total hot run time: 35300 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4088 4007 4050 4007
q2 329 401 329 329
q3 2098 2646 2279 2279
q4 1347 1736 1320 1320
q5 4216 4619 4601 4601
q6 225 183 137 137
q7 2053 1990 1790 1790
q8 2745 2573 2564 2564
q9 7457 7570 7420 7420
q10 3128 3241 2858 2858
q11 623 531 533 531
q12 790 774 607 607
q13 3503 3869 3487 3487
q14 319 329 279 279
q15 548 514 515 514
q16 659 668 627 627
q17 1169 1403 1447 1403
q18 7869 7648 7448 7448
q19 882 973 885 885
q20 1945 2035 1864 1864
q21 4742 4232 4152 4152
q22 1087 1008 960 960
Total cold run time: 51822 ms
Total hot run time: 50062 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hive) Add memory size metrics for Hive file cache [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #59103:
URL: https://github.com/apache/doris/pull/59103#issuecomment-3694800767
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hive) Add memory size metrics for Hive file cache [doris]
Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman commented on PR #59103:
URL: https://github.com/apache/doris/pull/59103#issuecomment-3694800205
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hive) Add memory size metrics for Hive file cache [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #59103:
URL: https://github.com/apache/doris/pull/59103#issuecomment-3663478941
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
Please clearly describe your PR:
1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hive) Add memory size metrics for Hive file cache [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59103:
URL: https://github.com/apache/doris/pull/59103#issuecomment-3663539569
<details>
<summary>TPC-DS: <b>Total hot run time: 178907 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4a083b66588313c5fb93f79deac3e5d9d3415aac, data reload: false
query5 5469 613 434 434
query6 334 234 224 224
query7 4213 452 261 261
query8 300 244 231 231
query9 8766 2525 2547 2525
query10 567 391 322 322
query11 15434 14725 15072 14725
query12 188 115 122 115
query13 1267 503 395 395
query14 6749 3067 2751 2751
query14_1 2673 2691 2645 2645
query15 222 208 180 180
query16 895 484 474 474
query17 1141 720 596 596
query18 2716 450 353 353
query19 234 238 223 223
query20 122 117 114 114
query21 227 143 121 121
query22 4026 3996 3955 3955
query23 16912 16446 16184 16184
query23_1 16107 16179 16104 16104
query24 7277 1638 1229 1229
query24_1 1262 1233 1270 1233
query25 603 497 447 447
query26 1258 271 169 169
query27 2751 472 320 320
query28 4458 2140 2126 2126
query29 844 596 478 478
query30 327 252 218 218
query31 827 718 618 618
query32 76 79 74 74
query33 552 353 301 301
query34 918 908 534 534
query35 840 820 718 718
query36 873 885 833 833
query37 126 89 81 81
query38 2864 2945 2838 2838
query39 780 727 710 710
query39_1 693 687 712 687
query40 227 140 125 125
query41 70 65 62 62
query42 107 105 103 103
query43 435 436 401 401
query44 1367 768 753 753
query45 196 197 195 195
query46 900 992 641 641
query47 1714 1703 1626 1626
query48 333 351 246 246
query49 634 431 350 350
query50 669 299 226 226
query51 3855 3923 3835 3835
query52 110 112 99 99
query53 318 347 294 294
query54 295 266 251 251
query55 82 79 72 72
query56 287 313 305 305
query57 1153 1171 1080 1080
query58 281 254 261 254
query59 2499 2556 2462 2462
query60 329 312 293 293
query61 164 162 167 162
query62 705 679 628 628
query63 328 299 300 299
query64 5017 1347 997 997
query65 4027 4012 3949 3949
query66 1354 435 316 316
query67 15455 15038 14922 14922
query68 8377 1000 720 720
query69 501 358 308 308
query70 1094 995 970 970
query71 380 299 274 274
query72 6149 4900 4887 4887
query73 656 545 312 312
query74 8879 8884 8570 8570
query75 3250 3179 2792 2792
query76 3994 1138 724 724
query77 593 396 279 279
query78 9423 9605 8909 8909
query79 1628 906 602 602
query80 699 664 556 556
query81 505 276 237 237
query82 205 136 102 102
query83 266 261 251 251
query84 260 122 106 106
query85 903 518 467 467
query86 362 272 285 272
query87 3155 3005 2944 2944
query88 4455 2296 2299 2296
query89 467 423 404 404
query90 2220 161 146 146
query91 175 168 145 145
query92 85 70 66 66
query93 1654 906 555 555
query94 474 298 286 286
query95 570 384 307 307
query96 589 476 210 210
query97 2266 2315 2228 2228
query98 212 189 191 189
query99 1269 1291 1214 1214
Total cold run time: 264670 ms
Total hot run time: 178907 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org