[jira] [Commented] (IMPALA-14874) Add more TCMalloc metrics

["ASF subversion and git services (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-14874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18070736#comment-18070736 ] 

ASF subversion and git services commented on IMPALA-14874:
----------------------------------------------------------

Commit a01d053d5e80329ab511334473060d73176b9475 in impala's branch refs/heads/master from stiga-huang
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=a01d053d5 ]

IMPALA-14874: Add more TCMalloc metrics

This patch exposes more numeric properties from TCMalloc in the /metrics
page. The following metrics are added.
 - tcmalloc.current-total-thread-cache-bytes:
   Number of bytes used across all thread caches.
 - tcmalloc.central-cache-free-bytes:
   Number of free bytes in the central cache that have been assigned to
   size classes.
 - tcmalloc.transfer-cache-free-bytes:
   Number of free bytes that are waiting to be transferred between the
   central cache and a thread cache.
 - tcmalloc.thread-cache-free-bytes:
   Number of free bytes in thread caches.

Tests
 - Added BE test in metrics-test.
 - Manually verified the metrics after running some queries.

Generated-by: composer-2
Generated-by: claude-4.5-sonnet
Change-Id: Iec8eb33415baea77451f97df3545e386a4b8c894
Reviewed-on: http://gerrit.cloudera.org:8080/24164
Reviewed-by: Csaba Ringhofer <cs...@cloudera.com>
Reviewed-by: Jason Fehr <jf...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> Add more TCMalloc metrics
> -------------------------
>
>                 Key: IMPALA-14874
>                 URL: https://issues.apache.org/jira/browse/IMPALA-14874
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Backend
>            Reporter: Quanlong Huang
>            Assignee: Quanlong Huang
>            Priority: Critical
>
> Currently, we just track the following TCMalloc metrics:
>  * tcmalloc.bytes-in-use
>  * tcmalloc.pageheap-free-bytes
>  * tcmalloc.pageheap-unmapped-bytes
>  * tcmalloc.physical-bytes-reserved
>  * tcmalloc.total-bytes-reserved
> It'd be helpful to show more numeric properties from TCMalloc that should have minimal overhead to read. E.g.,
>  * tcmalloc.current_total_thread_cache_bytes
>  * tcmalloc.central_cache_free_bytes
>  * tcmalloc.transfer_cache_free_bytes
>  * tcmalloc.thread_cache_free_bytes
> [https://github.com/gperftools/gperftools/blob/gperftools-2.10/src/gperftools/malloc_extension.h#L185-L207]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org