You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Joe McDonnell (Jira)" <ji...@apache.org> on 2026/08/27 23:34:00 UTC

[jira] [Created] (IMPALA-15316) Support huge pages when tcmalloc's aggressive decommit is off

Joe McDonnell created IMPALA-15316:
--------------------------------------

             Summary: Support huge pages when tcmalloc's aggressive decommit is off
                 Key: IMPALA-15316
                 URL: https://issues.apache.org/jira/browse/IMPALA-15316
             Project: IMPALA
          Issue Type: Task
          Components: Backend
    Affects Versions: Impala 5.0.0
            Reporter: Joe McDonnell


In IMPALA-14900, we added support for turning off TCMalloc's aggressive decommit mode. This came at the cost of disabling madvise_huge_pages for that configuration. Without aggressive decommit, TCMalloc could break up huge pages and reuse smaller chunks. This could make the memory usage deceptive.

We can support huge pages with aggressive decommit off by mmap them ourselves in the SystemAllocator. We would need to track this memory usage and count it toward the process limit.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)