You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Joe McDonnell (Jira)" <ji...@apache.org> on 2026/08/27 23:34:00 UTC
[jira] [Created] (IMPALA-15316) Support huge pages when tcmalloc's aggressive decommit is off
Joe McDonnell created IMPALA-15316:
--------------------------------------
Summary: Support huge pages when tcmalloc's aggressive decommit is off
Key: IMPALA-15316
URL: https://issues.apache.org/jira/browse/IMPALA-15316
Project: IMPALA
Issue Type: Task
Components: Backend
Affects Versions: Impala 5.0.0
Reporter: Joe McDonnell
In IMPALA-14900, we added support for turning off TCMalloc's aggressive decommit mode. This came at the cost of disabling madvise_huge_pages for that configuration. Without aggressive decommit, TCMalloc could break up huge pages and reuse smaller chunks. This could make the memory usage deceptive.
We can support huge pages with aggressive decommit off by mmap them ourselves in the SystemAllocator. We would need to track this memory usage and count it toward the process limit.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)