You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Tim Armstrong (JIRA)" <ji...@apache.org> on 2017/04/19 17:23:42 UTC
[jira] [Created] (IMPALA-5229) Try using TCMalloc + Huge Pages for
buffers
Tim Armstrong created IMPALA-5229:
-------------------------------------
Summary: Try using TCMalloc + Huge Pages for buffers
Key: IMPALA-5229
URL: https://issues.apache.org/jira/browse/IMPALA-5229
Project: IMPALA
Issue Type: Improvement
Components: Backend
Affects Versions: Impala 2.9.0
Reporter: Tim Armstrong
Assignee: Tim Armstrong
As well as mmap() + huge pages, we could support TCMalloc + huge pages. I believe TCMalloc will support this well because:
* We can allocate huge-page-aligned memory via posix_memalign()
* TCMalloc, by default, always decommits large allocations upon freeing them. So if we undo the HUGEPAGE madvise() before handing the pages back to TCMalloc, then TCMalloc will decommit the huge pages backing the allocation, and we won't get TCMalloc's page heap into a weird state.
This could give us the perf benefits of huge pages without some of the headaches associated with using mmap() directly.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)