[jira] [Created] (IMPALA-15602) Switch malloc implementation to Google TCMalloc by default

["Joe McDonnell (Jira)" <ji...@apache.org>]

Joe McDonnell created IMPALA-15602:
--------------------------------------

             Summary: Switch malloc implementation to Google TCMalloc by default
                 Key: IMPALA-15602
                 URL: https://issues.apache.org/jira/browse/IMPALA-15602
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
    Affects Versions: Impala 5.0.0
            Reporter: Joe McDonnell


Impala has used gperftools with aggressive decommit for many years. We have recently added two alternatives: We support turning off aggressive decommit with gperftools. We also support building against Google TCMalloc. Both show a major improvement in performance over current policy.

Google TCMalloc uses a new architecture that has per-CPU caches rather than per-thread caches. It also has sophisticated huge page handling. It holds a slight advantage over gperftools with aggressive decommit off in performance testing.

Upstream Impala should switch to building against Google TCMalloc by default. Google TCMalloc does not have an aggressive decommit mode, so that functionality would be left behind.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)