You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2018/07/10 19:27:00 UTC

[jira] [Commented] (IMPALA-6784) Upgrade gperftools to 2.6.90 or beyond

    [ https://issues.apache.org/jira/browse/IMPALA-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16539131#comment-16539131 ] 

Todd Lipcon commented on IMPALA-6784:
-------------------------------------

This is particularly important in clusters with a lot of Kudu scans, since the Kudu scanner ends up doing large mallocs for the response buffers coming from the servers.

> Upgrade gperftools to 2.6.90 or beyond
> --------------------------------------
>
>                 Key: IMPALA-6784
>                 URL: https://issues.apache.org/jira/browse/IMPALA-6784
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Backend
>    Affects Versions: Impala 2.13.0
>            Reporter: Michael Ho
>            Assignee: Bikramjeet Vig
>            Priority: Critical
>
> There are some pretty good improvements to TCMalloc in 2.6.90. Previous attempt to upgrade to 2.6.3 was reverted due to IMPALA-6414 which has been fixed since then.
> {noformat}
> gperftools 2.7rc is out!
> Changes:
> Most notable change in this release is that very large allocations (>1MiB) are now handled be O(log n) implementation. This is contributed by Todd Lipcon based on earlier work by Aliaksei Kandratsenka and James Golick. Special thanks to Alexey Serbin for contributing OSX fix for that commit.
> detection of sized deallocation support is improved. Which should fix another set of issues building on OSX. Much thanks to Alexey Serbin for reporting the issue, suggesting a fix and verifying it.
> Todd Lipcon made a change to extend page heaps freelists to 1 MiB (up from 1MiB - 8KiB). This may help a little for some workloads.
> Ishan Arora contributed typo fix to docs
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org