You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Weston Pace (Jira)" <ji...@apache.org> on 2021/04/28 12:40:00 UTC
[jira] [Assigned] (ARROW-12584) [C++][Python] Expose method for
benchmarking tools to release unused memory from the allocators
[ https://issues.apache.org/jira/browse/ARROW-12584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Weston Pace reassigned ARROW-12584:
-----------------------------------
Assignee: Weston Pace
> [C++][Python] Expose method for benchmarking tools to release unused memory from the allocators
> -----------------------------------------------------------------------------------------------
>
> Key: ARROW-12584
> URL: https://issues.apache.org/jira/browse/ARROW-12584
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++, Python
> Reporter: Weston Pace
> Assignee: Weston Pace
> Priority: Major
>
> A team working on Arrow benchmarks encountered a problem where the mimalloc allocator was holding onto considerably more RAM than needed (at least 6GB and potentially more).
> Mimalloc offers the `mi_collect` non-standard API which forces mimalloc to release unused pages to the OS. We could expose this to be called by benchmarking tools to get consistent results and reduce the amount of RAM needed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)