You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2021/05/12 14:54:00 UTC

[jira] [Resolved] (ARROW-12584) [C++][Python] Expose method for benchmarking tools to release unused memory from the allocators

     [ https://issues.apache.org/jira/browse/ARROW-12584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Antoine Pitrou resolved ARROW-12584.
------------------------------------
    Fix Version/s: 5.0.0
       Resolution: Fixed

Issue resolved by pull request 10186
[https://github.com/apache/arrow/pull/10186]

> [C++][Python] Expose method for benchmarking tools to release unused memory from the allocators
> -----------------------------------------------------------------------------------------------
>
>                 Key: ARROW-12584
>                 URL: https://issues.apache.org/jira/browse/ARROW-12584
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++, Python
>            Reporter: Weston Pace
>            Assignee: Weston Pace
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 5.0.0
>
>          Time Spent: 2h
>  Remaining Estimate: 0h
>
> A team working on Arrow benchmarks encountered a problem where the mimalloc allocator was holding onto considerably more RAM than needed (at least 6GB and potentially more).
> Mimalloc offers the `mi_collect` non-standard API which forces mimalloc to release unused pages to the OS.  We could expose this to be called by benchmarking tools to get consistent results and reduce the amount of RAM needed.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)