You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Weston Pace (Jira)" <ji...@apache.org> on 2021/04/28 12:39:00 UTC

[jira] [Created] (ARROW-12584) [C++][Python] Expose method for benchmarking tools to release unused memory from the allocators

Weston Pace created ARROW-12584:
-----------------------------------

             Summary: [C++][Python] Expose method for benchmarking tools to release unused memory from the allocators
                 Key: ARROW-12584
                 URL: https://issues.apache.org/jira/browse/ARROW-12584
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++, Python
            Reporter: Weston Pace


A team working on Arrow benchmarks encountered a problem where the mimalloc allocator was holding onto considerably more RAM than needed (at least 6GB and potentially more).

Mimalloc offers the `mi_collect` non-standard API which forces mimalloc to release unused pages to the OS.  We could expose this to be called by benchmarking tools to get consistent results and reduce the amount of RAM needed.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)