[jira] [Commented] (ARROW-1627) [JAVA] Reduce heap usage(Phase 2) - memory footprint in AllocationManager.BufferLedger

["Rok Mihevc (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-1627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17658660#comment-17658660 ] 

Rok Mihevc commented on ARROW-1627:
-----------------------------------

This issue has been migrated to [issue #17638|https://github.com/apache/arrow/issues/17638] on GitHub. Please see the [migration documentation|https://github.com/apache/arrow/issues/14542] for further details.

> [JAVA] Reduce heap usage(Phase 2) - memory footprint in AllocationManager.BufferLedger
> --------------------------------------------------------------------------------------
>
>                 Key: ARROW-1627
>                 URL: https://issues.apache.org/jira/browse/ARROW-1627
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Java
>            Reporter: Yuliya Feldman
>            Assignee: Yuliya Feldman
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 0.8.0
>
>
> Currently we instantiate IdentityHashMap while creating an instance of AllocationManager which is in turn is part of BufferLedger
> By default IdentityHashMap allocates an array of 64 objects which is 272 bytes of heap from the start. In reality a lot of ArrowBuf(s) will not need that many entries in the map, since they want share BufferAllocators with many other BufferLedgers.
> Suggestion is to come up with different collection to save heap w/o sacrificing much of the performance (if any).
> I have a suggestion in mind that I will share via a doc. later today



--
This message was sent by Atlassian Jira
(v8.20.10#820010)