You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Yuliya Feldman (JIRA)" <ji...@apache.org> on 2017/09/30 07:54:02 UTC
[jira] [Created] (ARROW-1627) Reducing memory footprint in
AllocationManager.BufferLedger
Yuliya Feldman created ARROW-1627:
-------------------------------------
Summary: Reducing memory footprint in AllocationManager.BufferLedger
Key: ARROW-1627
URL: https://issues.apache.org/jira/browse/ARROW-1627
Project: Apache Arrow
Issue Type: Improvement
Components: Java - Memory
Reporter: Yuliya Feldman
Currently we instantiate IdentityHashMap while creating an instance of AllocationManager which is in turn is part of BufferLedger
By default IdentityHashMap allocates an array of 64 objects which is 272 bytes of heap from the start. In reality a lot of ArrowBuf(s) will not need that many entries in the map, since they want share BufferAllocators with many other BufferLedgers.
Suggestion is to come up with different collection to save heap w/o sacrificing much of the performance (if any).
I have a suggestion in mind that I will share via a doc. later today
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)