You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Pindikura Ravindra (JIRA)" <ji...@apache.org> on 2019/06/03 05:42:00 UTC

[jira] [Created] (ARROW-5482) reduce heap footprint of ValueVectors

Pindikura Ravindra created ARROW-5482:
-----------------------------------------

             Summary: reduce heap footprint of ValueVectors
                 Key: ARROW-5482
                 URL: https://issues.apache.org/jira/browse/ARROW-5482
             Project: Apache Arrow
          Issue Type: Task
          Components: Java
            Reporter: Pindikura Ravindra
            Assignee: Pindikura Ravindra


In some scenarios, we hold lots of value vectors in memory eg. during join, aggregation. The heap analysis shows that the costs are as follows for a simple IntVector (used VisualVM on mac) :

 

IntVector : 80 bytes

vector.types.pojo.FieldType : 41 bytes

vector.types.pojo.Field : 40 bytes

IntReaderImpl : 28 bytes

 

I'll use this Jira to track ways to reduce the heap usage.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)