You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Davies Liu (JIRA)" <ji...@apache.org> on 2016/03/22 00:25:25 UTC

[jira] [Created] (SPARK-14052) Build BytesToBytesMap in HashedRelation

Davies Liu created SPARK-14052:
----------------------------------

             Summary: Build BytesToBytesMap in HashedRelation
                 Key: SPARK-14052
                 URL: https://issues.apache.org/jira/browse/SPARK-14052
             Project: Spark
          Issue Type: Improvement
          Components: SQL
            Reporter: Davies Liu
            Assignee: Davies Liu


Currently, for the key that can not fit within a long,  we build a hash map for UnsafeHashedRelation, it's converted to BytesToBytesMap after serialization and deserialization.

We should build a BytesToBytesMap directly to have better memory efficiency.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org