You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Davies Liu (JIRA)" <ji...@apache.org> on 2015/10/05 22:01:26 UTC

[jira] [Resolved] (SPARK-10585) only copy data once when generate unsafe projection

     [ https://issues.apache.org/jira/browse/SPARK-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Davies Liu resolved SPARK-10585.
--------------------------------
       Resolution: Fixed
    Fix Version/s: 1.6.0

Issue resolved by pull request 8747
[https://github.com/apache/spark/pull/8747]

> only copy data once when generate unsafe projection
> ---------------------------------------------------
>
>                 Key: SPARK-10585
>                 URL: https://issues.apache.org/jira/browse/SPARK-10585
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>            Reporter: Wenchen Fan
>             Fix For: 1.6.0
>
>
> When we have nested struct, array or map, we will create a byte buffer for each of them, and copy data to the buffer first, then copy them to the final row buffer. We can save the first copy and directly copy data to final row buffer.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org