You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2016/06/15 00:45:14 UTC

[jira] [Assigned] (SPARK-15956) When unwrapping ORC avoid pattern matching at runtime

     [ https://issues.apache.org/jira/browse/SPARK-15956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-15956:
------------------------------------

    Assignee: Apache Spark

> When unwrapping ORC avoid pattern matching at runtime
> -----------------------------------------------------
>
>                 Key: SPARK-15956
>                 URL: https://issues.apache.org/jira/browse/SPARK-15956
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>            Reporter: Brian Cho
>            Assignee: Apache Spark
>            Priority: Minor
>
> When unwrapping ORC values, pattern matching for each data value at runtime hurts performance. This should be avoided.
> Instead, we can run pattern matching once and return a function that is subsequently used to unwrap each data value. This is already implemented for certain primitive types. We should implement for the remaining types, including complex types (e.g, list, map).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org