You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Davies Liu (JIRA)" <ji...@apache.org> on 2015/08/05 00:47:04 UTC

[jira] [Created] (SPARK-9620) generated UnsafeProjection does not support many columns or large exressions

Davies Liu created SPARK-9620:
---------------------------------

             Summary: generated UnsafeProjection does not support many columns or large exressions
                 Key: SPARK-9620
                 URL: https://issues.apache.org/jira/browse/SPARK-9620
             Project: Spark
          Issue Type: Bug
          Components: SQL
            Reporter: Davies Liu
            Priority: Critical


We put all the expressions in one function of UnsafeProjection, that could reach the 65k code size limit in JVM.

We should split them into multiple functions, like that we do for MutableProjection and SafeProjection.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org