[jira] [Resolved] (SPARK-14838) Implement statistics in SerializeFromObject to avoid failure when estimating sizeInBytes for ObjectType

["Davies Liu (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-14838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Davies Liu resolved SPARK-14838.
--------------------------------
       Resolution: Fixed
    Fix Version/s: 2.0.0

Issue resolved by pull request 12599
[https://github.com/apache/spark/pull/12599]

> Implement statistics in SerializeFromObject to avoid failure when estimating sizeInBytes for ObjectType
> -------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-14838
>                 URL: https://issues.apache.org/jira/browse/SPARK-14838
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>            Reporter: Liang-Chi Hsieh
>             Fix For: 2.0.0
>
>
> Spark will determine the plan size to automatically broadcast it or not when doing join. As it can't estimate object type size, this mechanism will throw failure as shown in https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/56533/consoleFull. We should fix it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org