You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2015/04/13 13:03:12 UTC

[jira] [Commented] (SPARK-6878) Sum on empty RDD fails with exception

    [ https://issues.apache.org/jira/browse/SPARK-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14492271#comment-14492271 ] 

Sean Owen commented on SPARK-6878:
----------------------------------

Interesting question -- what's the expected sum of nothing at all? although I can see the argument both ways, 0 is probably the better result since {{Array[Double]().sum}} is 0. So {{sc.parallelize(Array[Double]()).sum}} should as well. Want to make a PR?

> Sum on empty RDD fails with exception
> -------------------------------------
>
>                 Key: SPARK-6878
>                 URL: https://issues.apache.org/jira/browse/SPARK-6878
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 1.2.0
>            Reporter: Erik van Oosten
>            Priority: Minor
>
> {{Sum}} on an empty RDD throws an exception. Expected result is {{0}}.
> A simple fix is the replace
> {noformat}
> class DoubleRDDFunctions {
>   def sum(): Double = self.reduce(_ + _)
> {noformat} 
> with:
> {noformat}
> class DoubleRDDFunctions {
>   def sum(): Double = self.aggregate(0.0)(_ + _, _ + _)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org