You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Robin Cheng (JIRA)" <ji...@apache.org> on 2015/08/25 18:37:45 UTC

[jira] [Created] (SPARK-10228) Integer overflow in VertexRDDImpl.count

Robin Cheng created SPARK-10228:
-----------------------------------

             Summary: Integer overflow in VertexRDDImpl.count
                 Key: SPARK-10228
                 URL: https://issues.apache.org/jira/browse/SPARK-10228
             Project: Spark
          Issue Type: Bug
          Components: GraphX
    Affects Versions: 1.4.1
            Reporter: Robin Cheng


VertexRDDImpl overrides RDD.count() but aggregates Int instead of Long:

/** The number of vertices in the RDD. */
  override def count(): Long = {
    partitionsRDD.map(_.size).reduce(_ + _)
  }

This causes Pregel to stop iterating when the number of messages is "negative", giving incorrect results.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org