You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Ian Hummel (JIRA)" <ji...@apache.org> on 2014/06/30 19:43:24 UTC

[jira] [Created] (SPARK-2331) SparkContext.emptyRDD has wrong return type

Ian Hummel created SPARK-2331:
---------------------------------

             Summary: SparkContext.emptyRDD has wrong return type
                 Key: SPARK-2331
                 URL: https://issues.apache.org/jira/browse/SPARK-2331
             Project: Spark
          Issue Type: Bug
    Affects Versions: 1.0.0
            Reporter: Ian Hummel


The return type for SparkContext.emptyRDD is EmptyRDD[T].

It should be RDD[T].  That means you have to add extra type annotations on code like the below (which creates a union of RDDs over some subset of paths in a folder)

val rdds = Seq("a", "b", "c").foldLeft[RDD[String]](sc.emptyRDD[String]) { (rdd, path) ⇒
          rdd.union(sc.textFile(path))
        }



--
This message was sent by Atlassian JIRA
(v6.2#6252)