[jira] [Resolved] (SPARK-15964) Assignment to RDD-typed val fails

["Michael Armbrust (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael Armbrust resolved SPARK-15964.
--------------------------------------
    Resolution: Won't Fix

> Assignment to RDD-typed val fails
> ---------------------------------
>
>                 Key: SPARK-15964
>                 URL: https://issues.apache.org/jira/browse/SPARK-15964
>             Project: Spark
>          Issue Type: Bug
>    Affects Versions: 2.0.0
>         Environment: Notebook on Databricks Community-Edition 
> Spark-2.0 preview
> Google Chrome Browser
> Linux Ubuntu 14.04 LTS
>            Reporter: Sanjay Dasgupta
>
> Unusual assignment error, giving the following error message:
> found : org.apache.spark.rdd.RDD[Name]
> required : org.apache.spark.rdd.RDD[Name]
> This occurs when the assignment is attempted in a cell that is different from the cell in which the item on the right-hand-side is defined. As in the following example:
> // CELL-1
> import org.apache.spark.sql.Dataset
> import org.apache.spark.rdd.RDD
> case class Name(number: Int, name: String)
> val names = Seq(Name(1, "one"), Name(2, "two"), Name(3, "three"), Name(4, "four"))
> val dataset: Dataset[Name] = spark.sparkContext.parallelize(names).toDF.as[Name]
> // CELL-2
> // Error reported here ...
> val dataRdd: RDD[Name] = dataset.rdd
> The error is reported in CELL-2



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org