You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by bchazalet <bc...@companywatch.net> on 2015/01/05 12:11:52 UTC
spark 1.2: value toJSON is not a member of
org.apache.spark.sql.SchemaRDD
Hi everyone,
I have just switched to spark 1.2.0 from 1.1.1, updating my sbt to point to
the 1.2.0 jars.
"org.apache.spark" %% "spark-core" % "1.2.0",
"org.apache.spark" %% "spark-sql" % "1.2.0",
"org.apache.spark" %% "spark-hive" % "1.2.0",
I was hoping to use the new SchemaRDD#toJSON among other features, but it
seems that this method is not available in the 1.2.0 spark-sql jars. I did a
'javap SchemaRDD.class | grep toJSON' on the unarchived
spark-sql_2.10-1.2.0.jar that I got from maven, but it's not there.
The SchemaRDD#toJson is present in the source
<https://github.com/apache/spark/blob/branch-1.2/sql/core/src/main/scala/org/apache/spark/sql/SchemaRDD.scala>
within the branch-1.2 branch though.
I am missing something? Or wasn't that feature shipped with 1.2?
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-1-2-value-toJSON-is-not-a-member-of-org-apache-spark-sql-SchemaRDD-tp20972.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: spark 1.2: value toJSON is not a member of org.apache.spark.sql.SchemaRDD
Posted by Michael Armbrust <mi...@databricks.com>.
I think you are missing something:
$ javap -cp ~/Downloads/spark-sql_2.10-1.2.0.jar
org.apache.spark.sql.SchemaRDD|grep toJSON
public org.apache.spark.rdd.RDD<java.lang.String> toJSON();
On Mon, Jan 5, 2015 at 3:11 AM, bchazalet <bc...@companywatch.net>
wrote:
> Hi everyone,
>
> I have just switched to spark 1.2.0 from 1.1.1, updating my sbt to point to
> the 1.2.0 jars.
>
> "org.apache.spark" %% "spark-core" % "1.2.0",
> "org.apache.spark" %% "spark-sql" % "1.2.0",
> "org.apache.spark" %% "spark-hive" % "1.2.0",
>
> I was hoping to use the new SchemaRDD#toJSON among other features, but it
> seems that this method is not available in the 1.2.0 spark-sql jars. I did
> a
> 'javap SchemaRDD.class | grep toJSON' on the unarchived
> spark-sql_2.10-1.2.0.jar that I got from maven, but it's not there.
>
> The SchemaRDD#toJson is present in the source
> <
> https://github.com/apache/spark/blob/branch-1.2/sql/core/src/main/scala/org/apache/spark/sql/SchemaRDD.scala
> >
> within the branch-1.2 branch though.
>
> I am missing something? Or wasn't that feature shipped with 1.2?
>
>
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/spark-1-2-value-toJSON-is-not-a-member-of-org-apache-spark-sql-SchemaRDD-tp20972.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>