You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by yanenli2 <ya...@gmail.com> on 2015/01/05 22:12:59 UTC
SparkSQL support for reading Avro files
Hi All,
I want to use the SparkSQL to manipulate the data with Avro format. I
found a solution at https://github.com/marmbrus/sql-avro . However it
doesn't compile successfully anymore with the latent code of Spark
version 1.2.0 or 1.2.1.
I then try to pull a copy from github stated at
http://mail-archives.apache.org/mod_mbox/spark-reviews/201409.mbox/%3Cgit-pr-2475-spark@git.apache.org%3E
by command:
git checkout 47d542cc0238fba04b6c4e4456393d812d559c4e
But it failed to pull this commit.
What can I do to make it work? Any plan for adding the Avro support in
SparkSQL?
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkSQL-support-for-reading-Avro-files-tp20981.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: SparkSQL support for reading Avro files
Posted by yanenli2 <ya...@gmail.com>.
thanks for the reply! Now I know that this package is moved here:
https://github.com/databricks/spark-avro
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkSQL-support-for-reading-Avro-files-tp20981p21040.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: SparkSQL support for reading Avro files
Posted by Michael Armbrust <mi...@databricks.com>.
Did you follow the link on that page?
THIS REPO HAS BEEN MOVED
<https://github.com/marmbrus/sql-avro#please-go-to-the-version-hosted-by-databricks>Please
go to the version hosted by databricks
<https://github.com/databricks/spark-avro>
On Mon, Jan 5, 2015 at 1:12 PM, yanenli2 <ya...@gmail.com> wrote:
> Hi All,
>
> I want to use the SparkSQL to manipulate the data with Avro format. I
> found a solution at https://github.com/marmbrus/sql-avro . However it
> doesn't compile successfully anymore with the latent code of Spark
> version 1.2.0 or 1.2.1.
>
>
> I then try to pull a copy from github stated at
>
>
>
> http://mail-archives.apache.org/mod_mbox/spark-reviews/201409.mbox/%3Cgit-pr-2475-spark@git.apache.org%3E
>
>
> by command:
>
>
> git checkout 47d542cc0238fba04b6c4e4456393d812d559c4e
>
>
> But it failed to pull this commit.
>
> What can I do to make it work? Any plan for adding the Avro support in
> SparkSQL?
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/SparkSQL-support-for-reading-Avro-files-tp20981.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>
Re: SparkSQL support for reading Avro files
Posted by Cheng Lian <li...@gmail.com>.
This package is moved here: https://github.com/databricks/spark-avro
On 1/6/15 5:12 AM, yanenli2 wrote:
> Hi All,
>
> I want to use the SparkSQL to manipulate the data with Avro format. I
> found a solution at https://github.com/marmbrus/sql-avro . However it
> doesn't compile successfully anymore with the latent code of Spark
> version 1.2.0 or 1.2.1.
>
>
> I then try to pull a copy from github stated at
>
>
> http://mail-archives.apache.org/mod_mbox/spark-reviews/201409.mbox/%3Cgit-pr-2475-spark@git.apache.org%3E
>
>
> by command:
>
>
> git checkout 47d542cc0238fba04b6c4e4456393d812d559c4e
>
>
> But it failed to pull this commit.
>
> What can I do to make it work? Any plan for adding the Avro support in
> SparkSQL?
>
>
>
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkSQL-support-for-reading-Avro-files-tp20981.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org