You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Joanne Contact <jo...@gmail.com> on 2015/03/28 05:38:27 UTC

unable to read avro file

Hi I am following the instruction on this website.
http://www.infoobjects.com/spark-with-avro/

I installed the sparkavro libary on https://github.com/databricks/spark-avro
on a machine which only has hive gateway client role on a hadoop cluster.

somehow I got error on reading the avro file.

scala> val ufos =
sqlContext.avroFile("hdfs://sssssss/xxxxx/iiiiiiiiiii/iiiiiiiiiiiAaaaSsssss/hhhhhh/2222/00/22/22/iiiiiiiiiiiAaaaSsssss.6.11.469465.2099222123.1427497200000.avro")

<console>:20: error: erroneous or inaccessible type
       val ufos =
sqlContext.avroFile("hdfs://sssssss/xxxxx/iiiiiiiiiii/iiiiiiiiiiiAaaaSsssss/hhhhhh/2222/00/22/22/iiiiiiiiiiiAaaaSsssss.6.11.469465.2099222123.1427497200000.avro")

Any advice please?

Thank you!

J

Re: unable to read avro file

Posted by Joanne Contact <jo...@gmail.com>.

never mind. find my spark is still 1.2 but the avro library requires 1.3.
will try again.

On Fri, Mar 27, 2015 at 9:38 PM, Joanne Contact <jo...@gmail.com>
wrote:

> Hi I am following the instruction on this website.
> http://www.infoobjects.com/spark-with-avro/
>
> I installed the sparkavro libary on https://
> github.com/databricks/spark-avro
> on a machine which only has hive gateway client role on a hadoop cluster.
>
> somehow I got error on reading the avro file.
>
> scala> val ufos =
> sqlContext.avroFile("hdfs://sssssss/xxxxx/iiiiiiiiiii/iiiiiiiiiiiAaaaSsssss/hhhhhh/2222/00/22/22/iiiiiiiiiiiAaaaSsssss.6.11.469465.
> 2099222123.1427497200000.avro")
>
> <console>:20: error: erroneous or inaccessible type
>        val ufos =
> sqlContext.avroFile("hdfs://sssssss/xxxxx/iiiiiiiiiii/iiiiiiiiiiiAaaaSsssss/hhhhhh/2222/00/22/22/iiiiiiiiiiiAaaaSsssss.6.11.469465.
> 2099222123.1427497200000.avro")
>
> Any advice please?
>
> Thank you!
>
> J
>