You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Prannoy <pr...@sigmoidanalytics.com> on 2014/12/03 20:04:16 UTC

Re: How can I read an avro file in HDFS in Java?

Hi,
Try using
 sc.newAPIHadoopFile("<hdfs path to your file>",
        AvroSequenceFileInputFormat.class, AvroKey.class, AvroValue.class,
your Configuration)

You will get the Avro related classes by importing org.apache.avro.*

Thanks.

On Tue, Dec 2, 2014 at 9:23 PM, leaviva [via Apache Spark User List] <
ml-node+s1001560n20173h65@n3.nabble.com> wrote:

> How can I read an avro file in HDFS ?
> I try use newAPIHadoopFile but I don't know how can i use it
>
> ------------------------------
>  If you reply to this email, your message will be added to the discussion
> below:
>
> http://apache-spark-user-list.1001560.n3.nabble.com/How-can-I-read-an-avro-file-in-HDFS-in-Java-tp20173.html
>  To start a new topic under Apache Spark User List, email
> ml-node+s1001560n1h33@n3.nabble.com
> To unsubscribe from Apache Spark User List, click here
> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1&code=cHJhbm5veUBzaWdtb2lkYW5hbHl0aWNzLmNvbXwxfC0xNTI2NTg4NjQ2>
> .
> NAML
> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>




--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-can-I-read-an-avro-file-in-HDFS-in-Java-tp20173p20285.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.