You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@avro.apache.org by Vignesh Srinivasan <sv...@gmail.com> on 2013/10/21 23:01:40 UTC
Joining Avro and sequence File
Hi
I am trying to join a Avro file and a sequence file in hadoop. I tried
using MultipleInputs.
MultipleInputs.addInputPath(jobConf, new Path("avrofile"),
classOf[AvroInputFormat[AvroData]], classOf[AvroDataMapper])
MultipleInputs.addInputPath(jobConf, new Path("SeqFile"),
classOf[SequenceFileInputFormat[Text, Text]], classOf[SequenceMapper])
AvroJob.setInputSchema(jobConf, AvroData.getClassSchema)
Now I get the below error.
java.lang.ClassCastException: org.apache.hadoop.io.Text cannot be cast to
org.apache.avro.mapred.AvroWrapper
I think the error is because sequence file takes [Text,Text] as input. Not
sure how I could work this around. Any help will be highly appreciated.
thanks
Vignesh