You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@avro.apache.org by Nishanth S <ch...@gmail.com> on 2015/06/26 22:20:42 UTC
Error when running Avro map reduce 2
Hello All,
I am getting the below error on running a map reduce job to ouput avro
files when running map reduce locally.
I am not setting the output schemas to Avrojob but I am setting them
in AvroMultipleOutputs.addNamedOutput since I have multiple schemas.Request
your help.
Avro version: 1.7.7
Hadoop : 2.5
2015-06-26 14:16:40 WARN LocalJobRunner:560 - job_local2030957284_0001
java.lang.Exception: java.lang.IllegalStateException: Writer schema for
output key was not set. Use AvroJob.setOutputKeySchema().
at
org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.lang.IllegalStateException: Writer schema for output key
was not set. Use AvroJob.setOutputKeySchema().
at
org.apache.avro.hadoop.io.AvroDatumConverterFactory.create(AvroDatumConverterFactory.java:94)
at
org.apache.avro.mapreduce.AvroKeyValueOutputFormat.getRecordWriter(AvroKeyValueOutputFormat.java:55)
at
org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.<init>(MapTask.java:624)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:744)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)