You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by ๏̯͡๏ <ÐΞ€ρ@Ҝ>,
de...@gmail.com on 2014/01/24 18:25:59 UTC
Exception at org.apache.avro.io.parsing.Symbol$Alternative.getSymbol
I got the below error after running a M/R job with Avro input and output.
Version: 1.7.6
Any suggestions as to when can this error occur ?
Trace:
2014-01-24 10:23:46,473 INFO org.apache.hadoop.io.nativeio.NativeIO: Got
UserName hadoop for UID 680 from the native implementation
2014-01-24 10:23:46,475 WARN org.apache.hadoop.mapred.Child: Error running
child
java.lang.ArrayIndexOutOfBoundsException: 40
at org.apache.avro.io.parsing.Symbol$Alternative.getSymbol(Symbol.java:364)
at org.apache.avro.io.ResolvingDecoder.doAction(ResolvingDecoder.java:229)
at org.apache.avro.io.parsing.Parser.advance(Parser.java:88)
at org.apache.avro.io.ResolvingDecoder.readIndex(ResolvingDecoder.java:206)
at
org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:155)
at
org.apache.avro.generic.GenericDatumReader.readField(GenericDatumReader.java:193)
at
org.apache.avro.reflect.ReflectDatumReader.readField(ReflectDatumReader.java:230)
at
org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:183)
at
org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:151)
at
org.apache.avro.generic.GenericDatumReader.readField(GenericDatumReader.java:193)
at
org.apache.avro.reflect.ReflectDatumReader.readField(ReflectDatumReader.java:230)
at
org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:183)
at
org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:151)
at
org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:142)
at
org.apache.avro.hadoop.io.AvroDeserializer.deserialize(AvroDeserializer.java:122)
at
org.apache.avro.hadoop.io.AvroDeserializer.deserialize(AvroDeserializer.java:48)
at
org.apache.hadoop.mapreduce.ReduceContext.nextKeyValue(ReduceContext.java:117)
at org.apache.hadoop.mapreduce.ReduceContext.nextKey(ReduceContext.java:92)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:649)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:418)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
2014-01-24 10:23:46,477 INFO org.apache.hadoop.mapred.Task: Runnning
cleanup for the task
--
Deepak
Re: Exception at org.apache.avro.io.parsing.Symbol$Alternative.getSymbol
Posted by ๏̯͡๏ <ÐΞ€ρ@Ҝ>,
de...@gmail.com.
A reduce task/30 had 5 attempts, all of them failed with above error and
hence M/R job failed.
On Fri, Jan 24, 2014 at 10:55 PM, ÐΞ€ρ@Ҝ (๏̯͡๏) <de...@gmail.com> wrote:
> I got the below error after running a M/R job with Avro input and output.
> Version: 1.7.6
>
> Any suggestions as to when can this error occur ?
>
> Trace:
>
> 2014-01-24 10:23:46,473 INFO org.apache.hadoop.io.nativeio.NativeIO: Got
> UserName hadoop for UID 680 from the native implementation
>
> 2014-01-24 10:23:46,475 WARN org.apache.hadoop.mapred.Child: Error running
> child
>
> java.lang.ArrayIndexOutOfBoundsException: 40
>
> at org.apache.avro.io.parsing.Symbol$Alternative.getSymbol(Symbol.java:364)
>
> at org.apache.avro.io.ResolvingDecoder.doAction(ResolvingDecoder.java:229)
>
> at org.apache.avro.io.parsing.Parser.advance(Parser.java:88)
>
> at org.apache.avro.io.ResolvingDecoder.readIndex(ResolvingDecoder.java:206)
>
> at
> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:155)
>
> at
> org.apache.avro.generic.GenericDatumReader.readField(GenericDatumReader.java:193)
>
> at
> org.apache.avro.reflect.ReflectDatumReader.readField(ReflectDatumReader.java:230)
>
> at
> org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:183)
>
> at
> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:151)
>
> at
> org.apache.avro.generic.GenericDatumReader.readField(GenericDatumReader.java:193)
>
> at
> org.apache.avro.reflect.ReflectDatumReader.readField(ReflectDatumReader.java:230)
>
> at
> org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:183)
>
> at
> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:151)
>
> at
> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:142)
>
> at
> org.apache.avro.hadoop.io.AvroDeserializer.deserialize(AvroDeserializer.java:122)
>
> at
> org.apache.avro.hadoop.io.AvroDeserializer.deserialize(AvroDeserializer.java:48)
>
> at
> org.apache.hadoop.mapreduce.ReduceContext.nextKeyValue(ReduceContext.java:117)
>
> at org.apache.hadoop.mapreduce.ReduceContext.nextKey(ReduceContext.java:92)
>
> at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
>
> at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:649)
>
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:418)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:396)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
>
> at org.apache.hadoop.mapred.Child.main(Child.java:249)
>
> 2014-01-24 10:23:46,477 INFO org.apache.hadoop.mapred.Task: Runnning
> cleanup for the task
>
> --
> Deepak
>
>
--
Deepak
Re: Exception at org.apache.avro.io.parsing.Symbol$Alternative.getSymbol
Posted by ๏̯͡๏ <ÐΞ€ρ@Ҝ>,
de...@gmail.com.
A reduce task/30 had 5 attempts, all of them failed with above error and
hence M/R job failed.
On Fri, Jan 24, 2014 at 10:55 PM, ÐΞ€ρ@Ҝ (๏̯͡๏) <de...@gmail.com> wrote:
> I got the below error after running a M/R job with Avro input and output.
> Version: 1.7.6
>
> Any suggestions as to when can this error occur ?
>
> Trace:
>
> 2014-01-24 10:23:46,473 INFO org.apache.hadoop.io.nativeio.NativeIO: Got
> UserName hadoop for UID 680 from the native implementation
>
> 2014-01-24 10:23:46,475 WARN org.apache.hadoop.mapred.Child: Error running
> child
>
> java.lang.ArrayIndexOutOfBoundsException: 40
>
> at org.apache.avro.io.parsing.Symbol$Alternative.getSymbol(Symbol.java:364)
>
> at org.apache.avro.io.ResolvingDecoder.doAction(ResolvingDecoder.java:229)
>
> at org.apache.avro.io.parsing.Parser.advance(Parser.java:88)
>
> at org.apache.avro.io.ResolvingDecoder.readIndex(ResolvingDecoder.java:206)
>
> at
> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:155)
>
> at
> org.apache.avro.generic.GenericDatumReader.readField(GenericDatumReader.java:193)
>
> at
> org.apache.avro.reflect.ReflectDatumReader.readField(ReflectDatumReader.java:230)
>
> at
> org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:183)
>
> at
> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:151)
>
> at
> org.apache.avro.generic.GenericDatumReader.readField(GenericDatumReader.java:193)
>
> at
> org.apache.avro.reflect.ReflectDatumReader.readField(ReflectDatumReader.java:230)
>
> at
> org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:183)
>
> at
> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:151)
>
> at
> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:142)
>
> at
> org.apache.avro.hadoop.io.AvroDeserializer.deserialize(AvroDeserializer.java:122)
>
> at
> org.apache.avro.hadoop.io.AvroDeserializer.deserialize(AvroDeserializer.java:48)
>
> at
> org.apache.hadoop.mapreduce.ReduceContext.nextKeyValue(ReduceContext.java:117)
>
> at org.apache.hadoop.mapreduce.ReduceContext.nextKey(ReduceContext.java:92)
>
> at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
>
> at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:649)
>
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:418)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:396)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
>
> at org.apache.hadoop.mapred.Child.main(Child.java:249)
>
> 2014-01-24 10:23:46,477 INFO org.apache.hadoop.mapred.Task: Runnning
> cleanup for the task
>
> --
> Deepak
>
>
--
Deepak