You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Anupam sinha <ak...@gmail.com> on 2015/07/16 16:25:51 UTC
Error: java.lang.RuntimeException: org.apache.hive.com/esotericsoftware.kryo.KryoException:
Encountered unregistered class ID: 380
Hi Guys,
I am writing the simple hive query,Receiving the following error
intermittently. This error
presents itself for 30min-2hr then goes away.
Appreciate your help to resolve this issue.
Error: java.lang.RuntimeException:
org.apache.hive.com/esotericsoftware.kryo.KryoException:
Encountered unregistered class ID: 380
on hive server the following Hive jar is installed:
i have using kryo version 2.22
hive-exec-0.13.1-cdh5.2.1.jar
Task with the most failures(4):
-----
Task ID:
task_1436470122113_0171_m_000014
URL:
http://0.0.0.0:8088/taskdetails.jsp?jobid=job_1436470122113_0171&tipid=task_1436470122113_0171_m_000014
-----
Diagnostic Messages for this Task:
Error: java.lang.RuntimeException:
org.apache.hive.com.esotericsoftware.kryo.KryoException: Encountered
unregistered class ID: -245153628
Serialization trace:
startTimes (org.apache.hadoop.hive.ql.log.PerfLogger)
perfLogger (org.apache.hadoop.hive.ql.exec.MapJoinOperator)
childOperators (org.apache.hadoop.hive.ql.exec.TableScanOperator)
aliasToWork (org.apache.hadoop.hive.ql.plan.MapWork)
at org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:364)
at org.apache.hadoop.hive.ql.exec.Utilities.getMapWork(Utilities.java:275)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:254)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:440)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:433)
at
org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getRecordReader(CombineHiveInputFormat.java:587)
at
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.<init>(MapTask.java:169)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:429)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
Caused by: org.apache.hive.com.esotericsoftware.kryo.KryoException:
Encountered unregistered class ID: -245153628
Serialization trace:
startTimes (org.apache.hadoop.hive.ql.log.PerfLogger)
perfLogger (org.apache.hadoop.hive.ql.exec.MapJoinOperator)
childOperators (org.apache.hadoop.hive.ql.exec.TableScanOperator)
aliasToWork (org.apache.hadoop.hive.ql.plan.MapWork)
at
org.apache.hive.com.esotericsoftware.kryo.util.DefaultClassResolver.readClass(DefaultClassResolver.java:119)
at org.apache.hive.com.esotericsoftware.kryo.Kryo.readClass(Kryo.java:656)
at
org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:99)
at
org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
at org.apache.hive.com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:694)
at
org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)
at
org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
at
org.apache.hive.com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:776)
at
org.apache.hive.com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:112)
at
org.apache.hive.com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:18)
at org.apache.hive.com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:694)
at
org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)
at
org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
at
org.apache.hive.com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:776)
at
org.apache.hive.com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:139)
at
org.apache.hive.com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:17)
at org.apache.hive.com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:694)
at
org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)
at
org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
at org.apache.hive.com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:672)
at
org.apache.hadoop.hive.ql.exec.Utilities.deserializeObjectByKryo(Utilities.java:918)
at
org.apache.hadoop.hive.ql.exec.Utilities.deserializePlan(Utilities.java:826)
at
org.apache.hadoop.hive.ql.exec.Utilities.deserializePlan(Utilities.java:840)
at org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:333)
... 13 more
Container killed by the ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.mr.MapRedTask
MapReduce Jobs Launched:
Stage-Stage-11: Map: 4 Reduce: 10 Cumulative CPU: 50.73 sec HDFS Read:
291926017 HDFS Write: 1510 SUCCESS
Stage-Stage-10: Map: 4 Reduce: 10 Cumulative CPU: 266.46 sec HDFS
Read: 291926017 HDFS Write: 248288495 SUCCESS
Stage-Stage-14: Map: 2719 HDFS Read: 0 HDFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 5 minutes 17 seconds 190 msec
Error (2). Execution Failed.
2015-07-10 12:04:53 ERROR (2) in run_hive
-----
Thank you,
Anupam
Re: Error: java.lang.RuntimeException: org.apache.hive.com/esotericsoftware.kryo.KryoException:
Encountered unregistered class ID: 380
Posted by Xuefu Zhang <xz...@cloudera.com>.
Same as https://issues.apache.org/jira/browse/HIVE-11269?
On Thu, Jul 16, 2015 at 7:25 AM, Anupam sinha <ak...@gmail.com> wrote:
> Hi Guys,
>
> I am writing the simple hive query,Receiving the following error
> intermittently. This error
> presents itself for 30min-2hr then goes away.
>
> Appreciate your help to resolve this issue.
>
> Error: java.lang.RuntimeException:
> org.apache.hive.com/esotericsoftware.kryo.KryoException:
> Encountered unregistered class ID: 380
>
> on hive server the following Hive jar is installed:
>
> i have using kryo version 2.22
> hive-exec-0.13.1-cdh5.2.1.jar
>
>
> Task with the most failures(4):
> -----
> Task ID:
> task_1436470122113_0171_m_000014
>
> URL:
>
> http://0.0.0.0:8088/taskdetails.jsp?jobid=job_1436470122113_0171&tipid=task_1436470122113_0171_m_000014
> -----
> Diagnostic Messages for this Task:
> Error: java.lang.RuntimeException:
> org.apache.hive.com.esotericsoftware.kryo.KryoException: Encountered
> unregistered class ID: -245153628
> Serialization trace:
> startTimes (org.apache.hadoop.hive.ql.log.PerfLogger)
> perfLogger (org.apache.hadoop.hive.ql.exec.MapJoinOperator)
> childOperators (org.apache.hadoop.hive.ql.exec.TableScanOperator)
> aliasToWork (org.apache.hadoop.hive.ql.plan.MapWork)
> at org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:364)
> at org.apache.hadoop.hive.ql.exec.Utilities.getMapWork(Utilities.java:275)
> at
> org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:254)
> at
> org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:440)
> at
> org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:433)
> at
> org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getRecordReader(CombineHiveInputFormat.java:587)
> at
> org.apache.hadoop.mapred.MapTask$TrackedRecordReader.<init>(MapTask.java:169)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:429)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
> Caused by: org.apache.hive.com.esotericsoftware.kryo.KryoException:
> Encountered unregistered class ID: -245153628
> Serialization trace:
> startTimes (org.apache.hadoop.hive.ql.log.PerfLogger)
> perfLogger (org.apache.hadoop.hive.ql.exec.MapJoinOperator)
> childOperators (org.apache.hadoop.hive.ql.exec.TableScanOperator)
> aliasToWork (org.apache.hadoop.hive.ql.plan.MapWork)
> at
> org.apache.hive.com.esotericsoftware.kryo.util.DefaultClassResolver.readClass(DefaultClassResolver.java:119)
> at org.apache.hive.com.esotericsoftware.kryo.Kryo.readClass(Kryo.java:656)
> at
> org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:99)
> at
> org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
> at org.apache.hive.com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:694)
> at
> org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)
> at
> org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
> at
> org.apache.hive.com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:776)
> at
> org.apache.hive.com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:112)
> at
> org.apache.hive.com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:18)
> at org.apache.hive.com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:694)
> at
> org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)
> at
> org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
> at
> org.apache.hive.com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:776)
> at
> org.apache.hive.com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:139)
> at
> org.apache.hive.com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:17)
> at org.apache.hive.com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:694)
> at
> org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)
> at
> org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
> at org.apache.hive.com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:672)
> at
> org.apache.hadoop.hive.ql.exec.Utilities.deserializeObjectByKryo(Utilities.java:918)
> at
> org.apache.hadoop.hive.ql.exec.Utilities.deserializePlan(Utilities.java:826)
> at
> org.apache.hadoop.hive.ql.exec.Utilities.deserializePlan(Utilities.java:840)
> at org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:333)
> ... 13 more
>
> Container killed by the ApplicationMaster.
> Container killed on request. Exit code is 143
> Container exited with a non-zero exit code 143
>
> FAILED: Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.mr.MapRedTask
> MapReduce Jobs Launched:
> Stage-Stage-11: Map: 4 Reduce: 10 Cumulative CPU: 50.73 sec HDFS
> Read: 291926017 HDFS Write: 1510 SUCCESS
> Stage-Stage-10: Map: 4 Reduce: 10 Cumulative CPU: 266.46 sec HDFS
> Read: 291926017 HDFS Write: 248288495 SUCCESS
> Stage-Stage-14: Map: 2719 HDFS Read: 0 HDFS Write: 0 FAIL
> Total MapReduce CPU Time Spent: 5 minutes 17 seconds 190 msec
> Error (2). Execution Failed.
> 2015-07-10 12:04:53 ERROR (2) in run_hive
>
> -----
> Thank you,
> Anupam
>