You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Anubhav Agarwal <an...@gmail.com> on 2015/05/20 20:06:36 UTC
Mapreduce Hcatalog upgrade issue
Hi,
My code was working with CDH 5.3 but after upgrading the code to 5.4 I am
getting the following error while using Hcatalog:-
Task Logs: 'attempt_201505131431_0013_m_000030_1'
*stdout logs*
------------------------------
*stderr logs*
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/opt/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/mapred/local/taskTracker/cloudera/jobcache/job_201505131431_0013/jars/job.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/mapred/local/taskTracker/distcache/-8482588650269571027_-1142469741_1919960239/master.cloudera/tmp/temp-2016036914/tmp-1892709241/slf4j-log4j12.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
------------------------------
*syslog logs*
2015-05-20 13:51:24,609 WARN mapreduce.Counters: Group
org.apache.hadoop.mapred.Task$Counter is deprecated. Use
org.apache.hadoop.mapreduce.TaskCounter instead
2015-05-20 13:51:25,323 INFO org.apache.hadoop.mapred.TaskRunner:
Creating symlink:
/mapred/local/taskTracker/distcache/-3321617315377295081_1858235370_1919948628/master.cloudera/tmp/temp-2016036914/tmp-488467356
<- /mapred/local/taskTracker/cloudera/jobcache/job_201505131431_0013/attempt_201505131431_0013_m_000030_1/work/pigrepl_scope-17_1531833640_1432144269081_1
2015-05-20 13:51:25,331 INFO
org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating
symlink: /mapred/local/taskTracker/cloudera/jobcache/job_201505131431_0013/jars/job.jar
<- /mapred/local/taskTracker/cloudera/jobcache/job_201505131431_0013/attempt_201505131431_0013_m_000030_1/work/job.jar
2015-05-20 13:51:25,333 INFO
org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating
symlink: /mapred/local/taskTracker/cloudera/jobcache/job_201505131431_0013/jars/.job.jar.crc
<- /mapred/local/taskTracker/cloudera/jobcache/job_201505131431_0013/attempt_201505131431_0013_m_000030_1/work/.job.jar.crc
2015-05-20 13:51:25,413 INFO
org.apache.hadoop.conf.Configuration.deprecation: session.id is
deprecated. Instead, use dfs.metrics.session-id
2015-05-20 13:51:25,414 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=MAP, sessionId=
2015-05-20 13:51:26,328 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2015-05-20 13:51:26,332 FATAL org.apache.hadoop.mapred.Child: Error
running child : java.lang.NoSuchFieldError: CHAR
at org.apache.hive.hcatalog.data.schema.HCatFieldSchema$Type.<clinit>(HCatFieldSchema.java:54)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at java.lang.Class.getEnumConstantsShared(Class.java:3085)
at java.lang.Class.enumConstantDirectory(Class.java:3106)
at java.lang.Enum.valueOf(Enum.java:231)
at java.io.ObjectInputStream.readEnum(ObjectInputStream.java:1741)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
at java.util.ArrayList.readObject(ArrayList.java:771)
at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
at java.util.Hashtable.readObject(Hashtable.java:996)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
at java.util.HashMap.readObject(HashMap.java:1180)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
at org.apache.pig.impl.util.ObjectSerializer.deserialize(ObjectSerializer.java:57)
at org.apache.pig.impl.util.UDFContext.deserialize(UDFContext.java:192)
at org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil.setupUDFContext(MapRedUtil.java:173)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.setupUdfEnvAndStores(PigOutputFormat.java:229)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getOutputCommitter(PigOutputFormat.java:275)
at org.apache.hadoop.mapred.Task.initialize(Task.java:523)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:313)
at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
at org.apache.hadoop.mapred.Child.main(Child.java:262)