You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hive.apache.org by Krishna Rao <kr...@gmail.com> on 2013/02/07 11:45:32 UTC

NoClassDefFoundError: org/apache/hadoop/mapreduce/util/HostUtil

Hi all,

I'm occasionally getting the following error, usually after running an
expensive Hive query (creating 20 or so MR jobs):

***
Error during job, obtaining debugging information...
Examining task ID: task_201301291405_1640_r_000001 (and more) from job
job_201301291405_1640
Exception in thread "Thread-29" java.lang.NoClassDefFoundError:
org/apache/hadoop/mapreduce/util/HostUtil
        at
org.apache.hadoop.hive.shims.Hadoop23Shims.getTaskAttemptLogUrl(Hadoop23Shims.java:51)
        at
org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.getTaskInfos(JobDebugger.java:186)
        at
org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.run(JobDebugger.java:142)
        at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.mapreduce.util.HostUtil
        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
        ... 4 more
CmdRunner::runCmd: Error running cmd in script, error: FAILED: Execution
Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
***

Any ideas on what's causing it?
How can I find out more info on this error?

Cheers,

Krishna