You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by John Villa <jo...@gmail.com> on 2010/01/21 21:37:54 UTC
Hive Execution Errors
Has anyone seen this error? Any help is appreciated, thanks;
hive> select * from apachelog where host ="64.62.191.114";
Total MapReduce jobs = 1
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_201001211744_0002, Tracking URL =
http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
Kill Command = /u01/hadoop/bin/../bin/hadoop job
-Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
2010-01-21 07:24:38,198 map = 0%, reduce =0%
2010-01-21 07:25:15,029 map = 100%, reduce =100%
Ended Job = job_201001211744_0002 with errors
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.ExecDriver
Re: Hive Execution Errors
Posted by John Villa <jo...@gmail.com>.
I just ran the job again and looking at the raw logs on the filesystem I get
the same;
2010-01-21 22:52:17,490 ERROR DataNucleus.Plugin
(Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
"org.eclipse.core.resources" but it cannot be resolved.
2010-01-21 22:52:17,490 ERROR DataNucleus.Plugin
(Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
"org.eclipse.core.resources" but it cannot be resolved.
2010-01-21 22:52:17,492 ERROR DataNucleus.Plugin
(Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
"org.eclipse.core.runtime" but it cannot be resolved.
2010-01-21 22:52:17,492 ERROR DataNucleus.Plugin
(Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
"org.eclipse.core.runtime" but it cannot be resolved.
2010-01-21 22:52:17,492 ERROR DataNucleus.Plugin
(Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
"org.eclipse.text" but it cannot be resolved.
2010-01-21 22:52:17,492 ERROR DataNucleus.Plugin
(Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
"org.eclipse.text" but it cannot be resolved.
2010-01-21 22:52:49,430 ERROR ql.Driver (SessionState.java:printError(279))
- FAILED: Parse Error: line 1:0 cannot recognize input 'clear'
org.apache.hadoop.hive.ql.parse.ParseException: line 1:0 cannot recognize
input 'clear'
at
org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:357)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:241)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:281)
at
org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:123)
at
org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:181)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:287)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
2010-01-21 22:53:21,144 WARN mapred.JobClient
(JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
for parsing the arguments. Applications should implement Tool for the same.
2010-01-21 22:53:53,788 ERROR exec.ExecDriver
(SessionState.java:printError(279)) - Ended Job = job_201001211744_0018 with
errors
2010-01-21 22:53:53,815 ERROR ql.Driver (SessionState.java:printError(279))
- FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.ExecDriver
Thanks a lot for looking into this.
Thanks,
-John
On Thu, Jan 21, 2010 at 5:48 PM, John Villa <jo...@gmail.com>wrote:
> Here is the output;
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
>
>
>
>
>
>
>
> On Thu, Jan 21, 2010 at 5:33 PM, John Villa <jo...@gmail.com>wrote:
>
>> I am currently using hadoop 0.20.1. When I installed ant I did
>> -Dhadoop.version="0.20.0"
>> I will try and get you that output but my connection is rough right now
>> and I need to do a little port forwarding. I will get it to you when i can.
>>
>>
>>
>> On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang <nz...@facebook.com> wrote:
>>
>>> Which hadoop version are you using (you can see it by running 'hadoop
>>> version')? Have you specified hadoop.version when you compile Hive? Are they
>>> match?
>>>
>>> Also can you post the log file found through the Tracking URL when you
>>> launch the job (in your example http://master:50030/jobdetails.jsp...)?
>>> The log files can be found by click through the mappers/reducers and at the
>>> rightmost column of the mapper/reducer stats.
>>>
>>>
>>> On Jan 21, 2010, at 1:37 PM, John Villa wrote:
>>>
>>> I did not see any hive jar files within hadoop lib directory. I compiled
>>> it using ant and the basic readme.
>>>
>>> On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang <nz...@facebook.com> wrote:
>>>
>>>> It may be because you have 2 copies of Hive's jar files (e.g., one in
>>>> Hadoop's lib directory and one in Hive's lib directory) and they are from
>>>> different releases. If you have compiled Hive trunk yoruself please make
>>>> sure no Hive's jar files in the Hadoop's directory.
>>>>
>>>>
>>>> On Jan 21, 2010, at 12:51 PM, John Villa wrote:
>>>>
>>>> Here is what I got from the hive log;
>>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>> "org.eclipse.core.resources" but it cannot be resolved.
>>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>> "org.eclipse.core.resources" but it cannot be resolved.
>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>> "org.eclipse.text" but it cannot be resolved.
>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>> "org.eclipse.text" but it cannot be resolved.
>>>> 2010-01-21 20:49:18,719 WARN mapred.JobClient
>>>> (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
>>>> for parsing the arguments. Applications should implement Tool for the same.
>>>> 2010-01-21 20:49:55,514 ERROR exec.ExecDriver
>>>> (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
>>>> errors
>>>> 2010-01-21 20:49:55,550 ERROR ql.Driver
>>>> (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2
>>>> from org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>
>>>>
>>>> On Thu, Jan 21, 2010 at 3:37 PM, John Villa <jo...@gmail.com>wrote:
>>>>
>>>>> Has anyone seen this error? Any help is appreciated, thanks;
>>>>>
>>>>> hive> select * from apachelog where host ="64.62.191.114";
>>>>> Total MapReduce jobs = 1
>>>>> Number of reduce tasks is set to 0 since there's no reduce operator
>>>>> Starting Job = job_201001211744_0002, Tracking URL =
>>>>> http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
>>>>> Kill Command = /u01/hadoop/bin/../bin/hadoop job
>>>>> -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
>>>>> 2010-01-21 07:24:38,198 map = 0%, reduce =0%
>>>>> 2010-01-21 07:25:15,029 map = 100%, reduce =100%
>>>>> Ended Job = job_201001211744_0002 with errors
>>>>> FAILED: Execution Error, return code 2 from
>>>>> org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>
>
Re: Hive Execution Errors
Posted by Edward Capriolo <ed...@gmail.com>.
John,
Just a side note a couple people have mentioned that the regex serde
is much slower then the standard serde, you may want to consider pre
processing the logs and inserting cntl+a or some other single byte
delimeter.
On 1/22/10, John Villa <jo...@gmail.com> wrote:
> Thanks a lot I appreciate that! It works :) I will be doing testing today
> and thankyou. Is there a way to auto implement adding the jar file? Are
> there any other jar files I may need within the /lib directory? Again thanks
> for the help.
> Thanks,
>
> On Thu, Jan 21, 2010 at 7:50 PM, Ning Zhang <nz...@facebook.com> wrote:
>
>> John, you don't need to change the jar file names if it is release 0.4.0.
>> As Carl just pointed out, you can just run add jar... in the same way you
>> have done when you create the table. This will distribute the jar file
>> distributed to the Hadoop cluster.
>>
>>
>> On Jan 21, 2010, at 4:43 PM, John Villa wrote:
>>
>> I cant even remember which version of hive I have installed but I believe
>> it is release 4. How to I go about renaming these hive jar files?
>> hive_foo-0.4.0.jar ?
>> Thanks,
>>
>> On Thu, Jan 21, 2010 at 7:38 PM, John Villa
>> <jo...@gmail.com>wrote:
>>
>>> I will change the names soon and let you guys know. Home with the dogs
>>> bothering me hehe.
>>> Thanks,
>>>
>>>
>>> On Thu, Jan 21, 2010 at 7:34 PM, John Villa
>>> <jo...@gmail.com>wrote:
>>>
>>>> Thanks for the info. The only adding of jar files I did was this when
>>>> creating a tables;
>>>>
>>>> add jar ../build/contrib/hive_contrib.jar;
>>>>
>>>>
>>>>
>>>>
>>>> On Thu, Jan 21, 2010 at 7:00 PM, Ning Zhang <nz...@facebook.com> wrote:
>>>>
>>>>> Thanks Carl. I'll take a look at the patch for HIVE-1063.
>>>>>
>>>>> Ning
>>>>>
>>>>> On Jan 21, 2010, at 3:44 PM, Carl Steinbach wrote:
>>>>>
>>>>>
>>>>> The naming convention for Hive jar files was changed in HIVE-978 from
>>>>> hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all
>>>>> Hive
>>>>> jars *except* hive_contrib.jar which was not changed because the
>>>>> hive_contrib.jar filename is referenced in several test cases.
>>>>> HIVE-1063
>>>>> fixes this problem by providing the ability to reference system
>>>>> property
>>>>> variables in test case qfiles.
>>>>>
>>>>> Thanks.
>>>>>
>>>>> Carl
>>>>>
>>>>> On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang <nz...@facebook.com>wrote:
>>>>>
>>>>>> This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
>>>>>> java.lang.ClassNotFoundException:
>>>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>>
>>>>>> The RegexSerDe is included in hive_contrib.jar. There may be an bug of
>>>>>> the name here because all other jar files are following the same
>>>>>> convention
>>>>>> hive-*-0.6.0.jar. If you see all the other jar files in the lib
>>>>>> directory
>>>>>> following the convention, you probably need to rename hive_contrib.jar
>>>>>> to
>>>>>> hive-contrib-0.6.0.jar. Can you try that and let us know the result?
>>>>>>
>>>>>> Thanks,
>>>>>> Ning
>>>>>>
>>>>>> On Jan 21, 2010, at 2:48 PM, John Villa wrote:
>>>>>>
>>>>>> Here is the output;
>>>>>>
>>>>>> java.lang.RuntimeException: Error in configuring object
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>> at
>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>> at
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>> ... 5 more
>>>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>>> ... 10 more
>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>> at
>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ... 13 more
>>>>>> Caused by: java.lang.RuntimeException: Map operator initialization
>>>>>> failed
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>>>> ... 18 more
>>>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
>>>>>> java.lang.ClassNotFoundException:
>>>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>>>> ... 18 more
>>>>>> Caused by: java.lang.ClassNotFoundException:
>>>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>>>> at java.lang.Class.forName0(Native Method)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at java.lang.Class.forName(Class.java:247)
>>>>>> at
>>>>>> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>>>> ... 19 more
>>>>>>
>>>>>> java.lang.RuntimeException: Error in configuring object
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>> at
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>> ... 5 more
>>>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ... 10 more
>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>> at
>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ... 13 more
>>>>>> Caused by: java.lang.RuntimeException: Map operator initialization
>>>>>> failed
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>>>> ... 18 more
>>>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
>>>>>> java.lang.ClassNotFoundException:
>>>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>>>> ... 18 more
>>>>>> Caused by: java.lang.ClassNotFoundException:
>>>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>>>> at java.lang.Class.forName0(Native Method)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at java.lang.Class.forName(Class.java:247)
>>>>>> at
>>>>>> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>>>> ... 19 more
>>>>>>
>>>>>> java.lang.RuntimeException: Error in configuring object
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>> at
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>> ... 5 more
>>>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ... 10 more
>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>> at
>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ... 13 more
>>>>>> Caused by: java.lang.RuntimeException: Map operator initialization
>>>>>> failed
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>>>> ... 18 more
>>>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
>>>>>> java.lang.ClassNotFoundException:
>>>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>>>> ... 18 more
>>>>>> Caused by: java.lang.ClassNotFoundException:
>>>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>>>> at java.lang.Class.forName0(Native Method)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at java.lang.Class.forName(Class.java:247)
>>>>>> at
>>>>>> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>>>> ... 19 more
>>>>>>
>>>>>> java.lang.RuntimeException: Error in configuring object
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>> at
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>> ... 5 more
>>>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ... 10 more
>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>> at
>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ... 13 more
>>>>>> Caused by: java.lang.RuntimeException: Map operator initialization
>>>>>> failed
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>>>> ... 18 more
>>>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
>>>>>> java.lang.ClassNotFoundException:
>>>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>>>> ... 18 more
>>>>>> Caused by: java.lang.ClassNotFoundException:
>>>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>>>> at java.lang.Class.forName0(Native Method)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at java.lang.Class.forName(Class.java:247)
>>>>>> at
>>>>>> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>>>> ... 19 more
>>>>>> java.lang.RuntimeException: Error in configuring object
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>> at
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>> ... 5 more
>>>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ... 10 more
>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>> at
>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ... 13 more
>>>>>> Caused by: java.lang.RuntimeException: Map operator initialization
>>>>>> failed
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>>>> ... 18 more
>>>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
>>>>>> java.lang.ClassNotFoundException:
>>>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>>>> ... 18 more
>>>>>> Caused by: java.lang.ClassNotFoundException:
>>>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>>>> at java.lang.Class.forName0(Native Method)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at java.lang.Class.forName(Class.java:247)
>>>>>> at
>>>>>> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>>>> ... 19 more
>>>>>>
>>>>>> java.lang.RuntimeException: Error in configuring object
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>> at
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>> ... 5 more
>>>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ... 10 more
>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>> at
>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ... 13 more
>>>>>> Caused by: java.lang.RuntimeException: Map operator initialization
>>>>>> failed
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>>>> ... 18 more
>>>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
>>>>>> java.lang.ClassNotFoundException:
>>>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>>>> ... 18 more
>>>>>> Caused by: java.lang.ClassNotFoundException:
>>>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>>>> at java.lang.Class.forName0(Native Method)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at java.lang.Class.forName(Class.java:247)
>>>>>> at
>>>>>> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>>>> ... 19 more
>>>>>>
>>>>>> java.lang.RuntimeException: Error in configuring object
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>> at
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>> ... 5 more
>>>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ... 10 more
>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>> at
>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ... 13 more
>>>>>> Caused by: java.lang.RuntimeException: Map operator initialization
>>>>>> failed
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>>>> ... 18 more
>>>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
>>>>>> java.lang.ClassNotFoundException:
>>>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>>>> ... 18 more
>>>>>> Caused by: java.lang.ClassNotFoundException:
>>>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>>>> at java.lang.Class.forName0(Native Method)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at java.lang.Class.forName(Class.java:247)
>>>>>> at
>>>>>> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>>>> ... 19 more
>>>>>>
>>>>>> java.lang.RuntimeException: Error in configuring object
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>> at
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>> ... 5 more
>>>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ... 10 more
>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>> at
>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>> at
>>>>>> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ... 13 more
>>>>>> Caused by: java.lang.RuntimeException: Map operator initialization
>>>>>> failed
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>>>> ... 18 more
>>>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
>>>>>> java.lang.ClassNotFoundException:
>>>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>>>> ... 18 more
>>>>>> Caused by: java.lang.ClassNotFoundException:
>>>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>>>> at java.lang.Class.forName0(Native Method)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at java.lang.Class.forName(Class.java:247)
>>>>>> at
>>>>>> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> at
>>>>>> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>>>> ... 19 more
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Thu, Jan 21, 2010 at 5:33 PM, John Villa
>>>>>> <jo...@gmail.com>wrote:
>>>>>>
>>>>>>> I am currently using hadoop 0.20.1. When I installed ant I did
>>>>>>> -Dhadoop.version="0.20.0"
>>>>>>> I will try and get you that output but my connection is rough right
>>>>>>> now and I need to do a little port forwarding. I will get it to you
>>>>>>> when i
>>>>>>> can.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang
>>>>>>> <nz...@facebook.com>wrote:
>>>>>>>
>>>>>>>> Which hadoop version are you using (you can see it by running
>>>>>>>> 'hadoop
>>>>>>>> version')? Have you specified hadoop.version when you compile Hive?
>>>>>>>> Are they
>>>>>>>> match?
>>>>>>>>
>>>>>>>> Also can you post the log file found through the Tracking URL when
>>>>>>>> you launch the job (in your example
>>>>>>>> http://master:50030/jobdetails.jsp...)? The log files can be found
>>>>>>>> by click through the mappers/reducers and at the rightmost column of
>>>>>>>> the
>>>>>>>> mapper/reducer stats.
>>>>>>>>
>>>>>>>>
>>>>>>>> On Jan 21, 2010, at 1:37 PM, John Villa wrote:
>>>>>>>>
>>>>>>>> I did not see any hive jar files within hadoop lib directory. I
>>>>>>>> compiled it using ant and the basic readme.
>>>>>>>>
>>>>>>>> On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang
>>>>>>>> <nz...@facebook.com>wrote:
>>>>>>>>
>>>>>>>>> It may be because you have 2 copies of Hive's jar files (e.g., one
>>>>>>>>> in Hadoop's lib directory and one in Hive's lib directory) and they
>>>>>>>>> are from
>>>>>>>>> different releases. If you have compiled Hive trunk yoruself please
>>>>>>>>> make
>>>>>>>>> sure no Hive's jar files in the Hadoop's directory.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Jan 21, 2010, at 12:51 PM, John Villa wrote:
>>>>>>>>>
>>>>>>>>> Here is what I got from the hive log;
>>>>>>>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>>>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core"
>>>>>>>>> requires
>>>>>>>>> "org.eclipse.core.resources" but it cannot be resolved.
>>>>>>>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>>>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core"
>>>>>>>>> requires
>>>>>>>>> "org.eclipse.core.resources" but it cannot be resolved.
>>>>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core"
>>>>>>>>> requires
>>>>>>>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>>>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core"
>>>>>>>>> requires
>>>>>>>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>>>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core"
>>>>>>>>> requires
>>>>>>>>> "org.eclipse.text" but it cannot be resolved.
>>>>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core"
>>>>>>>>> requires
>>>>>>>>> "org.eclipse.text" but it cannot be resolved.
>>>>>>>>> 2010-01-21 20:49:18,719 WARN mapred.JobClient
>>>>>>>>> (JobClient.java:configureCommandLineOptions(539)) - Use
>>>>>>>>> GenericOptionsParser
>>>>>>>>> for parsing the arguments. Applications should implement Tool for
>>>>>>>>> the same.
>>>>>>>>> 2010-01-21 20:49:55,514 ERROR exec.ExecDriver
>>>>>>>>> (SessionState.java:printError(279)) - Ended Job =
>>>>>>>>> job_201001211744_0008 with
>>>>>>>>> errors
>>>>>>>>> 2010-01-21 20:49:55,550 ERROR ql.Driver
>>>>>>>>> (SessionState.java:printError(279)) - FAILED: Execution Error,
>>>>>>>>> return code 2
>>>>>>>>> from org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Thu, Jan 21, 2010 at 3:37 PM, John Villa <
>>>>>>>>> john.joe.villa@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> Has anyone seen this error? Any help is appreciated, thanks;
>>>>>>>>>>
>>>>>>>>>> hive> select * from apachelog where host ="64.62.191.114";
>>>>>>>>>> Total MapReduce jobs = 1
>>>>>>>>>> Number of reduce tasks is set to 0 since there's no reduce
>>>>>>>>>> operator
>>>>>>>>>> Starting Job = job_201001211744_0002, Tracking URL =
>>>>>>>>>> http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
>>>>>>>>>> Kill Command = /u01/hadoop/bin/../bin/hadoop job
>>>>>>>>>> -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
>>>>>>>>>> 2010-01-21 07:24:38,198 map = 0%, reduce =0%
>>>>>>>>>> 2010-01-21 07:25:15,029 map = 100%, reduce =100%
>>>>>>>>>> Ended Job = job_201001211744_0002 with errors
>>>>>>>>>> FAILED: Execution Error, return code 2 from
>>>>>>>>>> org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>>
>
Re: Hive Execution Errors
Posted by Ning Zhang <nz...@facebook.com>.
HIVE-1063 is just for that to solve this problem. After that is committed, you don't need to manually add this jar files. There shouldn't be any other hive jar files that need to be manually added. If there are it should be fixed. The only jar files that need to be added by the users are those that the users developed for their UDFs etc.
Thanks,
Ning
On Jan 22, 2010, at 4:53 AM, John Villa wrote:
Thanks a lot I appreciate that! It works :) I will be doing testing today and thankyou. Is there a way to auto implement adding the jar file? Are there any other jar files I may need within the /lib directory? Again thanks for the help.
Thanks,
On Thu, Jan 21, 2010 at 7:50 PM, Ning Zhang <nz...@facebook.com>> wrote:
John, you don't need to change the jar file names if it is release 0.4.0. As Carl just pointed out, you can just run add jar... in the same way you have done when you create the table. This will distribute the jar file distributed to the Hadoop cluster.
On Jan 21, 2010, at 4:43 PM, John Villa wrote:
I cant even remember which version of hive I have installed but I believe it is release 4. How to I go about renaming these hive jar files? hive_foo-0.4.0.jar ?
Thanks,
On Thu, Jan 21, 2010 at 7:38 PM, John Villa <jo...@gmail.com>> wrote:
I will change the names soon and let you guys know. Home with the dogs bothering me hehe.
Thanks,
On Thu, Jan 21, 2010 at 7:34 PM, John Villa <jo...@gmail.com>> wrote:
Thanks for the info. The only adding of jar files I did was this when creating a tables;
add jar ../build/contrib/hive_contrib.jar;
On Thu, Jan 21, 2010 at 7:00 PM, Ning Zhang <nz...@facebook.com>> wrote:
Thanks Carl. I'll take a look at the patch for HIVE-1063.
Ning
On Jan 21, 2010, at 3:44 PM, Carl Steinbach wrote:
The naming convention for Hive jar files was changed in HIVE-978 from hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all Hive jars *except* hive_contrib.jar which was not changed because the hive_contrib.jar filename is referenced in several test cases. HIVE-1063 fixes this problem by providing the ability to reference system property variables in test case qfiles.
Thanks.
Carl
On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang <nz...@facebook.com>> wrote:
This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
The RegexSerDe is included in hive_contrib.jar. There may be an bug of the name here because all other jar files are following the same convention hive-*-0.6.0.jar. If you see all the other jar files in the lib directory following the convention, you probably need to rename hive_contrib.jar to hive-contrib-0.6.0.jar. Can you try that and let us know the result?
Thanks,
Ning
On Jan 21, 2010, at 2:48 PM, John Villa wrote:
Here is the output;
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
On Thu, Jan 21, 2010 at 5:33 PM, John Villa <jo...@gmail.com>> wrote:
I am currently using hadoop 0.20.1. When I installed ant I did -Dhadoop.version="0.20.0"
I will try and get you that output but my connection is rough right now and I need to do a little port forwarding. I will get it to you when i can.
On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang <nz...@facebook.com>> wrote:
Which hadoop version are you using (you can see it by running 'hadoop version')? Have you specified hadoop.version when you compile Hive? Are they match?
Also can you post the log file found through the Tracking URL when you launch the job (in your example http://master:50030/jobdetails.jsp...)? The log files can be found by click through the mappers/reducers and at the rightmost column of the mapper/reducer stats.
On Jan 21, 2010, at 1:37 PM, John Villa wrote:
I did not see any hive jar files within hadoop lib directory. I compiled it using ant and the basic readme.
On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang <nz...@facebook.com>> wrote:
It may be because you have 2 copies of Hive's jar files (e.g., one in Hadoop's lib directory and one in Hive's lib directory) and they are from different releases. If you have compiled Hive trunk yoruself please make sure no Hive's jar files in the Hadoop's directory.
On Jan 21, 2010, at 12:51 PM, John Villa wrote:
Here is what I got from the hive log;
2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
2010-01-21 20:49:18,719 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
2010-01-21 20:49:55,514 ERROR exec.ExecDriver (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with errors
2010-01-21 20:49:55,550 ERROR ql.Driver (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
On Thu, Jan 21, 2010 at 3:37 PM, John Villa <jo...@gmail.com>> wrote:
Has anyone seen this error? Any help is appreciated, thanks;
hive> select * from apachelog where host ="64.62.191.114";
Total MapReduce jobs = 1
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_201001211744_0002, Tracking URL = http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
Kill Command = /u01/hadoop/bin/../bin/hadoop job -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
2010-01-21 07:24:38,198 map = 0%, reduce =0%
2010-01-21 07:25:15,029 map = 100%, reduce =100%
Ended Job = job_201001211744_0002 with errors
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
Re: Hive Execution Errors
Posted by John Villa <jo...@gmail.com>.
Thanks a lot I appreciate that! It works :) I will be doing testing today
and thankyou. Is there a way to auto implement adding the jar file? Are
there any other jar files I may need within the /lib directory? Again thanks
for the help.
Thanks,
On Thu, Jan 21, 2010 at 7:50 PM, Ning Zhang <nz...@facebook.com> wrote:
> John, you don't need to change the jar file names if it is release 0.4.0.
> As Carl just pointed out, you can just run add jar... in the same way you
> have done when you create the table. This will distribute the jar file
> distributed to the Hadoop cluster.
>
>
> On Jan 21, 2010, at 4:43 PM, John Villa wrote:
>
> I cant even remember which version of hive I have installed but I believe
> it is release 4. How to I go about renaming these hive jar files?
> hive_foo-0.4.0.jar ?
> Thanks,
>
> On Thu, Jan 21, 2010 at 7:38 PM, John Villa <jo...@gmail.com>wrote:
>
>> I will change the names soon and let you guys know. Home with the dogs
>> bothering me hehe.
>> Thanks,
>>
>>
>> On Thu, Jan 21, 2010 at 7:34 PM, John Villa <jo...@gmail.com>wrote:
>>
>>> Thanks for the info. The only adding of jar files I did was this when
>>> creating a tables;
>>>
>>> add jar ../build/contrib/hive_contrib.jar;
>>>
>>>
>>>
>>>
>>> On Thu, Jan 21, 2010 at 7:00 PM, Ning Zhang <nz...@facebook.com> wrote:
>>>
>>>> Thanks Carl. I'll take a look at the patch for HIVE-1063.
>>>>
>>>> Ning
>>>>
>>>> On Jan 21, 2010, at 3:44 PM, Carl Steinbach wrote:
>>>>
>>>>
>>>> The naming convention for Hive jar files was changed in HIVE-978 from
>>>> hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all Hive
>>>> jars *except* hive_contrib.jar which was not changed because the
>>>> hive_contrib.jar filename is referenced in several test cases. HIVE-1063
>>>> fixes this problem by providing the ability to reference system property
>>>> variables in test case qfiles.
>>>>
>>>> Thanks.
>>>>
>>>> Carl
>>>>
>>>> On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang <nz...@facebook.com>wrote:
>>>>
>>>>> This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
>>>>> java.lang.ClassNotFoundException:
>>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>
>>>>> The RegexSerDe is included in hive_contrib.jar. There may be an bug of
>>>>> the name here because all other jar files are following the same convention
>>>>> hive-*-0.6.0.jar. If you see all the other jar files in the lib directory
>>>>> following the convention, you probably need to rename hive_contrib.jar to
>>>>> hive-contrib-0.6.0.jar. Can you try that and let us know the result?
>>>>>
>>>>> Thanks,
>>>>> Ning
>>>>>
>>>>> On Jan 21, 2010, at 2:48 PM, John Villa wrote:
>>>>>
>>>>> Here is the output;
>>>>>
>>>>> java.lang.RuntimeException: Error in configuring object
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>> ... 5 more
>>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>> ... 10 more
>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ... 13 more
>>>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>>> ... 18 more
>>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>>> ... 18 more
>>>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>>> at java.lang.Class.forName0(Native Method)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.lang.Class.forName(Class.java:247)
>>>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>>> ... 19 more
>>>>>
>>>>> java.lang.RuntimeException: Error in configuring object
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>> ... 5 more
>>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ... 10 more
>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ... 13 more
>>>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>>> ... 18 more
>>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>>> ... 18 more
>>>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>>> at java.lang.Class.forName0(Native Method)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.lang.Class.forName(Class.java:247)
>>>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>>> ... 19 more
>>>>>
>>>>> java.lang.RuntimeException: Error in configuring object
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>> ... 5 more
>>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ... 10 more
>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ... 13 more
>>>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>>> ... 18 more
>>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>>> ... 18 more
>>>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>>> at java.lang.Class.forName0(Native Method)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.lang.Class.forName(Class.java:247)
>>>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>>> ... 19 more
>>>>>
>>>>> java.lang.RuntimeException: Error in configuring object
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>> ... 5 more
>>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ... 10 more
>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ... 13 more
>>>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>>> ... 18 more
>>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>>> ... 18 more
>>>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>>> at java.lang.Class.forName0(Native Method)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.lang.Class.forName(Class.java:247)
>>>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>>> ... 19 more
>>>>> java.lang.RuntimeException: Error in configuring object
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>> ... 5 more
>>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ... 10 more
>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ... 13 more
>>>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>>> ... 18 more
>>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>>> ... 18 more
>>>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>>> at java.lang.Class.forName0(Native Method)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.lang.Class.forName(Class.java:247)
>>>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>>> ... 19 more
>>>>>
>>>>> java.lang.RuntimeException: Error in configuring object
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>> ... 5 more
>>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ... 10 more
>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ... 13 more
>>>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>>> ... 18 more
>>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>>> ... 18 more
>>>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>>> at java.lang.Class.forName0(Native Method)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.lang.Class.forName(Class.java:247)
>>>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>>> ... 19 more
>>>>>
>>>>> java.lang.RuntimeException: Error in configuring object
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>> ... 5 more
>>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ... 10 more
>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ... 13 more
>>>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>>> ... 18 more
>>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>>> ... 18 more
>>>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>>> at java.lang.Class.forName0(Native Method)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.lang.Class.forName(Class.java:247)
>>>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>>> ... 19 more
>>>>>
>>>>> java.lang.RuntimeException: Error in configuring object
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>> ... 5 more
>>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ... 10 more
>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ... 13 more
>>>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>>> ... 18 more
>>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>>> ... 18 more
>>>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>>> at java.lang.Class.forName0(Native Method)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.lang.Class.forName(Class.java:247)
>>>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>>> ... 19 more
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Thu, Jan 21, 2010 at 5:33 PM, John Villa <jo...@gmail.com>wrote:
>>>>>
>>>>>> I am currently using hadoop 0.20.1. When I installed ant I did
>>>>>> -Dhadoop.version="0.20.0"
>>>>>> I will try and get you that output but my connection is rough right
>>>>>> now and I need to do a little port forwarding. I will get it to you when i
>>>>>> can.
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang <nz...@facebook.com>wrote:
>>>>>>
>>>>>>> Which hadoop version are you using (you can see it by running 'hadoop
>>>>>>> version')? Have you specified hadoop.version when you compile Hive? Are they
>>>>>>> match?
>>>>>>>
>>>>>>> Also can you post the log file found through the Tracking URL when
>>>>>>> you launch the job (in your example
>>>>>>> http://master:50030/jobdetails.jsp...)? The log files can be found
>>>>>>> by click through the mappers/reducers and at the rightmost column of the
>>>>>>> mapper/reducer stats.
>>>>>>>
>>>>>>>
>>>>>>> On Jan 21, 2010, at 1:37 PM, John Villa wrote:
>>>>>>>
>>>>>>> I did not see any hive jar files within hadoop lib directory. I
>>>>>>> compiled it using ant and the basic readme.
>>>>>>>
>>>>>>> On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang <nz...@facebook.com>wrote:
>>>>>>>
>>>>>>>> It may be because you have 2 copies of Hive's jar files (e.g., one
>>>>>>>> in Hadoop's lib directory and one in Hive's lib directory) and they are from
>>>>>>>> different releases. If you have compiled Hive trunk yoruself please make
>>>>>>>> sure no Hive's jar files in the Hadoop's directory.
>>>>>>>>
>>>>>>>>
>>>>>>>> On Jan 21, 2010, at 12:51 PM, John Villa wrote:
>>>>>>>>
>>>>>>>> Here is what I got from the hive log;
>>>>>>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>>>> "org.eclipse.core.resources" but it cannot be resolved.
>>>>>>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>>>> "org.eclipse.core.resources" but it cannot be resolved.
>>>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>>>> "org.eclipse.text" but it cannot be resolved.
>>>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>>>> "org.eclipse.text" but it cannot be resolved.
>>>>>>>> 2010-01-21 20:49:18,719 WARN mapred.JobClient
>>>>>>>> (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
>>>>>>>> for parsing the arguments. Applications should implement Tool for the same.
>>>>>>>> 2010-01-21 20:49:55,514 ERROR exec.ExecDriver
>>>>>>>> (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
>>>>>>>> errors
>>>>>>>> 2010-01-21 20:49:55,550 ERROR ql.Driver
>>>>>>>> (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2
>>>>>>>> from org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>>>>>
>>>>>>>>
>>>>>>>> On Thu, Jan 21, 2010 at 3:37 PM, John Villa <
>>>>>>>> john.joe.villa@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Has anyone seen this error? Any help is appreciated, thanks;
>>>>>>>>>
>>>>>>>>> hive> select * from apachelog where host ="64.62.191.114";
>>>>>>>>> Total MapReduce jobs = 1
>>>>>>>>> Number of reduce tasks is set to 0 since there's no reduce operator
>>>>>>>>> Starting Job = job_201001211744_0002, Tracking URL =
>>>>>>>>> http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
>>>>>>>>> Kill Command = /u01/hadoop/bin/../bin/hadoop job
>>>>>>>>> -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
>>>>>>>>> 2010-01-21 07:24:38,198 map = 0%, reduce =0%
>>>>>>>>> 2010-01-21 07:25:15,029 map = 100%, reduce =100%
>>>>>>>>> Ended Job = job_201001211744_0002 with errors
>>>>>>>>> FAILED: Execution Error, return code 2 from
>>>>>>>>> org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>
>
>
Re: Hive Execution Errors
Posted by Ning Zhang <nz...@facebook.com>.
John, you don't need to change the jar file names if it is release 0.4.0. As Carl just pointed out, you can just run add jar... in the same way you have done when you create the table. This will distribute the jar file distributed to the Hadoop cluster.
On Jan 21, 2010, at 4:43 PM, John Villa wrote:
I cant even remember which version of hive I have installed but I believe it is release 4. How to I go about renaming these hive jar files? hive_foo-0.4.0.jar ?
Thanks,
On Thu, Jan 21, 2010 at 7:38 PM, John Villa <jo...@gmail.com>> wrote:
I will change the names soon and let you guys know. Home with the dogs bothering me hehe.
Thanks,
On Thu, Jan 21, 2010 at 7:34 PM, John Villa <jo...@gmail.com>> wrote:
Thanks for the info. The only adding of jar files I did was this when creating a tables;
add jar ../build/contrib/hive_contrib.jar;
On Thu, Jan 21, 2010 at 7:00 PM, Ning Zhang <nz...@facebook.com>> wrote:
Thanks Carl. I'll take a look at the patch for HIVE-1063.
Ning
On Jan 21, 2010, at 3:44 PM, Carl Steinbach wrote:
The naming convention for Hive jar files was changed in HIVE-978 from hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all Hive jars *except* hive_contrib.jar which was not changed because the hive_contrib.jar filename is referenced in several test cases. HIVE-1063 fixes this problem by providing the ability to reference system property variables in test case qfiles.
Thanks.
Carl
On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang <nz...@facebook.com>> wrote:
This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
The RegexSerDe is included in hive_contrib.jar. There may be an bug of the name here because all other jar files are following the same convention hive-*-0.6.0.jar. If you see all the other jar files in the lib directory following the convention, you probably need to rename hive_contrib.jar to hive-contrib-0.6.0.jar. Can you try that and let us know the result?
Thanks,
Ning
On Jan 21, 2010, at 2:48 PM, John Villa wrote:
Here is the output;
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
On Thu, Jan 21, 2010 at 5:33 PM, John Villa <jo...@gmail.com>> wrote:
I am currently using hadoop 0.20.1. When I installed ant I did -Dhadoop.version="0.20.0"
I will try and get you that output but my connection is rough right now and I need to do a little port forwarding. I will get it to you when i can.
On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang <nz...@facebook.com>> wrote:
Which hadoop version are you using (you can see it by running 'hadoop version')? Have you specified hadoop.version when you compile Hive? Are they match?
Also can you post the log file found through the Tracking URL when you launch the job (in your example http://master:50030/jobdetails.jsp...)? The log files can be found by click through the mappers/reducers and at the rightmost column of the mapper/reducer stats.
On Jan 21, 2010, at 1:37 PM, John Villa wrote:
I did not see any hive jar files within hadoop lib directory. I compiled it using ant and the basic readme.
On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang <nz...@facebook.com>> wrote:
It may be because you have 2 copies of Hive's jar files (e.g., one in Hadoop's lib directory and one in Hive's lib directory) and they are from different releases. If you have compiled Hive trunk yoruself please make sure no Hive's jar files in the Hadoop's directory.
On Jan 21, 2010, at 12:51 PM, John Villa wrote:
Here is what I got from the hive log;
2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
2010-01-21 20:49:18,719 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
2010-01-21 20:49:55,514 ERROR exec.ExecDriver (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with errors
2010-01-21 20:49:55,550 ERROR ql.Driver (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
On Thu, Jan 21, 2010 at 3:37 PM, John Villa <jo...@gmail.com>> wrote:
Has anyone seen this error? Any help is appreciated, thanks;
hive> select * from apachelog where host ="64.62.191.114";
Total MapReduce jobs = 1
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_201001211744_0002, Tracking URL = http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
Kill Command = /u01/hadoop/bin/../bin/hadoop job -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
2010-01-21 07:24:38,198 map = 0%, reduce =0%
2010-01-21 07:25:15,029 map = 100%, reduce =100%
Ended Job = job_201001211744_0002 with errors
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
Re: Hive Execution Errors
Posted by John Villa <jo...@gmail.com>.
I cant even remember which version of hive I have installed but I believe
it is release 4. How to I go about renaming these hive jar files?
hive_foo-0.4.0.jar ?
Thanks,
On Thu, Jan 21, 2010 at 7:38 PM, John Villa <jo...@gmail.com>wrote:
> I will change the names soon and let you guys know. Home with the dogs
> bothering me hehe.
> Thanks,
>
>
> On Thu, Jan 21, 2010 at 7:34 PM, John Villa <jo...@gmail.com>wrote:
>
>> Thanks for the info. The only adding of jar files I did was this when
>> creating a tables;
>>
>> add jar ../build/contrib/hive_contrib.jar;
>>
>>
>>
>>
>> On Thu, Jan 21, 2010 at 7:00 PM, Ning Zhang <nz...@facebook.com> wrote:
>>
>>> Thanks Carl. I'll take a look at the patch for HIVE-1063.
>>>
>>> Ning
>>>
>>> On Jan 21, 2010, at 3:44 PM, Carl Steinbach wrote:
>>>
>>>
>>> The naming convention for Hive jar files was changed in HIVE-978 from
>>> hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all Hive
>>> jars *except* hive_contrib.jar which was not changed because the
>>> hive_contrib.jar filename is referenced in several test cases. HIVE-1063
>>> fixes this problem by providing the ability to reference system property
>>> variables in test case qfiles.
>>>
>>> Thanks.
>>>
>>> Carl
>>>
>>> On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang <nz...@facebook.com> wrote:
>>>
>>>> This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
>>>> java.lang.ClassNotFoundException:
>>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>
>>>> The RegexSerDe is included in hive_contrib.jar. There may be an bug of
>>>> the name here because all other jar files are following the same convention
>>>> hive-*-0.6.0.jar. If you see all the other jar files in the lib directory
>>>> following the convention, you probably need to rename hive_contrib.jar to
>>>> hive-contrib-0.6.0.jar. Can you try that and let us know the result?
>>>>
>>>> Thanks,
>>>> Ning
>>>>
>>>> On Jan 21, 2010, at 2:48 PM, John Villa wrote:
>>>>
>>>> Here is the output;
>>>>
>>>> java.lang.RuntimeException: Error in configuring object
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>>
>>>>
>>>>
>>>>
>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>
>>>>
>>>>
>>>>
>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>> ... 5 more
>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>> ... 10 more
>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>
>>>>
>>>>
>>>>
>>>> ... 13 more
>>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>> ... 18 more
>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>> ... 18 more
>>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>
>>>>
>>>>
>>>>
>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>> at java.lang.Class.forName0(Native Method)
>>>>
>>>>
>>>>
>>>>
>>>> at java.lang.Class.forName(Class.java:247)
>>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>> ... 19 more
>>>>
>>>> java.lang.RuntimeException: Error in configuring object
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>> ... 5 more
>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>
>>>>
>>>>
>>>>
>>>> ... 10 more
>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>
>>>>
>>>>
>>>>
>>>> ... 13 more
>>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>> ... 18 more
>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>> ... 18 more
>>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>
>>>>
>>>>
>>>>
>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>> at java.lang.Class.forName0(Native Method)
>>>>
>>>>
>>>>
>>>>
>>>> at java.lang.Class.forName(Class.java:247)
>>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>> ... 19 more
>>>>
>>>> java.lang.RuntimeException: Error in configuring object
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>> ... 5 more
>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>
>>>>
>>>>
>>>>
>>>> ... 10 more
>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>
>>>>
>>>>
>>>>
>>>> ... 13 more
>>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>> ... 18 more
>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>> ... 18 more
>>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>
>>>>
>>>>
>>>>
>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>> at java.lang.Class.forName0(Native Method)
>>>>
>>>>
>>>>
>>>>
>>>> at java.lang.Class.forName(Class.java:247)
>>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>> ... 19 more
>>>>
>>>> java.lang.RuntimeException: Error in configuring object
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>> ... 5 more
>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>
>>>>
>>>>
>>>>
>>>> ... 10 more
>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>
>>>>
>>>>
>>>>
>>>> ... 13 more
>>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>> ... 18 more
>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>> ... 18 more
>>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>
>>>>
>>>>
>>>>
>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>> at java.lang.Class.forName0(Native Method)
>>>>
>>>>
>>>>
>>>>
>>>> at java.lang.Class.forName(Class.java:247)
>>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>> ... 19 more
>>>> java.lang.RuntimeException: Error in configuring object
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>> ... 5 more
>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>
>>>>
>>>>
>>>>
>>>> ... 10 more
>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>
>>>>
>>>>
>>>>
>>>> ... 13 more
>>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>> ... 18 more
>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>> ... 18 more
>>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>
>>>>
>>>>
>>>>
>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>> at java.lang.Class.forName0(Native Method)
>>>>
>>>>
>>>>
>>>>
>>>> at java.lang.Class.forName(Class.java:247)
>>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>> ... 19 more
>>>>
>>>> java.lang.RuntimeException: Error in configuring object
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>> ... 5 more
>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>
>>>>
>>>>
>>>>
>>>> ... 10 more
>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>
>>>>
>>>>
>>>>
>>>> ... 13 more
>>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>> ... 18 more
>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>> ... 18 more
>>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>
>>>>
>>>>
>>>>
>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>> at java.lang.Class.forName0(Native Method)
>>>>
>>>>
>>>>
>>>>
>>>> at java.lang.Class.forName(Class.java:247)
>>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>> ... 19 more
>>>>
>>>> java.lang.RuntimeException: Error in configuring object
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>> ... 5 more
>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>
>>>>
>>>>
>>>>
>>>> ... 10 more
>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>
>>>>
>>>>
>>>>
>>>> ... 13 more
>>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>> ... 18 more
>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>> ... 18 more
>>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>
>>>>
>>>>
>>>>
>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>> at java.lang.Class.forName0(Native Method)
>>>>
>>>>
>>>>
>>>>
>>>> at java.lang.Class.forName(Class.java:247)
>>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>> ... 19 more
>>>>
>>>> java.lang.RuntimeException: Error in configuring object
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>> ... 5 more
>>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>>
>>>>
>>>>
>>>>
>>>> ... 10 more
>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>>
>>>>
>>>>
>>>>
>>>> ... 13 more
>>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>>> ... 18 more
>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>>> ... 18 more
>>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>>
>>>>
>>>>
>>>>
>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>>
>>>>
>>>>
>>>>
>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>>> at java.lang.Class.forName0(Native Method)
>>>>
>>>>
>>>>
>>>>
>>>> at java.lang.Class.forName(Class.java:247)
>>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>>
>>>>
>>>>
>>>>
>>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>>> ... 19 more
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> On Thu, Jan 21, 2010 at 5:33 PM, John Villa <jo...@gmail.com>wrote:
>>>>
>>>>> I am currently using hadoop 0.20.1. When I installed ant I did
>>>>> -Dhadoop.version="0.20.0"
>>>>> I will try and get you that output but my connection is rough right now
>>>>> and I need to do a little port forwarding. I will get it to you when i can.
>>>>>
>>>>>
>>>>>
>>>>> On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang <nz...@facebook.com>wrote:
>>>>>
>>>>>> Which hadoop version are you using (you can see it by running 'hadoop
>>>>>> version')? Have you specified hadoop.version when you compile Hive? Are they
>>>>>> match?
>>>>>>
>>>>>> Also can you post the log file found through the Tracking URL when you
>>>>>> launch the job (in your example http://master:50030/jobdetails.jsp...)?
>>>>>> The log files can be found by click through the mappers/reducers and at the
>>>>>> rightmost column of the mapper/reducer stats.
>>>>>>
>>>>>>
>>>>>> On Jan 21, 2010, at 1:37 PM, John Villa wrote:
>>>>>>
>>>>>> I did not see any hive jar files within hadoop lib directory. I
>>>>>> compiled it using ant and the basic readme.
>>>>>>
>>>>>> On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang <nz...@facebook.com>wrote:
>>>>>>
>>>>>>> It may be because you have 2 copies of Hive's jar files (e.g., one
>>>>>>> in Hadoop's lib directory and one in Hive's lib directory) and they are from
>>>>>>> different releases. If you have compiled Hive trunk yoruself please make
>>>>>>> sure no Hive's jar files in the Hadoop's directory.
>>>>>>>
>>>>>>>
>>>>>>> On Jan 21, 2010, at 12:51 PM, John Villa wrote:
>>>>>>>
>>>>>>> Here is what I got from the hive log;
>>>>>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>>> "org.eclipse.core.resources" but it cannot be resolved.
>>>>>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>>> "org.eclipse.core.resources" but it cannot be resolved.
>>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>>> "org.eclipse.text" but it cannot be resolved.
>>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>>> "org.eclipse.text" but it cannot be resolved.
>>>>>>> 2010-01-21 20:49:18,719 WARN mapred.JobClient
>>>>>>> (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
>>>>>>> for parsing the arguments. Applications should implement Tool for the same.
>>>>>>> 2010-01-21 20:49:55,514 ERROR exec.ExecDriver
>>>>>>> (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
>>>>>>> errors
>>>>>>> 2010-01-21 20:49:55,550 ERROR ql.Driver
>>>>>>> (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2
>>>>>>> from org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>>>>
>>>>>>>
>>>>>>> On Thu, Jan 21, 2010 at 3:37 PM, John Villa <
>>>>>>> john.joe.villa@gmail.com> wrote:
>>>>>>>
>>>>>>>> Has anyone seen this error? Any help is appreciated, thanks;
>>>>>>>>
>>>>>>>> hive> select * from apachelog where host ="64.62.191.114";
>>>>>>>> Total MapReduce jobs = 1
>>>>>>>> Number of reduce tasks is set to 0 since there's no reduce operator
>>>>>>>> Starting Job = job_201001211744_0002, Tracking URL =
>>>>>>>> http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
>>>>>>>> Kill Command = /u01/hadoop/bin/../bin/hadoop job
>>>>>>>> -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
>>>>>>>> 2010-01-21 07:24:38,198 map = 0%, reduce =0%
>>>>>>>> 2010-01-21 07:25:15,029 map = 100%, reduce =100%
>>>>>>>> Ended Job = job_201001211744_0002 with errors
>>>>>>>> FAILED: Execution Error, return code 2 from
>>>>>>>> org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>>
>>>
>>>
>>
>
Re: Hive Execution Errors
Posted by John Villa <jo...@gmail.com>.
I will change the names soon and let you guys know. Home with the dogs
bothering me hehe.
Thanks,
On Thu, Jan 21, 2010 at 7:34 PM, John Villa <jo...@gmail.com>wrote:
> Thanks for the info. The only adding of jar files I did was this when
> creating a tables;
>
> add jar ../build/contrib/hive_contrib.jar;
>
>
>
>
> On Thu, Jan 21, 2010 at 7:00 PM, Ning Zhang <nz...@facebook.com> wrote:
>
>> Thanks Carl. I'll take a look at the patch for HIVE-1063.
>>
>> Ning
>>
>> On Jan 21, 2010, at 3:44 PM, Carl Steinbach wrote:
>>
>>
>> The naming convention for Hive jar files was changed in HIVE-978 from
>> hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all Hive
>> jars *except* hive_contrib.jar which was not changed because the
>> hive_contrib.jar filename is referenced in several test cases. HIVE-1063
>> fixes this problem by providing the ability to reference system property
>> variables in test case qfiles.
>>
>> Thanks.
>>
>> Carl
>>
>> On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang <nz...@facebook.com> wrote:
>>
>>> This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
>>> java.lang.ClassNotFoundException:
>>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>> The RegexSerDe is included in hive_contrib.jar. There may be an bug of
>>> the name here because all other jar files are following the same convention
>>> hive-*-0.6.0.jar. If you see all the other jar files in the lib directory
>>> following the convention, you probably need to rename hive_contrib.jar to
>>> hive-contrib-0.6.0.jar. Can you try that and let us know the result?
>>>
>>> Thanks,
>>> Ning
>>>
>>> On Jan 21, 2010, at 2:48 PM, John Villa wrote:
>>>
>>> Here is the output;
>>>
>>> java.lang.RuntimeException: Error in configuring object
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>>
>>>
>>>
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>
>>>
>>>
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>> ... 5 more
>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>>
>>>
>>>
>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>> ... 10 more
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>
>>>
>>>
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>
>>>
>>>
>>> ... 13 more
>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>> ... 18 more
>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>> ... 18 more
>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>
>>>
>>>
>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>> at java.lang.Class.forName0(Native Method)
>>>
>>>
>>>
>>> at java.lang.Class.forName(Class.java:247)
>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>
>>>
>>>
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>> ... 19 more
>>>
>>> java.lang.RuntimeException: Error in configuring object
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>
>>>
>>>
>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>
>>>
>>>
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>> ... 5 more
>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>
>>>
>>>
>>> ... 10 more
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>
>>>
>>>
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>
>>>
>>>
>>> ... 13 more
>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>> ... 18 more
>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>> ... 18 more
>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>
>>>
>>>
>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>> at java.lang.Class.forName0(Native Method)
>>>
>>>
>>>
>>> at java.lang.Class.forName(Class.java:247)
>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>
>>>
>>>
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>> ... 19 more
>>>
>>> java.lang.RuntimeException: Error in configuring object
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>
>>>
>>>
>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>
>>>
>>>
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>> ... 5 more
>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>
>>>
>>>
>>> ... 10 more
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>
>>>
>>>
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>
>>>
>>>
>>> ... 13 more
>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>> ... 18 more
>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>> ... 18 more
>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>
>>>
>>>
>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>> at java.lang.Class.forName0(Native Method)
>>>
>>>
>>>
>>> at java.lang.Class.forName(Class.java:247)
>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>
>>>
>>>
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>> ... 19 more
>>>
>>> java.lang.RuntimeException: Error in configuring object
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>
>>>
>>>
>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>
>>>
>>>
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>> ... 5 more
>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>
>>>
>>>
>>> ... 10 more
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>
>>>
>>>
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>
>>>
>>>
>>> ... 13 more
>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>> ... 18 more
>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>> ... 18 more
>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>
>>>
>>>
>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>> at java.lang.Class.forName0(Native Method)
>>>
>>>
>>>
>>> at java.lang.Class.forName(Class.java:247)
>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>
>>>
>>>
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>> ... 19 more
>>> java.lang.RuntimeException: Error in configuring object
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>
>>>
>>>
>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>
>>>
>>>
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>> ... 5 more
>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>
>>>
>>>
>>> ... 10 more
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>
>>>
>>>
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>
>>>
>>>
>>> ... 13 more
>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>> ... 18 more
>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>> ... 18 more
>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>
>>>
>>>
>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>> at java.lang.Class.forName0(Native Method)
>>>
>>>
>>>
>>> at java.lang.Class.forName(Class.java:247)
>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>
>>>
>>>
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>> ... 19 more
>>>
>>> java.lang.RuntimeException: Error in configuring object
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>
>>>
>>>
>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>
>>>
>>>
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>> ... 5 more
>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>
>>>
>>>
>>> ... 10 more
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>
>>>
>>>
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>
>>>
>>>
>>> ... 13 more
>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>> ... 18 more
>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>> ... 18 more
>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>
>>>
>>>
>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>> at java.lang.Class.forName0(Native Method)
>>>
>>>
>>>
>>> at java.lang.Class.forName(Class.java:247)
>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>
>>>
>>>
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>> ... 19 more
>>>
>>> java.lang.RuntimeException: Error in configuring object
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>
>>>
>>>
>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>
>>>
>>>
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>> ... 5 more
>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>
>>>
>>>
>>> ... 10 more
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>
>>>
>>>
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>
>>>
>>>
>>> ... 13 more
>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>> ... 18 more
>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>> ... 18 more
>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>
>>>
>>>
>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>> at java.lang.Class.forName0(Native Method)
>>>
>>>
>>>
>>> at java.lang.Class.forName(Class.java:247)
>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>
>>>
>>>
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>> ... 19 more
>>>
>>> java.lang.RuntimeException: Error in configuring object
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>>
>>>
>>>
>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>
>>>
>>>
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>> ... 5 more
>>> Caused by: java.lang.RuntimeException: Error in configuring object
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>>
>>>
>>>
>>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>>
>>>
>>>
>>> ... 10 more
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>
>>>
>>>
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>>
>>>
>>>
>>> ... 13 more
>>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>>> ... 18 more
>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>>> ... 18 more
>>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>>
>>>
>>>
>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>>
>>>
>>>
>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>>> at java.lang.Class.forName0(Native Method)
>>>
>>>
>>>
>>> at java.lang.Class.forName(Class.java:247)
>>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>>
>>>
>>>
>>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>>> ... 19 more
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> On Thu, Jan 21, 2010 at 5:33 PM, John Villa <jo...@gmail.com>wrote:
>>>
>>>> I am currently using hadoop 0.20.1. When I installed ant I did
>>>> -Dhadoop.version="0.20.0"
>>>> I will try and get you that output but my connection is rough right now
>>>> and I need to do a little port forwarding. I will get it to you when i can.
>>>>
>>>>
>>>>
>>>> On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang <nz...@facebook.com>wrote:
>>>>
>>>>> Which hadoop version are you using (you can see it by running 'hadoop
>>>>> version')? Have you specified hadoop.version when you compile Hive? Are they
>>>>> match?
>>>>>
>>>>> Also can you post the log file found through the Tracking URL when you
>>>>> launch the job (in your example http://master:50030/jobdetails.jsp...)?
>>>>> The log files can be found by click through the mappers/reducers and at the
>>>>> rightmost column of the mapper/reducer stats.
>>>>>
>>>>>
>>>>> On Jan 21, 2010, at 1:37 PM, John Villa wrote:
>>>>>
>>>>> I did not see any hive jar files within hadoop lib directory. I
>>>>> compiled it using ant and the basic readme.
>>>>>
>>>>> On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang <nz...@facebook.com>wrote:
>>>>>
>>>>>> It may be because you have 2 copies of Hive's jar files (e.g., one in
>>>>>> Hadoop's lib directory and one in Hive's lib directory) and they are from
>>>>>> different releases. If you have compiled Hive trunk yoruself please make
>>>>>> sure no Hive's jar files in the Hadoop's directory.
>>>>>>
>>>>>>
>>>>>> On Jan 21, 2010, at 12:51 PM, John Villa wrote:
>>>>>>
>>>>>> Here is what I got from the hive log;
>>>>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>> "org.eclipse.core.resources" but it cannot be resolved.
>>>>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>> "org.eclipse.core.resources" but it cannot be resolved.
>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>> "org.eclipse.text" but it cannot be resolved.
>>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>>> "org.eclipse.text" but it cannot be resolved.
>>>>>> 2010-01-21 20:49:18,719 WARN mapred.JobClient
>>>>>> (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
>>>>>> for parsing the arguments. Applications should implement Tool for the same.
>>>>>> 2010-01-21 20:49:55,514 ERROR exec.ExecDriver
>>>>>> (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
>>>>>> errors
>>>>>> 2010-01-21 20:49:55,550 ERROR ql.Driver
>>>>>> (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2
>>>>>> from org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>>>
>>>>>>
>>>>>> On Thu, Jan 21, 2010 at 3:37 PM, John Villa <john.joe.villa@gmail.com
>>>>>> > wrote:
>>>>>>
>>>>>>> Has anyone seen this error? Any help is appreciated, thanks;
>>>>>>>
>>>>>>> hive> select * from apachelog where host ="64.62.191.114";
>>>>>>> Total MapReduce jobs = 1
>>>>>>> Number of reduce tasks is set to 0 since there's no reduce operator
>>>>>>> Starting Job = job_201001211744_0002, Tracking URL =
>>>>>>> http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
>>>>>>> Kill Command = /u01/hadoop/bin/../bin/hadoop job
>>>>>>> -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
>>>>>>> 2010-01-21 07:24:38,198 map = 0%, reduce =0%
>>>>>>> 2010-01-21 07:25:15,029 map = 100%, reduce =100%
>>>>>>> Ended Job = job_201001211744_0002 with errors
>>>>>>> FAILED: Execution Error, return code 2 from
>>>>>>> org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>>
>>
>>
>
Re: Hive Execution Errors
Posted by John Villa <jo...@gmail.com>.
Thanks for the info. The only adding of jar files I did was this when
creating a tables;
add jar ../build/contrib/hive_contrib.jar;
On Thu, Jan 21, 2010 at 7:00 PM, Ning Zhang <nz...@facebook.com> wrote:
> Thanks Carl. I'll take a look at the patch for HIVE-1063.
>
> Ning
>
> On Jan 21, 2010, at 3:44 PM, Carl Steinbach wrote:
>
>
> The naming convention for Hive jar files was changed in HIVE-978 from
> hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all Hive
> jars *except* hive_contrib.jar which was not changed because the
> hive_contrib.jar filename is referenced in several test cases. HIVE-1063
> fixes this problem by providing the ability to reference system property
> variables in test case qfiles.
>
> Thanks.
>
> Carl
>
> On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang <nz...@facebook.com> wrote:
>
>> This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
>> java.lang.ClassNotFoundException:
>> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>
>> The RegexSerDe is included in hive_contrib.jar. There may be an bug of the
>> name here because all other jar files are following the same convention
>> hive-*-0.6.0.jar. If you see all the other jar files in the lib directory
>> following the convention, you probably need to rename hive_contrib.jar to
>> hive-contrib-0.6.0.jar. Can you try that and let us know the result?
>>
>> Thanks,
>> Ning
>>
>> On Jan 21, 2010, at 2:48 PM, John Villa wrote:
>>
>> Here is the output;
>>
>> java.lang.RuntimeException: Error in configuring object
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>
>>
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>
>>
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>> ... 5 more
>> Caused by: java.lang.RuntimeException: Error in configuring object
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>
>>
>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>> ... 10 more
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>
>>
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>
>>
>> ... 13 more
>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>> ... 18 more
>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>
>>
>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>> ... 18 more
>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>
>>
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>
>>
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>> at java.lang.Class.forName0(Native Method)
>>
>>
>> at java.lang.Class.forName(Class.java:247)
>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>
>>
>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>> ... 19 more
>>
>> java.lang.RuntimeException: Error in configuring object
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>
>>
>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>
>>
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>> ... 5 more
>> Caused by: java.lang.RuntimeException: Error in configuring object
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>
>>
>> ... 10 more
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>
>>
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>
>>
>> ... 13 more
>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>> ... 18 more
>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>
>>
>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>> ... 18 more
>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>
>>
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>
>>
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>> at java.lang.Class.forName0(Native Method)
>>
>>
>> at java.lang.Class.forName(Class.java:247)
>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>
>>
>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>> ... 19 more
>>
>> java.lang.RuntimeException: Error in configuring object
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>
>>
>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>
>>
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>> ... 5 more
>> Caused by: java.lang.RuntimeException: Error in configuring object
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>
>>
>> ... 10 more
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>
>>
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>
>>
>> ... 13 more
>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>> ... 18 more
>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>
>>
>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>> ... 18 more
>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>
>>
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>
>>
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>> at java.lang.Class.forName0(Native Method)
>>
>>
>> at java.lang.Class.forName(Class.java:247)
>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>
>>
>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>> ... 19 more
>>
>> java.lang.RuntimeException: Error in configuring object
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>
>>
>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>
>>
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>> ... 5 more
>> Caused by: java.lang.RuntimeException: Error in configuring object
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>
>>
>> ... 10 more
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>
>>
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>
>>
>> ... 13 more
>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>> ... 18 more
>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>
>>
>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>> ... 18 more
>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>
>>
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>
>>
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>> at java.lang.Class.forName0(Native Method)
>>
>>
>> at java.lang.Class.forName(Class.java:247)
>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>
>>
>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>> ... 19 more
>> java.lang.RuntimeException: Error in configuring object
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>
>>
>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>
>>
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>> ... 5 more
>> Caused by: java.lang.RuntimeException: Error in configuring object
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>
>>
>> ... 10 more
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>
>>
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>
>>
>> ... 13 more
>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>> ... 18 more
>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>
>>
>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>> ... 18 more
>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>
>>
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>
>>
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>> at java.lang.Class.forName0(Native Method)
>>
>>
>> at java.lang.Class.forName(Class.java:247)
>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>
>>
>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>> ... 19 more
>>
>> java.lang.RuntimeException: Error in configuring object
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>
>>
>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>
>>
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>> ... 5 more
>> Caused by: java.lang.RuntimeException: Error in configuring object
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>
>>
>> ... 10 more
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>
>>
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>
>>
>> ... 13 more
>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>> ... 18 more
>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>
>>
>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>> ... 18 more
>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>
>>
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>
>>
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>> at java.lang.Class.forName0(Native Method)
>>
>>
>> at java.lang.Class.forName(Class.java:247)
>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>
>>
>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>> ... 19 more
>>
>> java.lang.RuntimeException: Error in configuring object
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>
>>
>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>
>>
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>> ... 5 more
>> Caused by: java.lang.RuntimeException: Error in configuring object
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>
>>
>> ... 10 more
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>
>>
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>
>>
>> ... 13 more
>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>> ... 18 more
>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>
>>
>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>> ... 18 more
>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>
>>
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>
>>
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>> at java.lang.Class.forName0(Native Method)
>>
>>
>> at java.lang.Class.forName(Class.java:247)
>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>
>>
>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>> ... 19 more
>>
>> java.lang.RuntimeException: Error in configuring object
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>
>>
>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>
>>
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>> ... 5 more
>> Caused by: java.lang.RuntimeException: Error in configuring object
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>
>>
>> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>
>>
>> ... 10 more
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>
>>
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>
>>
>> ... 13 more
>> Caused by: java.lang.RuntimeException: Map operator initialization failed
>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
>> ... 18 more
>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>
>>
>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
>> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
>> ... 18 more
>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>>
>>
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>>
>>
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>> at java.lang.Class.forName0(Native Method)
>>
>>
>> at java.lang.Class.forName(Class.java:247)
>> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
>> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>>
>>
>> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
>> ... 19 more
>>
>>
>>
>>
>>
>>
>>
>>
>> On Thu, Jan 21, 2010 at 5:33 PM, John Villa <jo...@gmail.com>wrote:
>>
>>> I am currently using hadoop 0.20.1. When I installed ant I did
>>> -Dhadoop.version="0.20.0"
>>> I will try and get you that output but my connection is rough right now
>>> and I need to do a little port forwarding. I will get it to you when i can.
>>>
>>>
>>>
>>> On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang <nz...@facebook.com> wrote:
>>>
>>>> Which hadoop version are you using (you can see it by running 'hadoop
>>>> version')? Have you specified hadoop.version when you compile Hive? Are they
>>>> match?
>>>>
>>>> Also can you post the log file found through the Tracking URL when you
>>>> launch the job (in your example http://master:50030/jobdetails.jsp...)?
>>>> The log files can be found by click through the mappers/reducers and at the
>>>> rightmost column of the mapper/reducer stats.
>>>>
>>>>
>>>> On Jan 21, 2010, at 1:37 PM, John Villa wrote:
>>>>
>>>> I did not see any hive jar files within hadoop lib directory. I compiled
>>>> it using ant and the basic readme.
>>>>
>>>> On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang <nz...@facebook.com>wrote:
>>>>
>>>>> It may be because you have 2 copies of Hive's jar files (e.g., one in
>>>>> Hadoop's lib directory and one in Hive's lib directory) and they are from
>>>>> different releases. If you have compiled Hive trunk yoruself please make
>>>>> sure no Hive's jar files in the Hadoop's directory.
>>>>>
>>>>>
>>>>> On Jan 21, 2010, at 12:51 PM, John Villa wrote:
>>>>>
>>>>> Here is what I got from the hive log;
>>>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>> "org.eclipse.core.resources" but it cannot be resolved.
>>>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>> "org.eclipse.core.resources" but it cannot be resolved.
>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>> "org.eclipse.text" but it cannot be resolved.
>>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>>> "org.eclipse.text" but it cannot be resolved.
>>>>> 2010-01-21 20:49:18,719 WARN mapred.JobClient
>>>>> (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
>>>>> for parsing the arguments. Applications should implement Tool for the same.
>>>>> 2010-01-21 20:49:55,514 ERROR exec.ExecDriver
>>>>> (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
>>>>> errors
>>>>> 2010-01-21 20:49:55,550 ERROR ql.Driver
>>>>> (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2
>>>>> from org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>>
>>>>>
>>>>> On Thu, Jan 21, 2010 at 3:37 PM, John Villa <jo...@gmail.com>wrote:
>>>>>
>>>>>> Has anyone seen this error? Any help is appreciated, thanks;
>>>>>>
>>>>>> hive> select * from apachelog where host ="64.62.191.114";
>>>>>> Total MapReduce jobs = 1
>>>>>> Number of reduce tasks is set to 0 since there's no reduce operator
>>>>>> Starting Job = job_201001211744_0002, Tracking URL =
>>>>>> http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
>>>>>> Kill Command = /u01/hadoop/bin/../bin/hadoop job
>>>>>> -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
>>>>>> 2010-01-21 07:24:38,198 map = 0%, reduce =0%
>>>>>> 2010-01-21 07:25:15,029 map = 100%, reduce =100%
>>>>>> Ended Job = job_201001211744_0002 with errors
>>>>>> FAILED: Execution Error, return code 2 from
>>>>>> org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>
>>
>
>
Re: Hive Execution Errors
Posted by Ning Zhang <nz...@facebook.com>.
Thanks Carl. I'll take a look at the patch for HIVE-1063.
Ning
On Jan 21, 2010, at 3:44 PM, Carl Steinbach wrote:
The naming convention for Hive jar files was changed in HIVE-978 from hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all Hive jars *except* hive_contrib.jar which was not changed because the hive_contrib.jar filename is referenced in several test cases. HIVE-1063 fixes this problem by providing the ability to reference system property variables in test case qfiles.
Thanks.
Carl
On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang <nz...@facebook.com>> wrote:
This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
The RegexSerDe is included in hive_contrib.jar. There may be an bug of the name here because all other jar files are following the same convention hive-*-0.6.0.jar. If you see all the other jar files in the lib directory following the convention, you probably need to rename hive_contrib.jar to hive-contrib-0.6.0.jar. Can you try that and let us know the result?
Thanks,
Ning
On Jan 21, 2010, at 2:48 PM, John Villa wrote:
Here is the output;
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
On Thu, Jan 21, 2010 at 5:33 PM, John Villa <jo...@gmail.com>> wrote:
I am currently using hadoop 0.20.1. When I installed ant I did -Dhadoop.version="0.20.0"
I will try and get you that output but my connection is rough right now and I need to do a little port forwarding. I will get it to you when i can.
On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang <nz...@facebook.com>> wrote:
Which hadoop version are you using (you can see it by running 'hadoop version')? Have you specified hadoop.version when you compile Hive? Are they match?
Also can you post the log file found through the Tracking URL when you launch the job (in your example http://master:50030/jobdetails.jsp...)? The log files can be found by click through the mappers/reducers and at the rightmost column of the mapper/reducer stats.
On Jan 21, 2010, at 1:37 PM, John Villa wrote:
I did not see any hive jar files within hadoop lib directory. I compiled it using ant and the basic readme.
On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang <nz...@facebook.com>> wrote:
It may be because you have 2 copies of Hive's jar files (e.g., one in Hadoop's lib directory and one in Hive's lib directory) and they are from different releases. If you have compiled Hive trunk yoruself please make sure no Hive's jar files in the Hadoop's directory.
On Jan 21, 2010, at 12:51 PM, John Villa wrote:
Here is what I got from the hive log;
2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
2010-01-21 20:49:18,719 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
2010-01-21 20:49:55,514 ERROR exec.ExecDriver (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with errors
2010-01-21 20:49:55,550 ERROR ql.Driver (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
On Thu, Jan 21, 2010 at 3:37 PM, John Villa <jo...@gmail.com>> wrote:
Has anyone seen this error? Any help is appreciated, thanks;
hive> select * from apachelog where host ="64.62.191.114";
Total MapReduce jobs = 1
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_201001211744_0002, Tracking URL = http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
Kill Command = /u01/hadoop/bin/../bin/hadoop job -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
2010-01-21 07:24:38,198 map = 0%, reduce =0%
2010-01-21 07:25:15,029 map = 100%, reduce =100%
Ended Job = job_201001211744_0002 with errors
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
Re: Hive Execution Errors
Posted by Carl Steinbach <ca...@cloudera.com>.
The naming convention for Hive jar files was changed in HIVE-978 from
hive_foo.jar to hive-foo-VERSION.jar. This change currently affects all Hive
jars *except* hive_contrib.jar which was not changed because the
hive_contrib.jar filename is referenced in several test cases. HIVE-1063
fixes this problem by providing the ability to reference system property
variables in test case qfiles.
Thanks.
Carl
On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang <nz...@facebook.com> wrote:
> This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
> java.lang.ClassNotFoundException:
> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> The RegexSerDe is included in hive_contrib.jar. There may be an bug of the
> name here because all other jar files are following the same convention
> hive-*-0.6.0.jar. If you see all the other jar files in the lib directory
> following the convention, you probably need to rename hive_contrib.jar to
> hive-contrib-0.6.0.jar. Can you try that and let us know the result?
>
> Thanks,
> Ning
>
> On Jan 21, 2010, at 2:48 PM, John Villa wrote:
>
> Here is the output;
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
>
>
>
>
>
>
>
> On Thu, Jan 21, 2010 at 5:33 PM, John Villa <jo...@gmail.com>wrote:
>
>> I am currently using hadoop 0.20.1. When I installed ant I did
>> -Dhadoop.version="0.20.0"
>> I will try and get you that output but my connection is rough right now
>> and I need to do a little port forwarding. I will get it to you when i can.
>>
>>
>>
>> On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang <nz...@facebook.com> wrote:
>>
>>> Which hadoop version are you using (you can see it by running 'hadoop
>>> version')? Have you specified hadoop.version when you compile Hive? Are they
>>> match?
>>>
>>> Also can you post the log file found through the Tracking URL when you
>>> launch the job (in your example http://master:50030/jobdetails.jsp...)?
>>> The log files can be found by click through the mappers/reducers and at the
>>> rightmost column of the mapper/reducer stats.
>>>
>>>
>>> On Jan 21, 2010, at 1:37 PM, John Villa wrote:
>>>
>>> I did not see any hive jar files within hadoop lib directory. I compiled
>>> it using ant and the basic readme.
>>>
>>> On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang <nz...@facebook.com> wrote:
>>>
>>>> It may be because you have 2 copies of Hive's jar files (e.g., one in
>>>> Hadoop's lib directory and one in Hive's lib directory) and they are from
>>>> different releases. If you have compiled Hive trunk yoruself please make
>>>> sure no Hive's jar files in the Hadoop's directory.
>>>>
>>>>
>>>> On Jan 21, 2010, at 12:51 PM, John Villa wrote:
>>>>
>>>> Here is what I got from the hive log;
>>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>> "org.eclipse.core.resources" but it cannot be resolved.
>>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>> "org.eclipse.core.resources" but it cannot be resolved.
>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>> "org.eclipse.text" but it cannot be resolved.
>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>> "org.eclipse.text" but it cannot be resolved.
>>>> 2010-01-21 20:49:18,719 WARN mapred.JobClient
>>>> (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
>>>> for parsing the arguments. Applications should implement Tool for the same.
>>>> 2010-01-21 20:49:55,514 ERROR exec.ExecDriver
>>>> (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
>>>> errors
>>>> 2010-01-21 20:49:55,550 ERROR ql.Driver
>>>> (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2
>>>> from org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>
>>>>
>>>> On Thu, Jan 21, 2010 at 3:37 PM, John Villa <jo...@gmail.com>wrote:
>>>>
>>>>> Has anyone seen this error? Any help is appreciated, thanks;
>>>>>
>>>>> hive> select * from apachelog where host ="64.62.191.114";
>>>>> Total MapReduce jobs = 1
>>>>> Number of reduce tasks is set to 0 since there's no reduce operator
>>>>> Starting Job = job_201001211744_0002, Tracking URL =
>>>>> http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
>>>>> Kill Command = /u01/hadoop/bin/../bin/hadoop job
>>>>> -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
>>>>> 2010-01-21 07:24:38,198 map = 0%, reduce =0%
>>>>> 2010-01-21 07:25:15,029 map = 100%, reduce =100%
>>>>> Ended Job = job_201001211744_0002 with errors
>>>>> FAILED: Execution Error, return code 2 from
>>>>> org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>
>
>
Re: Hive Execution Errors
Posted by Carl Steinbach <ca...@cloudera.com>.
Hi John,
I think you forgot to add hive_contrib.jar to the distributed cache using
the "add jar" command? I recommend looking at the RegexSerDe testcase
located in contrib/src/test/queries/clientpositive/serde_regex.q for an
example of how to register the hive_contrib jar.
Thanks.
Carl
On Thu, Jan 21, 2010 at 3:19 PM, Ning Zhang <nz...@facebook.com> wrote:
> This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
> java.lang.ClassNotFoundException:
> org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> The RegexSerDe is included in hive_contrib.jar. There may be an bug of the
> name here because all other jar files are following the same convention
> hive-*-0.6.0.jar. If you see all the other jar files in the lib directory
> following the convention, you probably need to rename hive_contrib.jar to
> hive-contrib-0.6.0.jar. Can you try that and let us know the result?
>
> Thanks,
> Ning
>
> On Jan 21, 2010, at 2:48 PM, John Villa wrote:
>
> Here is the output;
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
>
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 5 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>
> ... 10 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>
> ... 13 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
> ... 18 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
> ... 18 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:247)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
>
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
> ... 19 more
>
>
>
>
>
>
>
>
> On Thu, Jan 21, 2010 at 5:33 PM, John Villa <jo...@gmail.com>wrote:
>
>> I am currently using hadoop 0.20.1. When I installed ant I did
>> -Dhadoop.version="0.20.0"
>> I will try and get you that output but my connection is rough right now
>> and I need to do a little port forwarding. I will get it to you when i can.
>>
>>
>>
>> On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang <nz...@facebook.com> wrote:
>>
>>> Which hadoop version are you using (you can see it by running 'hadoop
>>> version')? Have you specified hadoop.version when you compile Hive? Are they
>>> match?
>>>
>>> Also can you post the log file found through the Tracking URL when you
>>> launch the job (in your example http://master:50030/jobdetails.jsp...)?
>>> The log files can be found by click through the mappers/reducers and at the
>>> rightmost column of the mapper/reducer stats.
>>>
>>>
>>> On Jan 21, 2010, at 1:37 PM, John Villa wrote:
>>>
>>> I did not see any hive jar files within hadoop lib directory. I compiled
>>> it using ant and the basic readme.
>>>
>>> On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang <nz...@facebook.com> wrote:
>>>
>>>> It may be because you have 2 copies of Hive's jar files (e.g., one in
>>>> Hadoop's lib directory and one in Hive's lib directory) and they are from
>>>> different releases. If you have compiled Hive trunk yoruself please make
>>>> sure no Hive's jar files in the Hadoop's directory.
>>>>
>>>>
>>>> On Jan 21, 2010, at 12:51 PM, John Villa wrote:
>>>>
>>>> Here is what I got from the hive log;
>>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>> "org.eclipse.core.resources" but it cannot be resolved.
>>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>> "org.eclipse.core.resources" but it cannot be resolved.
>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>> "org.eclipse.text" but it cannot be resolved.
>>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>>> "org.eclipse.text" but it cannot be resolved.
>>>> 2010-01-21 20:49:18,719 WARN mapred.JobClient
>>>> (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
>>>> for parsing the arguments. Applications should implement Tool for the same.
>>>> 2010-01-21 20:49:55,514 ERROR exec.ExecDriver
>>>> (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
>>>> errors
>>>> 2010-01-21 20:49:55,550 ERROR ql.Driver
>>>> (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2
>>>> from org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>
>>>>
>>>> On Thu, Jan 21, 2010 at 3:37 PM, John Villa <jo...@gmail.com>wrote:
>>>>
>>>>> Has anyone seen this error? Any help is appreciated, thanks;
>>>>>
>>>>> hive> select * from apachelog where host ="64.62.191.114";
>>>>> Total MapReduce jobs = 1
>>>>> Number of reduce tasks is set to 0 since there's no reduce operator
>>>>> Starting Job = job_201001211744_0002, Tracking URL =
>>>>> http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
>>>>> Kill Command = /u01/hadoop/bin/../bin/hadoop job
>>>>> -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
>>>>> 2010-01-21 07:24:38,198 map = 0%, reduce =0%
>>>>> 2010-01-21 07:25:15,029 map = 100%, reduce =100%
>>>>> Ended Job = job_201001211744_0002 with errors
>>>>> FAILED: Execution Error, return code 2 from
>>>>> org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>
>
>
Re: Hive Execution Errors
Posted by Ning Zhang <nz...@facebook.com>.
This is Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
The RegexSerDe is included in hive_contrib.jar. There may be an bug of the name here because all other jar files are following the same convention hive-*-0.6.0.jar. If you see all the other jar files in the lib directory following the convention, you probably need to rename hive_contrib.jar to hive-contrib-0.6.0.jar. Can you try that and let us know the result?
Thanks,
Ning
On Jan 21, 2010, at 2:48 PM, John Villa wrote:
Here is the output;
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
On Thu, Jan 21, 2010 at 5:33 PM, John Villa <jo...@gmail.com>> wrote:
I am currently using hadoop 0.20.1. When I installed ant I did -Dhadoop.version="0.20.0"
I will try and get you that output but my connection is rough right now and I need to do a little port forwarding. I will get it to you when i can.
On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang <nz...@facebook.com>> wrote:
Which hadoop version are you using (you can see it by running 'hadoop version')? Have you specified hadoop.version when you compile Hive? Are they match?
Also can you post the log file found through the Tracking URL when you launch the job (in your example http://master:50030/jobdetails.jsp...)? The log files can be found by click through the mappers/reducers and at the rightmost column of the mapper/reducer stats.
On Jan 21, 2010, at 1:37 PM, John Villa wrote:
I did not see any hive jar files within hadoop lib directory. I compiled it using ant and the basic readme.
On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang <nz...@facebook.com>> wrote:
It may be because you have 2 copies of Hive's jar files (e.g., one in Hadoop's lib directory and one in Hive's lib directory) and they are from different releases. If you have compiled Hive trunk yoruself please make sure no Hive's jar files in the Hadoop's directory.
On Jan 21, 2010, at 12:51 PM, John Villa wrote:
Here is what I got from the hive log;
2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
2010-01-21 20:49:18,719 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
2010-01-21 20:49:55,514 ERROR exec.ExecDriver (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with errors
2010-01-21 20:49:55,550 ERROR ql.Driver (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
On Thu, Jan 21, 2010 at 3:37 PM, John Villa <jo...@gmail.com>> wrote:
Has anyone seen this error? Any help is appreciated, thanks;
hive> select * from apachelog where host ="64.62.191.114";
Total MapReduce jobs = 1
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_201001211744_0002, Tracking URL = http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
Kill Command = /u01/hadoop/bin/../bin/hadoop job -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
2010-01-21 07:24:38,198 map = 0%, reduce =0%
2010-01-21 07:25:15,029 map = 100%, reduce =100%
Ended Job = job_201001211744_0002 with errors
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
Re: Hive Execution Errors
Posted by John Villa <jo...@gmail.com>.
Here is the output;
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:277)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:80)
... 18 more
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:178)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:240)
... 19 more
On Thu, Jan 21, 2010 at 5:33 PM, John Villa <jo...@gmail.com>wrote:
> I am currently using hadoop 0.20.1. When I installed ant I did
> -Dhadoop.version="0.20.0"
> I will try and get you that output but my connection is rough right now and
> I need to do a little port forwarding. I will get it to you when i can.
>
>
>
> On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang <nz...@facebook.com> wrote:
>
>> Which hadoop version are you using (you can see it by running 'hadoop
>> version')? Have you specified hadoop.version when you compile Hive? Are they
>> match?
>>
>> Also can you post the log file found through the Tracking URL when you
>> launch the job (in your example http://master:50030/jobdetails.jsp...)?
>> The log files can be found by click through the mappers/reducers and at the
>> rightmost column of the mapper/reducer stats.
>>
>>
>> On Jan 21, 2010, at 1:37 PM, John Villa wrote:
>>
>> I did not see any hive jar files within hadoop lib directory. I compiled
>> it using ant and the basic readme.
>>
>> On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang <nz...@facebook.com> wrote:
>>
>>> It may be because you have 2 copies of Hive's jar files (e.g., one in
>>> Hadoop's lib directory and one in Hive's lib directory) and they are from
>>> different releases. If you have compiled Hive trunk yoruself please make
>>> sure no Hive's jar files in the Hadoop's directory.
>>>
>>>
>>> On Jan 21, 2010, at 12:51 PM, John Villa wrote:
>>>
>>> Here is what I got from the hive log;
>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>> "org.eclipse.core.resources" but it cannot be resolved.
>>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>> "org.eclipse.core.resources" but it cannot be resolved.
>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>> "org.eclipse.core.runtime" but it cannot be resolved.
>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>> "org.eclipse.text" but it cannot be resolved.
>>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>>> "org.eclipse.text" but it cannot be resolved.
>>> 2010-01-21 20:49:18,719 WARN mapred.JobClient
>>> (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
>>> for parsing the arguments. Applications should implement Tool for the same.
>>> 2010-01-21 20:49:55,514 ERROR exec.ExecDriver
>>> (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
>>> errors
>>> 2010-01-21 20:49:55,550 ERROR ql.Driver
>>> (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2
>>> from org.apache.hadoop.hive.ql.exec.ExecDriver
>>>
>>>
>>> On Thu, Jan 21, 2010 at 3:37 PM, John Villa <jo...@gmail.com>wrote:
>>>
>>>> Has anyone seen this error? Any help is appreciated, thanks;
>>>>
>>>> hive> select * from apachelog where host ="64.62.191.114";
>>>> Total MapReduce jobs = 1
>>>> Number of reduce tasks is set to 0 since there's no reduce operator
>>>> Starting Job = job_201001211744_0002, Tracking URL =
>>>> http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
>>>> Kill Command = /u01/hadoop/bin/../bin/hadoop job
>>>> -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
>>>> 2010-01-21 07:24:38,198 map = 0%, reduce =0%
>>>> 2010-01-21 07:25:15,029 map = 100%, reduce =100%
>>>> Ended Job = job_201001211744_0002 with errors
>>>> FAILED: Execution Error, return code 2 from
>>>> org.apache.hadoop.hive.ql.exec.ExecDriver
>>>>
>>>
>>>
>>>
>>
>>
>
Re: Hive Execution Errors
Posted by John Villa <jo...@gmail.com>.
I am currently using hadoop 0.20.1. When I installed ant I did
-Dhadoop.version="0.20.0"
I will try and get you that output but my connection is rough right now and
I need to do a little port forwarding. I will get it to you when i can.
On Thu, Jan 21, 2010 at 5:04 PM, Ning Zhang <nz...@facebook.com> wrote:
> Which hadoop version are you using (you can see it by running 'hadoop
> version')? Have you specified hadoop.version when you compile Hive? Are they
> match?
>
> Also can you post the log file found through the Tracking URL when you
> launch the job (in your example http://master:50030/jobdetails.jsp...)?
> The log files can be found by click through the mappers/reducers and at the
> rightmost column of the mapper/reducer stats.
>
>
> On Jan 21, 2010, at 1:37 PM, John Villa wrote:
>
> I did not see any hive jar files within hadoop lib directory. I compiled it
> using ant and the basic readme.
>
> On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang <nz...@facebook.com> wrote:
>
>> It may be because you have 2 copies of Hive's jar files (e.g., one in
>> Hadoop's lib directory and one in Hive's lib directory) and they are from
>> different releases. If you have compiled Hive trunk yoruself please make
>> sure no Hive's jar files in the Hadoop's directory.
>>
>>
>> On Jan 21, 2010, at 12:51 PM, John Villa wrote:
>>
>> Here is what I got from the hive log;
>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>> "org.eclipse.core.resources" but it cannot be resolved.
>> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>> "org.eclipse.core.resources" but it cannot be resolved.
>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>> "org.eclipse.core.runtime" but it cannot be resolved.
>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>> "org.eclipse.core.runtime" but it cannot be resolved.
>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>> "org.eclipse.text" but it cannot be resolved.
>> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
>> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
>> "org.eclipse.text" but it cannot be resolved.
>> 2010-01-21 20:49:18,719 WARN mapred.JobClient
>> (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
>> for parsing the arguments. Applications should implement Tool for the same.
>> 2010-01-21 20:49:55,514 ERROR exec.ExecDriver
>> (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
>> errors
>> 2010-01-21 20:49:55,550 ERROR ql.Driver
>> (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2
>> from org.apache.hadoop.hive.ql.exec.ExecDriver
>>
>>
>> On Thu, Jan 21, 2010 at 3:37 PM, John Villa <jo...@gmail.com>wrote:
>>
>>> Has anyone seen this error? Any help is appreciated, thanks;
>>>
>>> hive> select * from apachelog where host ="64.62.191.114";
>>> Total MapReduce jobs = 1
>>> Number of reduce tasks is set to 0 since there's no reduce operator
>>> Starting Job = job_201001211744_0002, Tracking URL =
>>> http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
>>> Kill Command = /u01/hadoop/bin/../bin/hadoop job
>>> -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
>>> 2010-01-21 07:24:38,198 map = 0%, reduce =0%
>>> 2010-01-21 07:25:15,029 map = 100%, reduce =100%
>>> Ended Job = job_201001211744_0002 with errors
>>> FAILED: Execution Error, return code 2 from
>>> org.apache.hadoop.hive.ql.exec.ExecDriver
>>>
>>
>>
>>
>
>
Re: Hive Execution Errors
Posted by Ning Zhang <nz...@facebook.com>.
Which hadoop version are you using (you can see it by running 'hadoop version')? Have you specified hadoop.version when you compile Hive? Are they match?
Also can you post the log file found through the Tracking URL when you launch the job (in your example http://master:50030/jobdetails.jsp...)? The log files can be found by click through the mappers/reducers and at the rightmost column of the mapper/reducer stats.
On Jan 21, 2010, at 1:37 PM, John Villa wrote:
I did not see any hive jar files within hadoop lib directory. I compiled it using ant and the basic readme.
On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang <nz...@facebook.com>> wrote:
It may be because you have 2 copies of Hive's jar files (e.g., one in Hadoop's lib directory and one in Hive's lib directory) and they are from different releases. If you have compiled Hive trunk yoruself please make sure no Hive's jar files in the Hadoop's directory.
On Jan 21, 2010, at 12:51 PM, John Villa wrote:
Here is what I got from the hive log;
2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
2010-01-21 20:49:18,719 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
2010-01-21 20:49:55,514 ERROR exec.ExecDriver (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with errors
2010-01-21 20:49:55,550 ERROR ql.Driver (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
On Thu, Jan 21, 2010 at 3:37 PM, John Villa <jo...@gmail.com>> wrote:
Has anyone seen this error? Any help is appreciated, thanks;
hive> select * from apachelog where host ="64.62.191.114";
Total MapReduce jobs = 1
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_201001211744_0002, Tracking URL = http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
Kill Command = /u01/hadoop/bin/../bin/hadoop job -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
2010-01-21 07:24:38,198 map = 0%, reduce =0%
2010-01-21 07:25:15,029 map = 100%, reduce =100%
Ended Job = job_201001211744_0002 with errors
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
Re: Hive Execution Errors
Posted by John Villa <jo...@gmail.com>.
I did not see any hive jar files within hadoop lib directory. I compiled it
using ant and the basic readme.
On Thu, Jan 21, 2010 at 4:17 PM, Ning Zhang <nz...@facebook.com> wrote:
> It may be because you have 2 copies of Hive's jar files (e.g., one in
> Hadoop's lib directory and one in Hive's lib directory) and they are from
> different releases. If you have compiled Hive trunk yoruself please make
> sure no Hive's jar files in the Hadoop's directory.
>
>
> On Jan 21, 2010, at 12:51 PM, John Villa wrote:
>
> Here is what I got from the hive log;
> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
> "org.eclipse.core.resources" but it cannot be resolved.
> 2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
> "org.eclipse.core.resources" but it cannot be resolved.
> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
> "org.eclipse.core.runtime" but it cannot be resolved.
> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
> "org.eclipse.core.runtime" but it cannot be resolved.
> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
> "org.eclipse.text" but it cannot be resolved.
> 2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
> "org.eclipse.text" but it cannot be resolved.
> 2010-01-21 20:49:18,719 WARN mapred.JobClient
> (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
> for parsing the arguments. Applications should implement Tool for the same.
> 2010-01-21 20:49:55,514 ERROR exec.ExecDriver
> (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
> errors
> 2010-01-21 20:49:55,550 ERROR ql.Driver (SessionState.java:printError(279))
> - FAILED: Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.ExecDriver
>
>
> On Thu, Jan 21, 2010 at 3:37 PM, John Villa <jo...@gmail.com>wrote:
>
>> Has anyone seen this error? Any help is appreciated, thanks;
>>
>> hive> select * from apachelog where host ="64.62.191.114";
>> Total MapReduce jobs = 1
>> Number of reduce tasks is set to 0 since there's no reduce operator
>> Starting Job = job_201001211744_0002, Tracking URL =
>> http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
>> Kill Command = /u01/hadoop/bin/../bin/hadoop job
>> -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
>> 2010-01-21 07:24:38,198 map = 0%, reduce =0%
>> 2010-01-21 07:25:15,029 map = 100%, reduce =100%
>> Ended Job = job_201001211744_0002 with errors
>> FAILED: Execution Error, return code 2 from
>> org.apache.hadoop.hive.ql.exec.ExecDriver
>>
>
>
>
Re: Hive Execution Errors
Posted by Ning Zhang <nz...@facebook.com>.
It may be because you have 2 copies of Hive's jar files (e.g., one in Hadoop's lib directory and one in Hive's lib directory) and they are from different releases. If you have compiled Hive trunk yoruself please make sure no Hive's jar files in the Hadoop's directory.
On Jan 21, 2010, at 12:51 PM, John Villa wrote:
Here is what I got from the hive log;
2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
2010-01-21 20:49:18,719 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
2010-01-21 20:49:55,514 ERROR exec.ExecDriver (SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with errors
2010-01-21 20:49:55,550 ERROR ql.Driver (SessionState.java:printError(279)) - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
On Thu, Jan 21, 2010 at 3:37 PM, John Villa <jo...@gmail.com>> wrote:
Has anyone seen this error? Any help is appreciated, thanks;
hive> select * from apachelog where host ="64.62.191.114";
Total MapReduce jobs = 1
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_201001211744_0002, Tracking URL = http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
Kill Command = /u01/hadoop/bin/../bin/hadoop job -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
2010-01-21 07:24:38,198 map = 0%, reduce =0%
2010-01-21 07:25:15,029 map = 100%, reduce =100%
Ended Job = job_201001211744_0002 with errors
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
Re: Hive Execution Errors
Posted by John Villa <jo...@gmail.com>.
Here is what I got from the hive log;
2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
(Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
"org.eclipse.core.resources" but it cannot be resolved.
2010-01-21 20:49:13,291 ERROR DataNucleus.Plugin
(Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
"org.eclipse.core.resources" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
(Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
"org.eclipse.core.runtime" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
(Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
"org.eclipse.core.runtime" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
(Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
"org.eclipse.text" but it cannot be resolved.
2010-01-21 20:49:13,294 ERROR DataNucleus.Plugin
(Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
"org.eclipse.text" but it cannot be resolved.
2010-01-21 20:49:18,719 WARN mapred.JobClient
(JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
for parsing the arguments. Applications should implement Tool for the same.
2010-01-21 20:49:55,514 ERROR exec.ExecDriver
(SessionState.java:printError(279)) - Ended Job = job_201001211744_0008 with
errors
2010-01-21 20:49:55,550 ERROR ql.Driver (SessionState.java:printError(279))
- FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.ExecDriver
On Thu, Jan 21, 2010 at 3:37 PM, John Villa <jo...@gmail.com>wrote:
> Has anyone seen this error? Any help is appreciated, thanks;
>
> hive> select * from apachelog where host ="64.62.191.114";
> Total MapReduce jobs = 1
> Number of reduce tasks is set to 0 since there's no reduce operator
> Starting Job = job_201001211744_0002, Tracking URL =
> http://master:50030/jobdetails.jsp?jobid=job_201001211744_0002
> Kill Command = /u01/hadoop/bin/../bin/hadoop job
> -Dmapred.job.tracker=master:54311 -kill job_201001211744_0002
> 2010-01-21 07:24:38,198 map = 0%, reduce =0%
> 2010-01-21 07:25:15,029 map = 100%, reduce =100%
> Ended Job = job_201001211744_0002 with errors
> FAILED: Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.ExecDriver
>