You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Tim Havens <ti...@gmail.com> on 2012/01/22 18:25:52 UTC
FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.FunctionTask
I have a similar UDF to this one which create's just fine.
I cam seem to resolve what 'return code -101' means however with this
one.
Can anyone tell me what 'return code -101' means?
My StemTermsUDF.jar has the proper classpath for the JWNL jars
already, I'm trying to insure they've REALLY available by 'add jar'
within hive.
All the paths are correct and I've checked them MANY times to be sure
before posting this.
hive> add file /usr/lib/hadoop/lib/jwnl/jwnl_properties.xml;
Added resource: /usr/lib/hadoop/lib/jwnl/jwnl_properties.xml
hive> add jar /usr/lib/hive/lib/jwnl/jwnl.jar;
Added /usr/lib/hive/lib/jwnl/jwnl.jar to class path
Added resource: /usr/lib/hive/lib/jwnl/jwnl.jar
hive> add jar /usr/lib/hive/lib/jwnl/commons-logging.jar;
Added /usr/lib/hive/lib/jwnl/commons-logging.jar to class path
Added resource: /usr/lib/hive/lib/jwnl/commons-logging.jar
hive> add jar StemTermsUDF.jar;
Added StemTermsUDF.jar to class path
Added resource: StemTermsUDF.jar
hive> create temporary function StemTermsUDF as
'org.apache.hadoop.hive.ql.udf.StemTermsUDF';
java.lang.NoClassDefFoundError: net/didion/jwnl/JWNLException
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at
org.apache.hadoop.hive.ql.exec.FunctionTask.getUdfClass(FunctionTask.java:
119)
at
org.apache.hadoop.hive.ql.exec.FunctionTask.createFunction(FunctionTask.
java:
75)
at
org.apache.hadoop.hive.ql.exec.FunctionTask.execute(FunctionTask.java:
63)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:
130)
at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:
57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:
1063)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
at
org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209)
at
org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:
516)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(
DelegatingMethodAccessorImpl.java:
43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
Caused by: java.lang.ClassNotFoundException:
net.didion.jwnl.JWNLException
at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:
294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
... 18 more
FAILED: Execution Error, return code -101 from
org.apache.hadoop.hive.ql.exec.FunctionTask
Re: FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.FunctionTask
Posted by Aniket Mokashi <an...@gmail.com>.
auxpath is not going to solve this problem. You have to set your
HADOOP_CLASSPATH for it. From the error it seems that your job client is
not able to load the class from classpath.
Try -
export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/reports/hive/ddc_jars/jwnl.jar
$ hive
hive> add jar ...
hive> create temporary ..
In my last email, I mentioned about auxlib directory, hive shell scripts
picks up all the jars in this directory and puts it in HADOOP_CLASSPATH and
auxpath.
thanks,
Aniket
On Sun, Jan 22, 2012 at 2:08 PM, Tim Havens <ti...@gmail.com> wrote:
> hive --auxpath /reports/hive/ddc_jars/jwnl.jar
> Hive history
> file=/tmp/thavens/hive_job_log_thavens_201201222205_2003418921.txt
> hive> create temporary function StemTermsUDF as
> 'org.apache.hadoop.hive.ql.udf.StemTermsUDF';
> OK
> Time taken: 0.005 seconds
>
> however:
>
> With in .hiverc with:
> add jar /reports/hive/ddc_jars/jwnl.jar
>
> AND
> /etc/hive/conf/hive-site.xml
>
> <property>
> <name>hive.aux.jars.path</name>
> <value>/reports/hive/ddc_jars</value>
> </property>
>
> results in:
>
> hive> create temporary function StemTermsUDF as
> 'org.apache.hadoop.hive.ql.udf.StemTermsUDF';
> java.lang.NoClassDefFoundError: net/didion/jwnl/JWNLException
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:264)
> at
> org.apache.hadoop.hive.ql.exec.FunctionTask.getUdfClass(FunctionTask.java:119)
> at
> org.apache.hadoop.hive.ql.exec.FunctionTask.createFunction(FunctionTask.java:75)
> at
> org.apache.hadoop.hive.ql.exec.FunctionTask.execute(FunctionTask.java:63)
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
> at
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
> at
> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209)
> at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:516)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:616)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
> Caused by: java.lang.ClassNotFoundException: net.didion.jwnl.JWNLException
> at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
> ... 18 more
> FAILED: Execution Error, return code -101 from
> org.apache.hadoop.hive.ql.exec.FunctionTask
>
> On Sun, Jan 22, 2012 at 3:43 PM, Tim Havens <ti...@gmail.com> wrote:
>
>> Unfortunately the issue appears to be something with the Jar, or my UDF.
>>
>> What I can't seem to resolve is what is causing the -101 Error Code.
>>
>> Tim
>>
>>
>> On Sun, Jan 22, 2012 at 3:26 PM, Aniket Mokashi <an...@gmail.com>wrote:
>>
>>> A simplest way would be to put the jar in auxlib directory. That does
>>> the both for you I guess. After that you can directly create temporary
>>> function in hive.
>>>
>>> ~Aniket
>>>
>>>
>>> On Sun, Jan 22, 2012 at 1:24 PM, Aniket Mokashi <an...@gmail.com>wrote:
>>>
>>>> Add the jar to HADOOP_CLASSPATH when you launch hive. That should help.
>>>>
>>>> Thanks,
>>>> Aniket
>>>>
>>>>
>>>> On Sun, Jan 22, 2012 at 9:25 AM, Tim Havens <ti...@gmail.com>wrote:
>>>>
>>>>> I have a similar UDF to this one which create's just fine.
>>>>>
>>>>> I cam seem to resolve what 'return code -101' means however with this
>>>>> one.
>>>>>
>>>>> Can anyone tell me what 'return code -101' means?
>>>>>
>>>>> My StemTermsUDF.jar has the proper classpath for the JWNL jars
>>>>> already, I'm trying to insure they've REALLY available by 'add jar'
>>>>> within hive.
>>>>>
>>>>> All the paths are correct and I've checked them MANY times to be sure
>>>>> before posting this.
>>>>>
>>>>> hive> add file /usr/lib/hadoop/lib/jwnl/jwnl_properties.xml;
>>>>> Added resource: /usr/lib/hadoop/lib/jwnl/jwnl_properties.xml
>>>>> hive> add jar /usr/lib/hive/lib/jwnl/jwnl.jar;
>>>>> Added /usr/lib/hive/lib/jwnl/jwnl.jar to class path
>>>>> Added resource: /usr/lib/hive/lib/jwnl/jwnl.jar
>>>>> hive> add jar /usr/lib/hive/lib/jwnl/commons-logging.jar;
>>>>> Added /usr/lib/hive/lib/jwnl/commons-logging.jar to class path
>>>>> Added resource: /usr/lib/hive/lib/jwnl/commons-logging.jar
>>>>> hive> add jar StemTermsUDF.jar;
>>>>> Added StemTermsUDF.jar to class path
>>>>> Added resource: StemTermsUDF.jar
>>>>> hive> create temporary function StemTermsUDF as
>>>>> 'org.apache.hadoop.hive.ql.udf.StemTermsUDF';
>>>>> java.lang.NoClassDefFoundError: net/didion/jwnl/JWNLException
>>>>> at java.lang.Class.forName0(Native Method)
>>>>> at java.lang.Class.forName(Class.java:264)
>>>>> at
>>>>> org.apache.hadoop.hive.ql.exec.FunctionTask.getUdfClass(
>>>>> FunctionTask.java:
>>>>> 119)
>>>>> at
>>>>> org.apache.hadoop.hive.ql.exec.FunctionTask.
>>>>> createFunction(FunctionTask.java:
>>>>> 75)
>>>>> at
>>>>> org.apache.hadoop.hive.ql.exec.FunctionTask.execute(FunctionTask.java:
>>>>> 63)
>>>>> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:
>>>>> 130)
>>>>> at
>>>>> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(
>>>>> TaskRunner.java:
>>>>> 57)
>>>>> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:
>>>>> 1063)
>>>>> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
>>>>> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
>>>>> at
>>>>> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209)
>>>>> at
>>>>> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286)
>>>>> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:
>>>>> 516)
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>> at
>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(
>>>>> NativeMethodAccessorImpl.java:
>>>>> 57)
>>>>> at
>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(
>>>>> DelegatingMethodAccessorImpl.java:
>>>>> 43)
>>>>> at java.lang.reflect.Method.invoke(Method.java:616)
>>>>> at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
>>>>> Caused by: java.lang.ClassNotFoundException:
>>>>> net.didion.jwnl.JWNLException
>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:
>>>>> 294)
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
>>>>> ... 18 more
>>>>> FAILED: Execution Error, return code -101 from
>>>>> org.apache.hadoop.hive.ql.exec.FunctionTask
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> "...:::Aniket:::... Quetzalco@tl"
>>>>
>>>
>>>
>>>
>>> --
>>> "...:::Aniket:::... Quetzalco@tl"
>>>
>>
>>
>>
>
>
> --
> "The whole world is you. Yet you keep thinking there is something else." -
> Xuefeng Yicun 822-902 A.D.
>
> Tim R. Havens
> Google Phone: 573.454.1232
> ICQ: 495992798
> ICBM: 37°51'34.79"N 90°35'24.35"W
> ham radio callsign: NW0W
>
--
"...:::Aniket:::... Quetzalco@tl"
Re: FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.FunctionTask
Posted by Tim Havens <ti...@gmail.com>.
hive --auxpath /reports/hive/ddc_jars/jwnl.jar
Hive history
file=/tmp/thavens/hive_job_log_thavens_201201222205_2003418921.txt
hive> create temporary function StemTermsUDF as
'org.apache.hadoop.hive.ql.udf.StemTermsUDF';
OK
Time taken: 0.005 seconds
however:
With in .hiverc with:
add jar /reports/hive/ddc_jars/jwnl.jar
AND
/etc/hive/conf/hive-site.xml
<property>
<name>hive.aux.jars.path</name>
<value>/reports/hive/ddc_jars</value>
</property>
results in:
hive> create temporary function StemTermsUDF as
'org.apache.hadoop.hive.ql.udf.StemTermsUDF';
java.lang.NoClassDefFoundError: net/didion/jwnl/JWNLException
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at
org.apache.hadoop.hive.ql.exec.FunctionTask.getUdfClass(FunctionTask.java:119)
at
org.apache.hadoop.hive.ql.exec.FunctionTask.createFunction(FunctionTask.java:75)
at
org.apache.hadoop.hive.ql.exec.FunctionTask.execute(FunctionTask.java:63)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
at
org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209)
at
org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:516)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
Caused by: java.lang.ClassNotFoundException: net.didion.jwnl.JWNLException
at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
... 18 more
FAILED: Execution Error, return code -101 from
org.apache.hadoop.hive.ql.exec.FunctionTask
On Sun, Jan 22, 2012 at 3:43 PM, Tim Havens <ti...@gmail.com> wrote:
> Unfortunately the issue appears to be something with the Jar, or my UDF.
>
> What I can't seem to resolve is what is causing the -101 Error Code.
>
> Tim
>
>
> On Sun, Jan 22, 2012 at 3:26 PM, Aniket Mokashi <an...@gmail.com>wrote:
>
>> A simplest way would be to put the jar in auxlib directory. That does the
>> both for you I guess. After that you can directly create temporary function
>> in hive.
>>
>> ~Aniket
>>
>>
>> On Sun, Jan 22, 2012 at 1:24 PM, Aniket Mokashi <an...@gmail.com>wrote:
>>
>>> Add the jar to HADOOP_CLASSPATH when you launch hive. That should help.
>>>
>>> Thanks,
>>> Aniket
>>>
>>>
>>> On Sun, Jan 22, 2012 at 9:25 AM, Tim Havens <ti...@gmail.com> wrote:
>>>
>>>> I have a similar UDF to this one which create's just fine.
>>>>
>>>> I cam seem to resolve what 'return code -101' means however with this
>>>> one.
>>>>
>>>> Can anyone tell me what 'return code -101' means?
>>>>
>>>> My StemTermsUDF.jar has the proper classpath for the JWNL jars
>>>> already, I'm trying to insure they've REALLY available by 'add jar'
>>>> within hive.
>>>>
>>>> All the paths are correct and I've checked them MANY times to be sure
>>>> before posting this.
>>>>
>>>> hive> add file /usr/lib/hadoop/lib/jwnl/jwnl_properties.xml;
>>>> Added resource: /usr/lib/hadoop/lib/jwnl/jwnl_properties.xml
>>>> hive> add jar /usr/lib/hive/lib/jwnl/jwnl.jar;
>>>> Added /usr/lib/hive/lib/jwnl/jwnl.jar to class path
>>>> Added resource: /usr/lib/hive/lib/jwnl/jwnl.jar
>>>> hive> add jar /usr/lib/hive/lib/jwnl/commons-logging.jar;
>>>> Added /usr/lib/hive/lib/jwnl/commons-logging.jar to class path
>>>> Added resource: /usr/lib/hive/lib/jwnl/commons-logging.jar
>>>> hive> add jar StemTermsUDF.jar;
>>>> Added StemTermsUDF.jar to class path
>>>> Added resource: StemTermsUDF.jar
>>>> hive> create temporary function StemTermsUDF as
>>>> 'org.apache.hadoop.hive.ql.udf.StemTermsUDF';
>>>> java.lang.NoClassDefFoundError: net/didion/jwnl/JWNLException
>>>> at java.lang.Class.forName0(Native Method)
>>>> at java.lang.Class.forName(Class.java:264)
>>>> at
>>>> org.apache.hadoop.hive.ql.exec.FunctionTask.getUdfClass(
>>>> FunctionTask.java:
>>>> 119)
>>>> at
>>>> org.apache.hadoop.hive.ql.exec.FunctionTask.
>>>> createFunction(FunctionTask.java:
>>>> 75)
>>>> at
>>>> org.apache.hadoop.hive.ql.exec.FunctionTask.execute(FunctionTask.java:
>>>> 63)
>>>> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:
>>>> 130)
>>>> at
>>>> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(
>>>> TaskRunner.java:
>>>> 57)
>>>> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:
>>>> 1063)
>>>> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
>>>> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
>>>> at
>>>> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209)
>>>> at
>>>> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286)
>>>> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:
>>>> 516)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at
>>>> sun.reflect.NativeMethodAccessorImpl.invoke(
>>>> NativeMethodAccessorImpl.java:
>>>> 57)
>>>> at
>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(
>>>> DelegatingMethodAccessorImpl.java:
>>>> 43)
>>>> at java.lang.reflect.Method.invoke(Method.java:616)
>>>> at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
>>>> Caused by: java.lang.ClassNotFoundException:
>>>> net.didion.jwnl.JWNLException
>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:
>>>> 294)
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
>>>> ... 18 more
>>>> FAILED: Execution Error, return code -101 from
>>>> org.apache.hadoop.hive.ql.exec.FunctionTask
>>>
>>>
>>>
>>>
>>> --
>>> "...:::Aniket:::... Quetzalco@tl"
>>>
>>
>>
>>
>> --
>> "...:::Aniket:::... Quetzalco@tl"
>>
>
>
>
--
"The whole world is you. Yet you keep thinking there is something else." -
Xuefeng Yicun 822-902 A.D.
Tim R. Havens
Google Phone: 573.454.1232
ICQ: 495992798
ICBM: 37°51'34.79"N 90°35'24.35"W
ham radio callsign: NW0W
Re: FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.FunctionTask
Posted by Tim Havens <ti...@gmail.com>.
Unfortunately the issue appears to be something with the Jar, or my UDF.
What I can't seem to resolve is what is causing the -101 Error Code.
Tim
On Sun, Jan 22, 2012 at 3:26 PM, Aniket Mokashi <an...@gmail.com> wrote:
> A simplest way would be to put the jar in auxlib directory. That does the
> both for you I guess. After that you can directly create temporary function
> in hive.
>
> ~Aniket
>
>
> On Sun, Jan 22, 2012 at 1:24 PM, Aniket Mokashi <an...@gmail.com>wrote:
>
>> Add the jar to HADOOP_CLASSPATH when you launch hive. That should help.
>>
>> Thanks,
>> Aniket
>>
>>
>> On Sun, Jan 22, 2012 at 9:25 AM, Tim Havens <ti...@gmail.com> wrote:
>>
>>> I have a similar UDF to this one which create's just fine.
>>>
>>> I cam seem to resolve what 'return code -101' means however with this
>>> one.
>>>
>>> Can anyone tell me what 'return code -101' means?
>>>
>>> My StemTermsUDF.jar has the proper classpath for the JWNL jars
>>> already, I'm trying to insure they've REALLY available by 'add jar'
>>> within hive.
>>>
>>> All the paths are correct and I've checked them MANY times to be sure
>>> before posting this.
>>>
>>> hive> add file /usr/lib/hadoop/lib/jwnl/jwnl_properties.xml;
>>> Added resource: /usr/lib/hadoop/lib/jwnl/jwnl_properties.xml
>>> hive> add jar /usr/lib/hive/lib/jwnl/jwnl.jar;
>>> Added /usr/lib/hive/lib/jwnl/jwnl.jar to class path
>>> Added resource: /usr/lib/hive/lib/jwnl/jwnl.jar
>>> hive> add jar /usr/lib/hive/lib/jwnl/commons-logging.jar;
>>> Added /usr/lib/hive/lib/jwnl/commons-logging.jar to class path
>>> Added resource: /usr/lib/hive/lib/jwnl/commons-logging.jar
>>> hive> add jar StemTermsUDF.jar;
>>> Added StemTermsUDF.jar to class path
>>> Added resource: StemTermsUDF.jar
>>> hive> create temporary function StemTermsUDF as
>>> 'org.apache.hadoop.hive.ql.udf.StemTermsUDF';
>>> java.lang.NoClassDefFoundError: net/didion/jwnl/JWNLException
>>> at java.lang.Class.forName0(Native Method)
>>> at java.lang.Class.forName(Class.java:264)
>>> at
>>> org.apache.hadoop.hive.ql.exec.FunctionTask.getUdfClass(
>>> FunctionTask.java:
>>> 119)
>>> at
>>> org.apache.hadoop.hive.ql.exec.FunctionTask.createFunction(FunctionTask.
>>> java:
>>> 75)
>>> at
>>> org.apache.hadoop.hive.ql.exec.FunctionTask.execute(FunctionTask.java:
>>> 63)
>>> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:
>>> 130)
>>> at
>>> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:
>>> 57)
>>> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:
>>> 1063)
>>> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
>>> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
>>> at
>>> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209)
>>> at
>>> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286)
>>> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:
>>> 516)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at
>>> sun.reflect.NativeMethodAccessorImpl.invoke(
>>> NativeMethodAccessorImpl.java:
>>> 57)
>>> at
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(
>>> DelegatingMethodAccessorImpl.java:
>>> 43)
>>> at java.lang.reflect.Method.invoke(Method.java:616)
>>> at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
>>> Caused by: java.lang.ClassNotFoundException:
>>> net.didion.jwnl.JWNLException
>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:
>>> 294)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
>>> ... 18 more
>>> FAILED: Execution Error, return code -101 from
>>> org.apache.hadoop.hive.ql.exec.FunctionTask
>>
>>
>>
>>
>> --
>> "...:::Aniket:::... Quetzalco@tl"
>>
>
>
>
> --
> "...:::Aniket:::... Quetzalco@tl"
>
Re: FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.FunctionTask
Posted by Aniket Mokashi <an...@gmail.com>.
A simplest way would be to put the jar in auxlib directory. That does the
both for you I guess. After that you can directly create temporary function
in hive.
~Aniket
On Sun, Jan 22, 2012 at 1:24 PM, Aniket Mokashi <an...@gmail.com> wrote:
> Add the jar to HADOOP_CLASSPATH when you launch hive. That should help.
>
> Thanks,
> Aniket
>
>
> On Sun, Jan 22, 2012 at 9:25 AM, Tim Havens <ti...@gmail.com> wrote:
>
>> I have a similar UDF to this one which create's just fine.
>>
>> I cam seem to resolve what 'return code -101' means however with this
>> one.
>>
>> Can anyone tell me what 'return code -101' means?
>>
>> My StemTermsUDF.jar has the proper classpath for the JWNL jars
>> already, I'm trying to insure they've REALLY available by 'add jar'
>> within hive.
>>
>> All the paths are correct and I've checked them MANY times to be sure
>> before posting this.
>>
>> hive> add file /usr/lib/hadoop/lib/jwnl/jwnl_properties.xml;
>> Added resource: /usr/lib/hadoop/lib/jwnl/jwnl_properties.xml
>> hive> add jar /usr/lib/hive/lib/jwnl/jwnl.jar;
>> Added /usr/lib/hive/lib/jwnl/jwnl.jar to class path
>> Added resource: /usr/lib/hive/lib/jwnl/jwnl.jar
>> hive> add jar /usr/lib/hive/lib/jwnl/commons-logging.jar;
>> Added /usr/lib/hive/lib/jwnl/commons-logging.jar to class path
>> Added resource: /usr/lib/hive/lib/jwnl/commons-logging.jar
>> hive> add jar StemTermsUDF.jar;
>> Added StemTermsUDF.jar to class path
>> Added resource: StemTermsUDF.jar
>> hive> create temporary function StemTermsUDF as
>> 'org.apache.hadoop.hive.ql.udf.StemTermsUDF';
>> java.lang.NoClassDefFoundError: net/didion/jwnl/JWNLException
>> at java.lang.Class.forName0(Native Method)
>> at java.lang.Class.forName(Class.java:264)
>> at
>> org.apache.hadoop.hive.ql.exec.FunctionTask.getUdfClass(
>> FunctionTask.java:
>> 119)
>> at
>> org.apache.hadoop.hive.ql.exec.FunctionTask.createFunction(FunctionTask.
>> java:
>> 75)
>> at
>> org.apache.hadoop.hive.ql.exec.FunctionTask.execute(FunctionTask.java:
>> 63)
>> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:
>> 130)
>> at
>> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:
>> 57)
>> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:
>> 1063)
>> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
>> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
>> at
>> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209)
>> at
>> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286)
>> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:
>> 516)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(
>> NativeMethodAccessorImpl.java:
>> 57)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(
>> DelegatingMethodAccessorImpl.java:
>> 43)
>> at java.lang.reflect.Method.invoke(Method.java:616)
>> at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
>> Caused by: java.lang.ClassNotFoundException:
>> net.didion.jwnl.JWNLException
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:
>> 294)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
>> ... 18 more
>> FAILED: Execution Error, return code -101 from
>> org.apache.hadoop.hive.ql.exec.FunctionTask
>
>
>
>
> --
> "...:::Aniket:::... Quetzalco@tl"
>
--
"...:::Aniket:::... Quetzalco@tl"
Re: FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.FunctionTask
Posted by Aniket Mokashi <an...@gmail.com>.
Add the jar to HADOOP_CLASSPATH when you launch hive. That should help.
Thanks,
Aniket
On Sun, Jan 22, 2012 at 9:25 AM, Tim Havens <ti...@gmail.com> wrote:
> I have a similar UDF to this one which create's just fine.
>
> I cam seem to resolve what 'return code -101' means however with this
> one.
>
> Can anyone tell me what 'return code -101' means?
>
> My StemTermsUDF.jar has the proper classpath for the JWNL jars
> already, I'm trying to insure they've REALLY available by 'add jar'
> within hive.
>
> All the paths are correct and I've checked them MANY times to be sure
> before posting this.
>
> hive> add file /usr/lib/hadoop/lib/jwnl/jwnl_properties.xml;
> Added resource: /usr/lib/hadoop/lib/jwnl/jwnl_properties.xml
> hive> add jar /usr/lib/hive/lib/jwnl/jwnl.jar;
> Added /usr/lib/hive/lib/jwnl/jwnl.jar to class path
> Added resource: /usr/lib/hive/lib/jwnl/jwnl.jar
> hive> add jar /usr/lib/hive/lib/jwnl/commons-logging.jar;
> Added /usr/lib/hive/lib/jwnl/commons-logging.jar to class path
> Added resource: /usr/lib/hive/lib/jwnl/commons-logging.jar
> hive> add jar StemTermsUDF.jar;
> Added StemTermsUDF.jar to class path
> Added resource: StemTermsUDF.jar
> hive> create temporary function StemTermsUDF as
> 'org.apache.hadoop.hive.ql.udf.StemTermsUDF';
> java.lang.NoClassDefFoundError: net/didion/jwnl/JWNLException
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:264)
> at
> org.apache.hadoop.hive.ql.exec.FunctionTask.getUdfClass(FunctionTask.java:
> 119)
> at
> org.apache.hadoop.hive.ql.exec.FunctionTask.createFunction(FunctionTask.
> java:
> 75)
> at
> org.apache.hadoop.hive.ql.exec.FunctionTask.execute(FunctionTask.java:
> 63)
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:
> 130)
> at
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:
> 57)
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:
> 1063)
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
> at
> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209)
> at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:
> 516)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:
> 43)
> at java.lang.reflect.Method.invoke(Method.java:616)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
> Caused by: java.lang.ClassNotFoundException:
> net.didion.jwnl.JWNLException
> at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:
> 294)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
> ... 18 more
> FAILED: Execution Error, return code -101 from
> org.apache.hadoop.hive.ql.exec.FunctionTask
--
"...:::Aniket:::... Quetzalco@tl"