You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Marco Cadetg <ma...@zattoo.com> on 2011/09/13 11:09:00 UTC
pig & hadoop 0.20.204.0
Hi there,
I do have a problem with pig 9.0 and hadoop 0.20.204:
http://hadoop.apache.org/common/releases.html#5+Sep%2C+2011%3A+release+0.20.204.0+available
I tried several things but I am unable to use pig with that version of
hadoop. When using the pig without hadoop version build via ant
jar-withouthadoop I get the following error:
2011-09-13 11:16:42,919 [main] ERROR org.apache.pig.Main - ERROR 2998:
Unhandled internal error. org/apache/commons/configuration/Configuration
I'm using the following pig classpath:
/home/marco/hadoop/current/conf:/home/marco/hadoop/current/hadoop-core-0.20.204.0.jar:/home/marco/pig/current/pig-withouthadoop.jar
Thanks for your help!
-Marco
Re: pig & hadoop 0.20.204.0
Posted by Marco Cadetg <ma...@zattoo.com>.
Sorry for spamming the list, it looks like there were some classpath jars
missing.
Cheers
-Marco
On Tue, Sep 13, 2011 at 3:13 PM, Marco Cadetg <ma...@zattoo.com> wrote:
> I'm wondering if this is rather a hadoop configuration problem or a problem
> between pig and hadoop?
>
> Here is the complete error logging:
>
> Error before Pig is launched
> ----------------------------
> ERROR 2998: Unhandled internal error. org/apache/commons/configuration/C
> onfiguration
>
> java.lang.NoClassDefFoundError: org/apache/commons/configuration/Configu
> ration
> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.<init>(De
> faultMetricsSystem.java:37)
> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.<clinit>(
> DefaultMetricsSystem.java:34)
> at org.apache.hadoop.security.UgiInstrumentation.create(UgiInstr
> umentation.java:51)
> at org.apache.hadoop.security.UserGroupInformation.initialize(Us
> erGroupInformation.java:196)
> at org.apache.hadoop.security.UserGroupInformation.ensureInitial
> ized(UserGroupInformation.java:159)
> at org.apache.hadoop.security.UserGroupInformation.isSecurityEna
> bled(UserGroupInformation.java:216)
> at org.apache.hadoop.security.KerberosName.<clinit>(KerberosName
> .java:83)
> at org.apache.hadoop.security.UserGroupInformation.initialize(Us
> erGroupInformation.java:189)
> at org.apache.hadoop.security.UserGroupInformation.ensureInitial
> ized(UserGroupInformation.java:159)
> at org.apache.hadoop.security.UserGroupInformation.isSecurityEna
> bled(UserGroupInformation.java:216)
> at org.apache.hadoop.security.UserGroupInformation.getLoginUser(
> UserGroupInformation.java:409)
> at
> org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:395)
> at
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1418)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1319)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:109)
> at
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:72)
> at
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.<init>(HDataStorage.java:58)
> at
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:196)
> at
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:116)
> at org.apache.pig.impl.PigContext.connect(PigContext.java:184)
> at org.apache.pig.PigServer.<init>(PigServer.java:243)
> at org.apache.pig.PigServer.<init>(PigServer.java:228)
> at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:46)
> at org.apache.pig.Main.run(Main.java:484)
> at org.apache.pig.Main.main(Main.java:108)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.commons.configuration.Configuration
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> ... 26 more
>
> ================================================================================
>
>
> On Tue, Sep 13, 2011 at 11:09 AM, Marco Cadetg <ma...@zattoo.com> wrote:
>
>> Hi there,
>>
>> I do have a problem with pig 9.0 and hadoop 0.20.204:
>> http://hadoop.apache.org/common/releases.html#5+Sep%2C+2011%3A+release+0.20.204.0+available
>>
>> I tried several things but I am unable to use pig with that version of
>> hadoop. When using the pig without hadoop version build via ant
>> jar-withouthadoop I get the following error:
>>
>> 2011-09-13 11:16:42,919 [main] ERROR org.apache.pig.Main - ERROR 2998:
>> Unhandled internal error. org/apache/commons/configuration/Configuration
>>
>> I'm using the following pig classpath:
>> /home/marco/hadoop/current/conf:/home/marco/hadoop/current/hadoop-core-0.20.204.0.jar:/home/marco/pig/current/pig-withouthadoop.jar
>>
>> Thanks for your help!
>> -Marco
>>
>>
>
Re: pig & hadoop 0.20.204.0
Posted by Marco Cadetg <ma...@zattoo.com>.
I'm wondering if this is rather a hadoop configuration problem or a problem
between pig and hadoop?
Here is the complete error logging:
Error before Pig is launched
----------------------------
ERROR 2998: Unhandled internal error. org/apache/commons/configuration/C
onfiguration
java.lang.NoClassDefFoundError: org/apache/commons/configuration/Configu
ration
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.<init>(De
faultMetricsSystem.java:37)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.<clinit>(
DefaultMetricsSystem.java:34)
at org.apache.hadoop.security.UgiInstrumentation.create(UgiInstr
umentation.java:51)
at org.apache.hadoop.security.UserGroupInformation.initialize(Us
erGroupInformation.java:196)
at org.apache.hadoop.security.UserGroupInformation.ensureInitial
ized(UserGroupInformation.java:159)
at org.apache.hadoop.security.UserGroupInformation.isSecurityEna
bled(UserGroupInformation.java:216)
at org.apache.hadoop.security.KerberosName.<clinit>(KerberosName
.java:83)
at org.apache.hadoop.security.UserGroupInformation.initialize(Us
erGroupInformation.java:189)
at org.apache.hadoop.security.UserGroupInformation.ensureInitial
ized(UserGroupInformation.java:159)
at org.apache.hadoop.security.UserGroupInformation.isSecurityEna
bled(UserGroupInformation.java:216)
at org.apache.hadoop.security.UserGroupInformation.getLoginUser(
UserGroupInformation.java:409)
at
org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:395)
at
org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1418)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1319)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:109)
at
org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:72)
at
org.apache.pig.backend.hadoop.datastorage.HDataStorage.<init>(HDataStorage.java:58)
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:196)
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:116)
at org.apache.pig.impl.PigContext.connect(PigContext.java:184)
at org.apache.pig.PigServer.<init>(PigServer.java:243)
at org.apache.pig.PigServer.<init>(PigServer.java:228)
at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:46)
at org.apache.pig.Main.run(Main.java:484)
at org.apache.pig.Main.main(Main.java:108)
Caused by: java.lang.ClassNotFoundException:
org.apache.commons.configuration.Configuration
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 26 more
================================================================================
On Tue, Sep 13, 2011 at 11:09 AM, Marco Cadetg <ma...@zattoo.com> wrote:
> Hi there,
>
> I do have a problem with pig 9.0 and hadoop 0.20.204:
> http://hadoop.apache.org/common/releases.html#5+Sep%2C+2011%3A+release+0.20.204.0+available
>
> I tried several things but I am unable to use pig with that version of
> hadoop. When using the pig without hadoop version build via ant
> jar-withouthadoop I get the following error:
>
> 2011-09-13 11:16:42,919 [main] ERROR org.apache.pig.Main - ERROR 2998:
> Unhandled internal error. org/apache/commons/configuration/Configuration
>
> I'm using the following pig classpath:
> /home/marco/hadoop/current/conf:/home/marco/hadoop/current/hadoop-core-0.20.204.0.jar:/home/marco/pig/current/pig-withouthadoop.jar
>
> Thanks for your help!
> -Marco
>
>