You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "AJ Pahl (JIRA)" <ji...@apache.org> on 2010/09/03 15:36:36 UTC
[jira] Created: (HIVE-1612) Cannot build hive for hadoop 0.21.0
Cannot build hive for hadoop 0.21.0
-----------------------------------
Key: HIVE-1612
URL: https://issues.apache.org/jira/browse/HIVE-1612
Project: Hadoop Hive
Issue Type: Bug
Affects Versions: 0.7.0
Reporter: AJ Pahl
Current trunk for 0.7.0 does not support building HIVE against the Hadoop 0.21.0 release.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
Re: [jira] Updated: (HIVE-1612) Cannot build hive for hadoop 0.21.0
Posted by SingoWong <si...@gmail.com>.
Hi,
Can you execute the hive-ql in hive client? i got this error below:
$ ./hive
Exception in thread "main" java.lang.RuntimeException: Could not load shims
in class null
at org.apache.hadoop
.hive.shims.ShimLoader.loadShims(ShimLoader.java:86)
at org.apache.hadoop
.hive.shims.ShimLoader.getHadoopShims(ShimLoader.java:62)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:234)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)
Caused by: java.lang.NullPointerException
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:169)
at org.apache.hadoop
.hive.shims.ShimLoader.loadShims(ShimLoader.java:83)
... 7 more
and cannot execute hive, is it HIVE dont support hadoop0.21.0 now?
Thanks & Regards,
Singo
On Wed, Oct 13, 2010 at 2:51 AM, Daisuke Fujiwara (JIRA) <ji...@apache.org>wrote:
>
> [
> https://issues.apache.org/jira/browse/HIVE-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel]
>
> Daisuke Fujiwara updated HIVE-1612:
> -----------------------------------
>
> Attachment: HIVE-1612.patch
>
> Hi,
> I have managed to build Hive (trunk -r 1000628) against Hadoop 0.21.0.
>
> Following is what I had to do to make it work.
> 1. build Hive as instructed in Hive wiki (ant pacakge).
> 2. Copy hadoop-0.21.0.tar.gz to ${HIVE_DIR}/build/hadoopcore, untar it, and
> create/touch the "hadoop-0.21.0.installed" file
> 3. Apply the patch
> 4. build Hive again by issuing ant package "-Dhadoop.version=0.21.0
> -Doffline=true"
>
> I understand that the patch and process to build is not in the pristine
> forms, but I would like to get some feedback and see if I can pursue this
> further.
>
> Thanks.
>
> > Cannot build hive for hadoop 0.21.0
> > -----------------------------------
> >
> > Key: HIVE-1612
> > URL: https://issues.apache.org/jira/browse/HIVE-1612
> > Project: Hadoop Hive
> > Issue Type: Bug
> > Affects Versions: 0.7.0
> > Reporter: AJ Pahl
> > Attachments: HIVE-1612.patch
> >
> >
> > Current trunk for 0.7.0 does not support building HIVE against the Hadoop
> 0.21.0 release.
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
>
[jira] Commented: (HIVE-1612) Cannot build hive for hadoop 0.21.0
Posted by "bharath v (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12916869#action_12916869 ]
bharath v commented on HIVE-1612:
---------------------------------
Any one working on this issue ?
> Cannot build hive for hadoop 0.21.0
> -----------------------------------
>
> Key: HIVE-1612
> URL: https://issues.apache.org/jira/browse/HIVE-1612
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: AJ Pahl
>
> Current trunk for 0.7.0 does not support building HIVE against the Hadoop 0.21.0 release.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1612) Cannot build hive for hadoop 0.21.0
Posted by "AJ Pahl (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12919544#action_12919544 ]
AJ Pahl commented on HIVE-1612:
-------------------------------
No one has reached out to me for further info or clarification.
Sent via PocketJIRA - www.pocketjira.com
> Cannot build hive for hadoop 0.21.0
> -----------------------------------
>
> Key: HIVE-1612
> URL: https://issues.apache.org/jira/browse/HIVE-1612
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: AJ Pahl
>
> Current trunk for 0.7.0 does not support building HIVE against the Hadoop 0.21.0 release.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1612) Cannot build hive for hadoop 0.21.0
Posted by "Daisuke Fujiwara (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daisuke Fujiwara updated HIVE-1612:
-----------------------------------
Attachment: HIVE-1612.patch
Hi,
I have managed to build Hive (trunk -r 1000628) against Hadoop 0.21.0.
Following is what I had to do to make it work.
1. build Hive as instructed in Hive wiki (ant pacakge).
2. Copy hadoop-0.21.0.tar.gz to ${HIVE_DIR}/build/hadoopcore, untar it, and create/touch the "hadoop-0.21.0.installed" file
3. Apply the patch
4. build Hive again by issuing ant package "-Dhadoop.version=0.21.0 -Doffline=true"
I understand that the patch and process to build is not in the pristine forms, but I would like to get some feedback and see if I can pursue this further.
Thanks.
> Cannot build hive for hadoop 0.21.0
> -----------------------------------
>
> Key: HIVE-1612
> URL: https://issues.apache.org/jira/browse/HIVE-1612
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: AJ Pahl
> Attachments: HIVE-1612.patch
>
>
> Current trunk for 0.7.0 does not support building HIVE against the Hadoop 0.21.0 release.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1612) Cannot build hive for hadoop 0.21.0
Posted by "SingoWong (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12923487#action_12923487 ]
SingoWong commented on HIVE-1612:
---------------------------------
Hi,
Can you execute the hive-ql in hive client? i got this error below:
$ ./hive
Exception in thread "main" java.lang.RuntimeException: Could not load shims
in class null
at org.apache.hadoop
.hive.shims.ShimLoader.loadShims(ShimLoader.java:86)
at org.apache.hadoop
.hive.shims.ShimLoader.getHadoopShims(ShimLoader.java:62)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:234)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)
Caused by: java.lang.NullPointerException
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:169)
at org.apache.hadoop
.hive.shims.ShimLoader.loadShims(ShimLoader.java:83)
... 7 more
and cannot execute hive, is it HIVE dont support hadoop0.21.0 now?
Thanks & Regards,
Singo
> Cannot build hive for hadoop 0.21.0
> -----------------------------------
>
> Key: HIVE-1612
> URL: https://issues.apache.org/jira/browse/HIVE-1612
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: AJ Pahl
> Attachments: HIVE-1612.patch
>
>
> Current trunk for 0.7.0 does not support building HIVE against the Hadoop 0.21.0 release.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1612) Cannot build hive for hadoop 0.21.0
Posted by "AJ Pahl (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926518#action_12926518 ]
AJ Pahl commented on HIVE-1612:
-------------------------------
As per Daisuke's instructions I was able to complile trunk-1000628 against Hadoop 0.21.0.
Unfortunately, execution isn't exactly like Singo's but is still contains a few exceptions:
-bash-3.2$ ./hive
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hive/conf/HiveConf
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.util.RunJar.main(RunJar.java:185)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.conf.HiveConf
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
... 3 more
Also starting hiveserver...
Starting Hive Thrift Server
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/thrift/protocol/TProtocolFactory
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.util.RunJar.main(RunJar.java:185)
Caused by: java.lang.ClassNotFoundException: org.apache.thrift.protocol.TProtocolFactory
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
... 3 more
I've had success with compiling previous releases of 0.6.0 and 0.7.0 (prior to 0.21.0) so I'm
pretty sure my environment is correct for testing this. (ie: Classpath etc)
Daisuke, keep up the good work. I think this JIRA will be renamed DAISUKE-1612 if you can get it worked out. :)
> Cannot build hive for hadoop 0.21.0
> -----------------------------------
>
> Key: HIVE-1612
> URL: https://issues.apache.org/jira/browse/HIVE-1612
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: AJ Pahl
> Attachments: HIVE-1612.patch
>
>
> Current trunk for 0.7.0 does not support building HIVE against the Hadoop 0.21.0 release.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1612) Cannot build hive for hadoop 0.21.0
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12919554#action_12919554 ]
Edward Capriolo commented on HIVE-1612:
---------------------------------------
Their are issues open to get hive working with hadoop security. Since security is only in the 0.21 branch, thus someone is working on this.
> Cannot build hive for hadoop 0.21.0
> -----------------------------------
>
> Key: HIVE-1612
> URL: https://issues.apache.org/jira/browse/HIVE-1612
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: AJ Pahl
>
> Current trunk for 0.7.0 does not support building HIVE against the Hadoop 0.21.0 release.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1612) Cannot build hive for hadoop 0.21.0
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12919555#action_12919555 ]
Todd Lipcon commented on HIVE-1612:
-----------------------------------
Currently the people working on security are doing so against features backported to 0.20S (see HIVE-1264 shims for example). This is distinct from 0.21, which only has a partial implementation of security features.
> Cannot build hive for hadoop 0.21.0
> -----------------------------------
>
> Key: HIVE-1612
> URL: https://issues.apache.org/jira/browse/HIVE-1612
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: AJ Pahl
>
> Current trunk for 0.7.0 does not support building HIVE against the Hadoop 0.21.0 release.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.