You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by "Hiller, Dean (Contractor)" <de...@broadridge.com> on 2010/12/29 14:45:12 UTC
hive installation
I ran into "Unable to determine Hadoop version information"
Google found
some post referring to some build/dist directory that I can only have if
I checkout the source(I downloaded the binary instead). Do I have to
checkout and build source or is there changes to the binary?
http://osdir.com/ml/hive-user-hadoop-apache/2010-02/msg00289.html
I am using version 0.20.2 of hadoop.
Thanks,
Dean
This message and any attachments are intended only for the use of the addressee and
may contain information that is privileged and confidential. If the reader of the
message is not the intended recipient or an authorized representative of the
intended recipient, you are hereby notified that any dissemination of this
communication is strictly prohibited. If you have received this communication in
error, please notify us immediately by e-mail and delete the message and any
attachments from your system.
RE: hive installation
Posted by "Hiller, Dean (Contractor)" <de...@broadridge.com>.
Ah, sweet...ok, I didn't know hive was reading stdout for that. I had some echo's in there to log some info as I added a debug line that I can flip on and off and other echo statements.
Thanks!!!!!
Dean
-----Original Message-----
From: Edward Capriolo [mailto:edlinuxguru@gmail.com]
Sent: Wednesday, December 29, 2010 9:35 AM
To: user@hive.apache.org
Subject: Re: hive installation
On Wed, Dec 29, 2010 at 11:20 AM, Hiller, Dean (Contractor)
<de...@broadridge.com> wrote:
> I don't' understand. I can run "hadoop" from anywhere. ie. It's in my path as in ....
>
> [root@DNVR-DEV1 ~]# echo $PATH
> /opt/jdk1.6.0_23/bin:/opt/hive-0.6.0-bin/bin:/opt/hadoop-install/hadoop/bin:/usr
> /kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/
> sbin:/usr/bin:/root/bin
> [root@DNVR-DEV1 ~]# echo $HADOOP_HOME
> /opt/hadoop-install/hadoop
>
> And notice my HADOOP_HOME is setup as well, but hive still complains. Could it be because I am on fedora and there are linux differences?
>
> I noticed there are like 4 scripts that do the check :(. Is there a way to short circuit all of those so I can just temporarily get past this and modify a script in one place to lie about the version?
>
> Thanks,
> Dean
>
> -----Original Message-----
> From: Edward Capriolo [mailto:edlinuxguru@gmail.com]
> Sent: Wednesday, December 29, 2010 8:09 AM
> To: user@hive.apache.org
> Subject: Re: hive installation
>
> On Wed, Dec 29, 2010 at 8:45 AM, Hiller, Dean (Contractor)
> <de...@broadridge.com> wrote:
>> I ran into "Unable to determine Hadoop version information"
>>
>>
>>
>> Google found
>>
>> some post referring to some build/dist directory that I can only have if I
>> checkout the source(I downloaded the binary instead). Do I have to checkout
>> and build source or is there changes to the binary?
>>
>>
>>
>> http://osdir.com/ml/hive-user-hadoop-apache/2010-02/msg00289.html
>>
>>
>>
>> I am using version 0.20.2 of hadoop.
>>
>>
>>
>> Thanks,
>>
>> Dean
>>
>> This message and any attachments are intended only for the use of the
>> addressee and
>> may contain information that is privileged and confidential. If the reader
>> of the
>> message is not the intended recipient or an authorized representative of the
>> intended recipient, you are hereby notified that any dissemination of this
>> communication is strictly prohibited. If you have received this
>> communication in
>> error, please notify us immediately by e-mail and delete the message and any
>> attachments from your system.
>>
>>
>
> The hadoop executable must be in your path. or
> you must export the environment variable HADOOP_HOME or
> 'bin/hadoop version' produces something that the shell script can not digest.
>
> #3 almost should never happen.
> This message and any attachments are intended only for the use of the addressee and
> may contain information that is privileged and confidential. If the reader of the
> message is not the intended recipient or an authorized representative of the
> intended recipient, you are hereby notified that any dissemination of this
> communication is strictly prohibited. If you have received this communication in
> error, please notify us immediately by e-mail and delete the message and any
> attachments from your system.
>
>
You should not have to disable the version check with 0.20.2 and hive 0.6.0.
You are free to chance the shell scripts and try.
What does your hadoop version output?
It should look like this.
hadoo[root@etl02 ~]# hadoop version
Hadoop 0.20.1+152
Subversion -r c15291d10caa19c2355f437936c7678d537adf94
Compiled by root on Mon Nov 2 00:44:35 EST 2009
If hadoop version is not correct there is some post on this mailing
list (by me) about how to patch and avoid this. But like I said I do
not think you have to and your problem is likely elsewhere.
This message and any attachments are intended only for the use of the addressee and
may contain information that is privileged and confidential. If the reader of the
message is not the intended recipient or an authorized representative of the
intended recipient, you are hereby notified that any dissemination of this
communication is strictly prohibited. If you have received this communication in
error, please notify us immediately by e-mail and delete the message and any
attachments from your system.
Re: hive installation
Posted by Edward Capriolo <ed...@gmail.com>.
On Wed, Dec 29, 2010 at 11:20 AM, Hiller, Dean (Contractor)
<de...@broadridge.com> wrote:
> I don't' understand. I can run "hadoop" from anywhere. ie. It's in my path as in ....
>
> [root@DNVR-DEV1 ~]# echo $PATH
> /opt/jdk1.6.0_23/bin:/opt/hive-0.6.0-bin/bin:/opt/hadoop-install/hadoop/bin:/usr
> /kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/
> sbin:/usr/bin:/root/bin
> [root@DNVR-DEV1 ~]# echo $HADOOP_HOME
> /opt/hadoop-install/hadoop
>
> And notice my HADOOP_HOME is setup as well, but hive still complains. Could it be because I am on fedora and there are linux differences?
>
> I noticed there are like 4 scripts that do the check :(. Is there a way to short circuit all of those so I can just temporarily get past this and modify a script in one place to lie about the version?
>
> Thanks,
> Dean
>
> -----Original Message-----
> From: Edward Capriolo [mailto:edlinuxguru@gmail.com]
> Sent: Wednesday, December 29, 2010 8:09 AM
> To: user@hive.apache.org
> Subject: Re: hive installation
>
> On Wed, Dec 29, 2010 at 8:45 AM, Hiller, Dean (Contractor)
> <de...@broadridge.com> wrote:
>> I ran into "Unable to determine Hadoop version information"
>>
>>
>>
>> Google found
>>
>> some post referring to some build/dist directory that I can only have if I
>> checkout the source(I downloaded the binary instead). Do I have to checkout
>> and build source or is there changes to the binary?
>>
>>
>>
>> http://osdir.com/ml/hive-user-hadoop-apache/2010-02/msg00289.html
>>
>>
>>
>> I am using version 0.20.2 of hadoop.
>>
>>
>>
>> Thanks,
>>
>> Dean
>>
>> This message and any attachments are intended only for the use of the
>> addressee and
>> may contain information that is privileged and confidential. If the reader
>> of the
>> message is not the intended recipient or an authorized representative of the
>> intended recipient, you are hereby notified that any dissemination of this
>> communication is strictly prohibited. If you have received this
>> communication in
>> error, please notify us immediately by e-mail and delete the message and any
>> attachments from your system.
>>
>>
>
> The hadoop executable must be in your path. or
> you must export the environment variable HADOOP_HOME or
> 'bin/hadoop version' produces something that the shell script can not digest.
>
> #3 almost should never happen.
> This message and any attachments are intended only for the use of the addressee and
> may contain information that is privileged and confidential. If the reader of the
> message is not the intended recipient or an authorized representative of the
> intended recipient, you are hereby notified that any dissemination of this
> communication is strictly prohibited. If you have received this communication in
> error, please notify us immediately by e-mail and delete the message and any
> attachments from your system.
>
>
You should not have to disable the version check with 0.20.2 and hive 0.6.0.
You are free to chance the shell scripts and try.
What does your hadoop version output?
It should look like this.
hadoo[root@etl02 ~]# hadoop version
Hadoop 0.20.1+152
Subversion -r c15291d10caa19c2355f437936c7678d537adf94
Compiled by root on Mon Nov 2 00:44:35 EST 2009
If hadoop version is not correct there is some post on this mailing
list (by me) about how to patch and avoid this. But like I said I do
not think you have to and your problem is likely elsewhere.
RE: hive installation
Posted by "Hiller, Dean (Contractor)" <de...@broadridge.com>.
I don't' understand. I can run "hadoop" from anywhere. ie. It's in my path as in ....
[root@DNVR-DEV1 ~]# echo $PATH
/opt/jdk1.6.0_23/bin:/opt/hive-0.6.0-bin/bin:/opt/hadoop-install/hadoop/bin:/usr
/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/
sbin:/usr/bin:/root/bin
[root@DNVR-DEV1 ~]# echo $HADOOP_HOME
/opt/hadoop-install/hadoop
And notice my HADOOP_HOME is setup as well, but hive still complains. Could it be because I am on fedora and there are linux differences?
I noticed there are like 4 scripts that do the check :(. Is there a way to short circuit all of those so I can just temporarily get past this and modify a script in one place to lie about the version?
Thanks,
Dean
-----Original Message-----
From: Edward Capriolo [mailto:edlinuxguru@gmail.com]
Sent: Wednesday, December 29, 2010 8:09 AM
To: user@hive.apache.org
Subject: Re: hive installation
On Wed, Dec 29, 2010 at 8:45 AM, Hiller, Dean (Contractor)
<de...@broadridge.com> wrote:
> I ran into "Unable to determine Hadoop version information"
>
>
>
> Google found
>
> some post referring to some build/dist directory that I can only have if I
> checkout the source(I downloaded the binary instead). Do I have to checkout
> and build source or is there changes to the binary?
>
>
>
> http://osdir.com/ml/hive-user-hadoop-apache/2010-02/msg00289.html
>
>
>
> I am using version 0.20.2 of hadoop.
>
>
>
> Thanks,
>
> Dean
>
> This message and any attachments are intended only for the use of the
> addressee and
> may contain information that is privileged and confidential. If the reader
> of the
> message is not the intended recipient or an authorized representative of the
> intended recipient, you are hereby notified that any dissemination of this
> communication is strictly prohibited. If you have received this
> communication in
> error, please notify us immediately by e-mail and delete the message and any
> attachments from your system.
>
>
The hadoop executable must be in your path. or
you must export the environment variable HADOOP_HOME or
'bin/hadoop version' produces something that the shell script can not digest.
#3 almost should never happen.
This message and any attachments are intended only for the use of the addressee and
may contain information that is privileged and confidential. If the reader of the
message is not the intended recipient or an authorized representative of the
intended recipient, you are hereby notified that any dissemination of this
communication is strictly prohibited. If you have received this communication in
error, please notify us immediately by e-mail and delete the message and any
attachments from your system.
Re: hive installation
Posted by Edward Capriolo <ed...@gmail.com>.
On Wed, Dec 29, 2010 at 8:45 AM, Hiller, Dean (Contractor)
<de...@broadridge.com> wrote:
> I ran into “Unable to determine Hadoop version information”
>
>
>
> Google found
>
> some post referring to some build/dist directory that I can only have if I
> checkout the source(I downloaded the binary instead). Do I have to checkout
> and build source or is there changes to the binary?
>
>
>
> http://osdir.com/ml/hive-user-hadoop-apache/2010-02/msg00289.html
>
>
>
> I am using version 0.20.2 of hadoop.
>
>
>
> Thanks,
>
> Dean
>
> This message and any attachments are intended only for the use of the
> addressee and
> may contain information that is privileged and confidential. If the reader
> of the
> message is not the intended recipient or an authorized representative of the
> intended recipient, you are hereby notified that any dissemination of this
> communication is strictly prohibited. If you have received this
> communication in
> error, please notify us immediately by e-mail and delete the message and any
> attachments from your system.
>
>
The hadoop executable must be in your path. or
you must export the environment variable HADOOP_HOME or
'bin/hadoop version' produces something that the shell script can not digest.
#3 almost should never happen.