You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@bigtop.apache.org by Bob Metelsky <bo...@gmail.com> on 2015/04/08 17:06:00 UTC
bigtop-detect-javahome - file not found
Guys, I removed hadoop alpha from bt repo 6 via yum
I cleanly installed hadoop replacing repo 6 with repo 8
yum remove/install hadoop\* flume\* zookeeper\* oozie\* sqoop\* hbase\*
hive\* hue\*
I now have hadoop 2.4.1
Problem is in my services hadoop-* there is a reference to
/usr/lib/bigtop-utils/bigtop-detect-javahome
which is not on my system
getting these errors...
/etc/init.d/hadoop-hdfs-datanode: line 40:
/usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
starting datanode, logging to
/var/log/hadoop-hdfs/hadoop-hdfs-datanode-nn111.rack1.lab.out
Failed to start Hadoop datanode. Return value: 1 [FAILED]
/etc/init.d/hadoop-hdfs-journalnode: line 40:
/usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
Error: JAVA_HOME is not set and could not be found.
Failed to start Hadoop journalnode. Return value: 3 [FAILED]
/etc/init.d/hadoop-hdfs-namenode: line 40:
/usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
starting namenode, logging to
/var/log/hadoop-hdfs/hadoop-hdfs-namenode-nn111.rack1.lab.out
Failed to start Hadoop namenode. Return value: 1 [FAILED]
can someone send me this file?
Re: bigtop-detect-javahome - file not found
Posted by Konstantin Boudnik <co...@apache.org>.
Can you try to reinstall the bigtop-utils package to rule out any
upgrade-related issues? We haven't seen the issue before, really...
Cos
On Wed, Apr 08, 2015 at 10:24PM, Bob Metelsky wrote:
> Hi I have --> Package bigtop-utils-0.8.0.6-1.el6.noarch
> and using
>
> root dn112.rack1.lab/etc/yum.repos.d cat bigtop.repo
> [bigtop]
> name=Bigtop
> enabled=1
> gpgcheck=1
> type=NONE
> baseurl=http://bigtop.s3.amazonaws.com/releases/0.8.0/redhat/6/x86_64
> gpgkey=http://archive.apache.org/dist/bigtop/KEYS
>
> as the repo - there is no update using the above repo
> looking at your website
> current release seems to be .8
> http://www.apache.org/dyn/closer.cgi/bigtop/bigtop-0.8.0/
>
> [image: Inline image 1]
>
> soo.... file bigtop-detect-javahome is nowhere to be found on my system, it
> was there when I was on .6 but after moving to 8 its gone and I had
> to modify all the service scripts and set the JAVA_HOME in those scripts.
>
> Seems to be the file was removed by yum and not replaced by v .8
>
>
>
>
>
> On Wed, Apr 8, 2015 at 11:31 AM, Sean Mackrory <ma...@gmail.com> wrote:
>
> > Which version of the bigtop-utils package do you have installed? It used
> > to be that bigtop-detect-javahome was installed in different directories on
> > different systems, and other packages in those releases looked in all those
> > locations. If you bigtop-utils installed from an old version, you may need
> > to update it to a new version to make sure it's installed in
> > /usr/lib/bigtop-utils/ where the new Hadoop packages are looking for it..
> >
> > On Wed, Apr 8, 2015 at 9:07 AM, Bob Metelsky <bo...@gmail.com>
> > wrote:
> >
> >> I suppose I can comment it out and manually set the JAVA_HOME in each...
> >> Ill try that for now. If someone can send me the file that would be good as
> >> well
> >>
> >> Just a fyi that the file does not seem to be included in the 8 build
> >>
> >>
> >> On Wed, Apr 8, 2015 at 11:06 AM, Bob Metelsky <bo...@gmail.com>
> >> wrote:
> >>
> >>> Guys, I removed hadoop alpha from bt repo 6 via yum
> >>>
> >>> I cleanly installed hadoop replacing repo 6 with repo 8
> >>>
> >>> yum remove/install hadoop\* flume\* zookeeper\* oozie\* sqoop\* hbase\*
> >>> hive\* hue\*
> >>>
> >>> I now have hadoop 2.4.1
> >>>
> >>> Problem is in my services hadoop-* there is a reference to
> >>> /usr/lib/bigtop-utils/bigtop-detect-javahome
> >>>
> >>> which is not on my system
> >>>
> >>> getting these errors...
> >>>
> >>> /etc/init.d/hadoop-hdfs-datanode: line 40:
> >>> /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
> >>> starting datanode, logging to
> >>> /var/log/hadoop-hdfs/hadoop-hdfs-datanode-nn111.rack1.lab.out
> >>> Failed to start Hadoop datanode. Return value: 1 [FAILED]
> >>> /etc/init.d/hadoop-hdfs-journalnode: line 40:
> >>> /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
> >>> Error: JAVA_HOME is not set and could not be found.
> >>> Failed to start Hadoop journalnode. Return value: 3 [FAILED]
> >>> /etc/init.d/hadoop-hdfs-namenode: line 40:
> >>> /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
> >>> starting namenode, logging to
> >>> /var/log/hadoop-hdfs/hadoop-hdfs-namenode-nn111.rack1.lab.out
> >>> Failed to start Hadoop namenode. Return value: 1 [FAILED]
> >>>
> >>> can someone send me this file?
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>
> >
Re: bigtop-detect-javahome - file not found
Posted by Bob Metelsky <bo...@gmail.com>.
Hi I have --> Package bigtop-utils-0.8.0.6-1.el6.noarch
and using
root dn112.rack1.lab/etc/yum.repos.d cat bigtop.repo
[bigtop]
name=Bigtop
enabled=1
gpgcheck=1
type=NONE
baseurl=http://bigtop.s3.amazonaws.com/releases/0.8.0/redhat/6/x86_64
gpgkey=http://archive.apache.org/dist/bigtop/KEYS
as the repo - there is no update using the above repo
looking at your website
current release seems to be .8
http://www.apache.org/dyn/closer.cgi/bigtop/bigtop-0.8.0/
[image: Inline image 1]
soo.... file bigtop-detect-javahome is nowhere to be found on my system, it
was there when I was on .6 but after moving to 8 its gone and I had
to modify all the service scripts and set the JAVA_HOME in those scripts.
Seems to be the file was removed by yum and not replaced by v .8
On Wed, Apr 8, 2015 at 11:31 AM, Sean Mackrory <ma...@gmail.com> wrote:
> Which version of the bigtop-utils package do you have installed? It used
> to be that bigtop-detect-javahome was installed in different directories on
> different systems, and other packages in those releases looked in all those
> locations. If you bigtop-utils installed from an old version, you may need
> to update it to a new version to make sure it's installed in
> /usr/lib/bigtop-utils/ where the new Hadoop packages are looking for it..
>
> On Wed, Apr 8, 2015 at 9:07 AM, Bob Metelsky <bo...@gmail.com>
> wrote:
>
>> I suppose I can comment it out and manually set the JAVA_HOME in each...
>> Ill try that for now. If someone can send me the file that would be good as
>> well
>>
>> Just a fyi that the file does not seem to be included in the 8 build
>>
>>
>> On Wed, Apr 8, 2015 at 11:06 AM, Bob Metelsky <bo...@gmail.com>
>> wrote:
>>
>>> Guys, I removed hadoop alpha from bt repo 6 via yum
>>>
>>> I cleanly installed hadoop replacing repo 6 with repo 8
>>>
>>> yum remove/install hadoop\* flume\* zookeeper\* oozie\* sqoop\* hbase\*
>>> hive\* hue\*
>>>
>>> I now have hadoop 2.4.1
>>>
>>> Problem is in my services hadoop-* there is a reference to
>>> /usr/lib/bigtop-utils/bigtop-detect-javahome
>>>
>>> which is not on my system
>>>
>>> getting these errors...
>>>
>>> /etc/init.d/hadoop-hdfs-datanode: line 40:
>>> /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
>>> starting datanode, logging to
>>> /var/log/hadoop-hdfs/hadoop-hdfs-datanode-nn111.rack1.lab.out
>>> Failed to start Hadoop datanode. Return value: 1 [FAILED]
>>> /etc/init.d/hadoop-hdfs-journalnode: line 40:
>>> /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
>>> Error: JAVA_HOME is not set and could not be found.
>>> Failed to start Hadoop journalnode. Return value: 3 [FAILED]
>>> /etc/init.d/hadoop-hdfs-namenode: line 40:
>>> /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
>>> starting namenode, logging to
>>> /var/log/hadoop-hdfs/hadoop-hdfs-namenode-nn111.rack1.lab.out
>>> Failed to start Hadoop namenode. Return value: 1 [FAILED]
>>>
>>> can someone send me this file?
>>>
>>>
>>>
>>>
>>>
>>>
>>
>
Re: bigtop-detect-javahome - file not found
Posted by Sean Mackrory <ma...@gmail.com>.
Which version of the bigtop-utils package do you have installed? It used to
be that bigtop-detect-javahome was installed in different directories on
different systems, and other packages in those releases looked in all those
locations. If you bigtop-utils installed from an old version, you may need
to update it to a new version to make sure it's installed in
/usr/lib/bigtop-utils/ where the new Hadoop packages are looking for it..
On Wed, Apr 8, 2015 at 9:07 AM, Bob Metelsky <bo...@gmail.com> wrote:
> I suppose I can comment it out and manually set the JAVA_HOME in each...
> Ill try that for now. If someone can send me the file that would be good as
> well
>
> Just a fyi that the file does not seem to be included in the 8 build
>
>
> On Wed, Apr 8, 2015 at 11:06 AM, Bob Metelsky <bo...@gmail.com>
> wrote:
>
>> Guys, I removed hadoop alpha from bt repo 6 via yum
>>
>> I cleanly installed hadoop replacing repo 6 with repo 8
>>
>> yum remove/install hadoop\* flume\* zookeeper\* oozie\* sqoop\* hbase\*
>> hive\* hue\*
>>
>> I now have hadoop 2.4.1
>>
>> Problem is in my services hadoop-* there is a reference to
>> /usr/lib/bigtop-utils/bigtop-detect-javahome
>>
>> which is not on my system
>>
>> getting these errors...
>>
>> /etc/init.d/hadoop-hdfs-datanode: line 40:
>> /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
>> starting datanode, logging to
>> /var/log/hadoop-hdfs/hadoop-hdfs-datanode-nn111.rack1.lab.out
>> Failed to start Hadoop datanode. Return value: 1 [FAILED]
>> /etc/init.d/hadoop-hdfs-journalnode: line 40:
>> /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
>> Error: JAVA_HOME is not set and could not be found.
>> Failed to start Hadoop journalnode. Return value: 3 [FAILED]
>> /etc/init.d/hadoop-hdfs-namenode: line 40:
>> /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
>> starting namenode, logging to
>> /var/log/hadoop-hdfs/hadoop-hdfs-namenode-nn111.rack1.lab.out
>> Failed to start Hadoop namenode. Return value: 1 [FAILED]
>>
>> can someone send me this file?
>>
>>
>>
>>
>>
>>
>
Re: bigtop-detect-javahome - file not found
Posted by jay vyas <ja...@gmail.com>.
Hi Bob as an aside.
Most of my experience with bigtop is that I don't ever have to worry about
stuff like this... i just use puppet recipes which do this.
Hadoop-env.sh which comes in the puppet recipes I thought solves this for
us....
Are you using puppet? The vagrant recipes are a nice easy way to start
because they use puppet to configure everything... which is exactly what
bigtop uses to test the rpms.
In that case I think these issues would not occur since puppet also iirc
sets up java.
Now that you've seen these low level things... maybe you will be in a great
position to start using the deploy tooling which handles this elegantly ...
Or maybe I'm missing something and you have encountered a real bug.
Either way keep up the feedback this is great info for us moving forward on
how to make things easier for people!
On Apr 10, 2015 12:00 PM, "Bob Metelsky" <bo...@gmail.com> wrote:
> ok somehow looks good... not sure what happened
>
> situation
> removed hadoop bigtop 6 * with yum
> That seems to remove the java detect file.. because I did not get startup
> errors while on 6 but did when I moved to 8 becasue of
> bigtop-detect-javahome being missing .
>
>
> bigtop-utils.noarch
> 0.8.0.6-1.el6
>
> hadoop-hdfs-namenode
> service script has this ( I added JAVA_HOME and commented the detect)
> export JAVA_HOME=/usr/java/jdk1.7.0_67
> # Autodetect JAVA_HOME if not defined
> #. /usr/lib/bigtop-utils/bigtop-detect-javahome
>
> show the file is not there
> root nn111.rack1.lab/usr/lib/bigtop-utils ls -ltr
> total 52
> -rwxr-xr-x 1 root root 49904 Sep 9 2014 jsvc
>
>
> I reinstalled yum reinstall bigtop-utils.noarch
>
> The detect files get installed
>
> root nn111.rack1.lab/usr/lib/bigtop-utils ls -ltr
> total 64
> -rwxr-xr-x 1 root root 49904 Sep 9 2014 jsvc
> -rwxr-xr-x 1 root root 1948 Sep 9 2014 bigtop-detect-javalibs
> -rwxr-xr-x 1 root root 2730 Sep 9 2014 bigtop-detect-javahome
> -rwxr-xr-x 1 root root 1560 Sep 9 2014 bigtop-detect-classpath
>
> So it seems all set thanks for the pointer to reinstall
>
> On Wed, Apr 8, 2015 at 11:07 AM, Bob Metelsky <bo...@gmail.com>
> wrote:
>
>> I suppose I can comment it out and manually set the JAVA_HOME in each...
>> Ill try that for now. If someone can send me the file that would be good as
>> well
>>
>> Just a fyi that the file does not seem to be included in the 8 build
>>
>>
>> On Wed, Apr 8, 2015 at 11:06 AM, Bob Metelsky <bo...@gmail.com>
>> wrote:
>>
>>> Guys, I removed hadoop alpha from bt repo 6 via yum
>>>
>>> I cleanly installed hadoop replacing repo 6 with repo 8
>>>
>>> yum remove/install hadoop\* flume\* zookeeper\* oozie\* sqoop\* hbase\*
>>> hive\* hue\*
>>>
>>> I now have hadoop 2.4.1
>>>
>>> Problem is in my services hadoop-* there is a reference to
>>> /usr/lib/bigtop-utils/bigtop-detect-javahome
>>>
>>> which is not on my system
>>>
>>> getting these errors...
>>>
>>> /etc/init.d/hadoop-hdfs-datanode: line 40:
>>> /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
>>> starting datanode, logging to
>>> /var/log/hadoop-hdfs/hadoop-hdfs-datanode-nn111.rack1.lab.out
>>> Failed to start Hadoop datanode. Return value: 1 [FAILED]
>>> /etc/init.d/hadoop-hdfs-journalnode: line 40:
>>> /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
>>> Error: JAVA_HOME is not set and could not be found.
>>> Failed to start Hadoop journalnode. Return value: 3 [FAILED]
>>> /etc/init.d/hadoop-hdfs-namenode: line 40:
>>> /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
>>> starting namenode, logging to
>>> /var/log/hadoop-hdfs/hadoop-hdfs-namenode-nn111.rack1.lab.out
>>> Failed to start Hadoop namenode. Return value: 1 [FAILED]
>>>
>>> can someone send me this file?
>>>
>>>
>>>
>>>
>>>
>>>
>>
>
Re: bigtop-detect-javahome - file not found
Posted by Bob Metelsky <bo...@gmail.com>.
ok somehow looks good... not sure what happened
situation
removed hadoop bigtop 6 * with yum
That seems to remove the java detect file.. because I did not get startup
errors while on 6 but did when I moved to 8 becasue of
bigtop-detect-javahome being missing .
bigtop-utils.noarch
0.8.0.6-1.el6
hadoop-hdfs-namenode
service script has this ( I added JAVA_HOME and commented the detect)
export JAVA_HOME=/usr/java/jdk1.7.0_67
# Autodetect JAVA_HOME if not defined
#. /usr/lib/bigtop-utils/bigtop-detect-javahome
show the file is not there
root nn111.rack1.lab/usr/lib/bigtop-utils ls -ltr
total 52
-rwxr-xr-x 1 root root 49904 Sep 9 2014 jsvc
I reinstalled yum reinstall bigtop-utils.noarch
The detect files get installed
root nn111.rack1.lab/usr/lib/bigtop-utils ls -ltr
total 64
-rwxr-xr-x 1 root root 49904 Sep 9 2014 jsvc
-rwxr-xr-x 1 root root 1948 Sep 9 2014 bigtop-detect-javalibs
-rwxr-xr-x 1 root root 2730 Sep 9 2014 bigtop-detect-javahome
-rwxr-xr-x 1 root root 1560 Sep 9 2014 bigtop-detect-classpath
So it seems all set thanks for the pointer to reinstall
On Wed, Apr 8, 2015 at 11:07 AM, Bob Metelsky <bo...@gmail.com>
wrote:
> I suppose I can comment it out and manually set the JAVA_HOME in each...
> Ill try that for now. If someone can send me the file that would be good as
> well
>
> Just a fyi that the file does not seem to be included in the 8 build
>
>
> On Wed, Apr 8, 2015 at 11:06 AM, Bob Metelsky <bo...@gmail.com>
> wrote:
>
>> Guys, I removed hadoop alpha from bt repo 6 via yum
>>
>> I cleanly installed hadoop replacing repo 6 with repo 8
>>
>> yum remove/install hadoop\* flume\* zookeeper\* oozie\* sqoop\* hbase\*
>> hive\* hue\*
>>
>> I now have hadoop 2.4.1
>>
>> Problem is in my services hadoop-* there is a reference to
>> /usr/lib/bigtop-utils/bigtop-detect-javahome
>>
>> which is not on my system
>>
>> getting these errors...
>>
>> /etc/init.d/hadoop-hdfs-datanode: line 40:
>> /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
>> starting datanode, logging to
>> /var/log/hadoop-hdfs/hadoop-hdfs-datanode-nn111.rack1.lab.out
>> Failed to start Hadoop datanode. Return value: 1 [FAILED]
>> /etc/init.d/hadoop-hdfs-journalnode: line 40:
>> /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
>> Error: JAVA_HOME is not set and could not be found.
>> Failed to start Hadoop journalnode. Return value: 3 [FAILED]
>> /etc/init.d/hadoop-hdfs-namenode: line 40:
>> /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
>> starting namenode, logging to
>> /var/log/hadoop-hdfs/hadoop-hdfs-namenode-nn111.rack1.lab.out
>> Failed to start Hadoop namenode. Return value: 1 [FAILED]
>>
>> can someone send me this file?
>>
>>
>>
>>
>>
>>
>
Re: bigtop-detect-javahome - file not found
Posted by Bob Metelsky <bo...@gmail.com>.
I suppose I can comment it out and manually set the JAVA_HOME in each...
Ill try that for now. If someone can send me the file that would be good as
well
Just a fyi that the file does not seem to be included in the 8 build
On Wed, Apr 8, 2015 at 11:06 AM, Bob Metelsky <bo...@gmail.com>
wrote:
> Guys, I removed hadoop alpha from bt repo 6 via yum
>
> I cleanly installed hadoop replacing repo 6 with repo 8
>
> yum remove/install hadoop\* flume\* zookeeper\* oozie\* sqoop\* hbase\*
> hive\* hue\*
>
> I now have hadoop 2.4.1
>
> Problem is in my services hadoop-* there is a reference to
> /usr/lib/bigtop-utils/bigtop-detect-javahome
>
> which is not on my system
>
> getting these errors...
>
> /etc/init.d/hadoop-hdfs-datanode: line 40:
> /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
> starting datanode, logging to
> /var/log/hadoop-hdfs/hadoop-hdfs-datanode-nn111.rack1.lab.out
> Failed to start Hadoop datanode. Return value: 1 [FAILED]
> /etc/init.d/hadoop-hdfs-journalnode: line 40:
> /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
> Error: JAVA_HOME is not set and could not be found.
> Failed to start Hadoop journalnode. Return value: 3 [FAILED]
> /etc/init.d/hadoop-hdfs-namenode: line 40:
> /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
> starting namenode, logging to
> /var/log/hadoop-hdfs/hadoop-hdfs-namenode-nn111.rack1.lab.out
> Failed to start Hadoop namenode. Return value: 1 [FAILED]
>
> can someone send me this file?
>
>
>
>
>
>