You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@chukwa.apache.org by weiwei <we...@163.com> on 2017/04/20 04:25:25 UTC
Issues for installing Chukwa 0.8 on Red Hat Linux7
Hi Team:
This is Wei Wei who is now installing Chukwa 0.8 on Red Hat Linux 7. I encountered some issues during installing Chukwa 0.8, could you please help me to resolve them?Many thanks.
Note that the information in red below is issue/problem, the information in blue is my responses for the relevant issues/problems.
The environment for the Chukwa 0.8 as following:
OS==>Red Hat Enterprise Linux Server release 7.0 (Maipo)
Chukwa==>0.8.0
Java==>1.8.0_121
Hadoop==>2.7.2
Hbase==>1.2.0
$CHUKWA_HOME=/home/chukwa/chukwa-src-0.8.0
$HADOOP_HOME=/home/hadoop/hadoop-2.7.2
$HBASE_HOME=/home/hadoop/hbase-1.2.0
$HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop
$HBASE_CONF_DIR=$HBASE_HOME/conf
According to the instructions from official website http://chukwa.apache.org/docs/r0.8.0/Quick_Start_Guide.htmll , I have already set the CHUWA_HOME variable.
However on the part of “Configure Hadoop and HBase”, following issues happened,
Issue1:
cp $CHUKWA_HOME/etc/chukwa/hadoop-log4j.properties $HADOOP_CONF_DIR/log4j.properties.
cp $CHUKWA_HOME/etc/chukwa/hadoop-metrics2.properties $HADOOP_CONF_DIR/hadoop-metrics2.properties
$CHUKWA_HOME/etc/chukwa in blue above Should be $CHUKWA_HOME/conf
And I have copied above two files to the relevant directory.
cp $CHUKWA_HOME/share/chukwa/chukwa-0.8.0-client.jar $HADOOP_HOME/share/hadoop/common/lib
cp $CHUKWA_HOME/share/chukwa/lib/json-simple-1.1.jar $HADOOP_HOME/share/hadoop/common/lib
There is no above two files in blue. So, I could not do that.
cp $CHUKWA_HOME/etc/chukwa/hbase-log4j.properties $HBASE_CONF_DIR/log4j.properties
cp $CHUKWA_HOME/etc/chukwa/hadoop-metrics2-hbase.properties $HBASE_CONF_DIR/hadoop-metrics2-hbase.properties
I have copied above two files to the relevant directory.
cp $CHUKWA_HOME/share/chukwa/chukwa-0.8.0-client.jar $HBASE_HOME/lib
cp $CHUKWA_HOME/share/chukwa/lib/json-simple-1.1.jar $HBASE_HOME/lib
There is no above two files in blue. So, I could not do that.
Question1: Why couldn’t I find out the chukwa-0.8.0-client.jar and json-simple-.1. jar? Is the package on the link http://www.apache.org/dyn/closer.cgi/chukwa/ correct or completed? (I downloaded several times from different mirror site).
Then I did "bin/hbase shell < $CHUKWA_HOME/etc/chukwa/hbase.schema”, set the environment variables (JAVA_HOME,HADOOP_CONF_DIR, HBASE_CONF_DIR) on the file $CHUKWA_HOME/conf/chukwa-env.sh
When I execute the the command “bin/chukwa-daemon.sh start agent”, following errors occurred,
./chukwa-daemon.sh: line 42: /home/chukwa/chukwa-src-0.8.0/bin/../libexec/chukwa-config.sh: No such file or directory
starting agent, logging to /home/chukwa/chukwa-src-0.8.0/logs/chukwa-root-agent-s3538463-2.out
/home/chukwa/chukwa-src-0.8.0/bin/chukwa: line 30: /home/chukwa/chukwa-src-0.8.0/bin/../libexec/chukwa-config.sh: No such file or directory
[root@s3538463-2 bin]#
I checked and found that the file chukwa-config.sh was in the $CHUKWA_HOME/bin directory, so I did following changes:
on the file chukwa-daemon.sh, line 42==>. Change . "$bin"/../libexec/chukwa-config.sh. to . "$bin"/chukwa-config.sh
on the file chukwa, line 30==>. Change . "$bin"/../libexec/chukwa-config.sh. to . "$bin"/chukwa-config.sh
I executed the command “bin/chukwa-daemon.sh start agent” again after above changes were done.
[root@s3538463-2 bin]# ./chukwa-daemon.sh start agent
cat: /home/chukwa/chukwa-src-0.8.0/share/chukwa/VERSION: No such file or directory
starting agent, logging to /home/chukwa/chukwa-src-0.8.0/logs/chukwa-root-agent-s3538463-2.out
cat: /home/chukwa/chukwa-src-0.8.0/share/chukwa/VERSION: No such file or directory
[root@s3538463-2 bin]#
I found that the file VERSION was in the $CHUKWA_HOME/bin directory, and there was no share/chukwa directory, so I made the directory (share/chukwa)
And copy the file VERSION from $CHUKWA_HOME/bin to $CHUKWA_HOME/share/chukwa and change the value of the file VERSION from 0.5.0 to 0.8.0
Question: Why the value of the file VERSION is 0.5.0, I am pretty sure that the version of CHUKWA I downloaded is 0.8.0.
And then I executed the command,“bin/chukwa-daemon.sh start agent”, there was no any error information. However, It could not telnet to the port 9093, as following:
weiweis-MacBook-Air:~ weiwei$ telnet 192.168.1.105 9093
Trying 192.168.1.105...
telnet: connect to address 192.168.1.105: Connection refused
telnet: Unable to connect to remote host
weiweis-MacBook-Air:~ weiwei$
I checked the log files and no more helpful information except the errors above.
[root@s3538463-2 bin]# ./chukwa-daemon.sh start hicc
starting hicc, logging to /home/chukwa/chukwa-src-0.8.0/logs/chukwa-root-hicc-s3538463-2.out
ls: cannot access /home/chukwa/chukwa-src-0.8.0/share/chukwa/webapps/hicc.war: No such file or directory
[root@s3538463-2 bin]#
There is no this file hicc.war on the package I download.
I also checked the root cause from the Google but I didn't find anything. So Could you help me to resolve them? Many thanks.
Re: Issues for installing Chukwa 0.8 on Red Hat Linux7
Posted by Eric Yang <er...@gmail.com>.
Hi WeiWei,
Issue 1: hadoop-log4j.properties is a log4j configuration file for Hadoop
to enable streaming of Hadoop log files to Chukwa. To be more specific,
the appenders are converted to use SocketAppender instead of
FileRollingAppender to stream Hadoop logs directly to Chukwa. However,
please make sure that the copy of hadoop-log4j.properties can apply to your
version of Hadoop.
Chukwa is released as source only, do you compile Chukwa? The jar files
only exists in binary tarball. You may need to run "mvn clean package"
from Chukwa source to obtain binary tarball, then the jar files would be
inside the binary tarball.
It looks like Question 1 will be answered when you have compiled chukwa.
regards,
Eric
On Wed, Apr 19, 2017 at 9:25 PM, weiwei <we...@163.com> wrote:
> Hi Team:
>
> This is Wei Wei who is now installing Chukwa 0.8 on Red Hat Linux 7.
> I encountered some issues during installing Chukwa 0.8, could you please
> help me to resolve them?Many thanks.
> Note that the information in red below is issue/problem, the
> information in blue is my responses for the relevant issues/problems.
>
> The environment for the Chukwa 0.8 as following:
> OS==>Red Hat Enterprise Linux Server release 7.0 (Maipo)
> Chukwa==>0.8.0
> Java==>1.8.0_121
> Hadoop==>2.7.2
> Hbase==>1.2.0
> $CHUKWA_HOME=/home/chukwa/chukwa-src-0.8.0
> $HADOOP_HOME=/home/hadoop/hadoop-2.7.2
> $HBASE_HOME=/home/hadoop/hbase-1.2.0
> $HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop
> $HBASE_CONF_DIR=$HBASE_HOME/conf
>
> According to the instructions from official website
> http://chukwa.apache.org/docs/r0.8.0/Quick_Start_Guide.htmll , I have
> already set the CHUWA_HOME variable.
>
> However on the part of “Configure Hadoop and HBase”, following
> issues happened,
>
> Issue1:
> cp $CHUKWA_HOME/etc/chukwa/hadoop-log4j.properties
> $HADOOP_CONF_DIR/log4j.properties.
> cp $CHUKWA_HOME/etc/chukwa/hadoop-metrics2.properties
> $HADOOP_CONF_DIR/hadoop-metrics2.properties
> $CHUKWA_HOME/etc/chukwa in blue above Should be $CHUKWA_HOME/conf
> And I have copied above two files to the relevant directory.
>
> cp $CHUKWA_HOME/share/chukwa/chukwa-0.8.0-client.jar
> $HADOOP_HOME/share/hadoop/common/lib
> cp $CHUKWA_HOME/share/chukwa/lib/json-simple-1.1.jar
> $HADOOP_HOME/share/hadoop/common/lib
> There is no above two files in blue. So, I could not do that.
>
> cp $CHUKWA_HOME/etc/chukwa/hbase-log4j.properties $HBASE_CONF_DIR/log4j.
> properties
> cp $CHUKWA_HOME/etc/chukwa/hadoop-metrics2-hbase.properties
> $HBASE_CONF_DIR/hadoop-metrics2-hbase.properties
> I have copied above two files to the relevant directory.
>
> cp $CHUKWA_HOME/share/chukwa/chukwa-0.8.0-client.jar $HBASE_HOME/lib
> cp $CHUKWA_HOME/share/chukwa/lib/json-simple-1.1.jar $HBASE_HOME/lib
> There is no above two files in blue. So, I could not do that.
>
> Question1: Why couldn’t I find out the chukwa-0.8.0-client.jar and
> json-simple-.1. jar? Is the package on the link http://www.apache.org/dyn/
> closer.cgi/chukwa/ correct or completed? (I downloaded several times from
> different mirror site).
>
> Then I did "bin/hbase shell < $CHUKWA_HOME/etc/chukwa/hbase.schema”,
> set the environment variables (JAVA_HOME,HADOOP_CONF_DIR, HBASE_CONF_DIR)
> on the file $CHUKWA_HOME/conf/chukwa-env.sh
>
> When I execute the the command “bin/chukwa-daemon.sh start agent”,
> following errors occurred,
> ./chukwa-daemon.sh: line 42: /home/chukwa/chukwa-src-0.8.0/
> bin/../libexec/chukwa-config.sh: No such file or directory
> starting agent, logging to /home/chukwa/chukwa-src-0.8.0/
> logs/chukwa-root-agent-s3538463-2.out
> /home/chukwa/chukwa-src-0.8.0/bin/chukwa: line 30:
> /home/chukwa/chukwa-src-0.8.0/bin/../libexec/chukwa-config.sh: No such
> file or directory
> [root@s3538463-2 bin]#
>
> I checked and found that the file chukwa-config.sh was in the
> $CHUKWA_HOME/bin directory, so I did following changes:
> on the file chukwa-daemon.sh, line 42==>. Change . "$bin
> "/../libexec/chukwa-config.sh. to . "$bin"/chukwa-config.sh
> on the file chukwa, line 30==>. Change . "$bin"/../libexec/chukwa-
> config.sh. to . "$bin"/chukwa-config.sh
>
> I executed the command “bin/chukwa-daemon.sh start agent” again
> after above changes were done.
>
> [root@s3538463-2 bin]# ./chukwa-daemon.sh start agent
> cat: /home/chukwa/chukwa-src-0.8.0/share/chukwa/VERSION: No such
> file or directory
> starting agent, logging to /home/chukwa/chukwa-src-0.8.0/
> logs/chukwa-root-agent-s3538463-2.out
> cat: /home/chukwa/chukwa-src-0.8.0/share/chukwa/VERSION: No such
> file or directory
> [root@s3538463-2 bin]#
>
> I found that the file VERSION was in the $CHUKWA_HOME/bin directory,
> and there was no share/chukwa directory, so I made the directory
> (share/chukwa)
> And copy the file VERSION from $CHUKWA_HOME/bin to $CHUKWA_HOME/share/chukwa
> and change the value of the file VERSION from 0.5.0 to 0.8.0
> Question: Why the value of the file VERSION is 0.5.0, I am pretty
> sure that the version of CHUKWA I downloaded is 0.8.0.
>
> And then I executed the command,“bin/chukwa-daemon.sh start agent”,
> there was no any error information. However, It could not telnet to the
> port 9093, as following:
> weiweis-MacBook-Air:~ weiwei$ telnet 192.168.1.105 9093
> Trying 192.168.1.105...
> telnet: connect to address 192.168.1.105: Connection refused
> telnet: Unable to connect to remote host
> weiweis-MacBook-Air:~ weiwei$
>
> I checked the log files and no more helpful information except the
> errors above.
>
>
> [root@s3538463-2 bin]# ./chukwa-daemon.sh start hicc
> starting hicc, logging to /home/chukwa/chukwa-src-0.8.0/
> logs/chukwa-root-hicc-s3538463-2.out
> ls: cannot access /home/chukwa/chukwa-src-0.8.0/share/chukwa/webapps/hicc.war:
> No such file or directory
> [root@s3538463-2 bin]#
>
> There is no this file hicc.war on the package I download.
>
> I also checked the root cause from the Google but I didn't find
> anything. So Could you help me to resolve them? Many thanks.
>
>
>
>
>
>
>
>
>
Re: Issues for installing Chukwa 0.8 on Red Hat Linux7
Posted by weiwei <we...@163.com>.
Hi Team:
Any progress for following problems?
> On Apr 20, 2017, at 12:25 PM, weiwei <we...@163.com> wrote:
>
> Hi Team:
>
> This is Wei Wei who is now installing Chukwa 0.8 on Red Hat Linux 7. I encountered some issues during installing Chukwa 0.8, could you please help me to resolve them?Many thanks.
> Note that the information in red below is issue/problem, the information in blue is my responses for the relevant issues/problems.
>
> The environment for the Chukwa 0.8 as following:
> OS==>Red Hat Enterprise Linux Server release 7.0 (Maipo)
> Chukwa==>0.8.0
> Java==>1.8.0_121
> Hadoop==>2.7.2
> Hbase==>1.2.0
> $CHUKWA_HOME=/home/chukwa/chukwa-src-0.8.0
> $HADOOP_HOME=/home/hadoop/hadoop-2.7.2
> $HBASE_HOME=/home/hadoop/hbase-1.2.0
> $HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop
> $HBASE_CONF_DIR=$HBASE_HOME/conf
>
> According to the instructions from official website http://chukwa.apache.org/docs/r0.8.0/Quick_Start_Guide.htmll <http://chukwa.apache.org/docs/r0.8.0/Quick_Start_Guide.htmll> , I have already set the CHUWA_HOME variable.
>
> However on the part of “Configure Hadoop and HBase”, following issues happened,
>
> Issue1:
> cp $CHUKWA_HOME/etc/chukwa/hadoop-log4j.properties $HADOOP_CONF_DIR/log4j.properties.
> cp $CHUKWA_HOME/etc/chukwa/hadoop-metrics2.properties $HADOOP_CONF_DIR/hadoop-metrics2.properties
> $CHUKWA_HOME/etc/chukwa in blue above Should be $CHUKWA_HOME/conf
> And I have copied above two files to the relevant directory.
>
> cp $CHUKWA_HOME/share/chukwa/chukwa-0.8.0-client.jar $HADOOP_HOME/share/hadoop/common/lib
> cp $CHUKWA_HOME/share/chukwa/lib/json-simple-1.1.jar $HADOOP_HOME/share/hadoop/common/lib
> There is no above two files in blue. So, I could not do that.
>
> cp $CHUKWA_HOME/etc/chukwa/hbase-log4j.properties $HBASE_CONF_DIR/log4j.properties
> cp $CHUKWA_HOME/etc/chukwa/hadoop-metrics2-hbase.properties $HBASE_CONF_DIR/hadoop-metrics2-hbase.properties
> I have copied above two files to the relevant directory.
>
> cp $CHUKWA_HOME/share/chukwa/chukwa-0.8.0-client.jar $HBASE_HOME/lib
> cp $CHUKWA_HOME/share/chukwa/lib/json-simple-1.1.jar $HBASE_HOME/lib
> There is no above two files in blue. So, I could not do that.
>
> Question1: Why couldn’t I find out the chukwa-0.8.0-client.jar and json-simple-.1. jar? Is the package on the link http://www.apache.org/dyn/closer.cgi/chukwa/ <http://www.apache.org/dyn/closer.cgi/chukwa/> correct or completed? (I downloaded several times from different mirror site).
>
> Then I did "bin/hbase shell < $CHUKWA_HOME/etc/chukwa/hbase.schema”, set the environment variables (JAVA_HOME,HADOOP_CONF_DIR, HBASE_CONF_DIR) on the file $CHUKWA_HOME/conf/chukwa-env.sh
>
> When I execute the the command “bin/chukwa-daemon.sh start agent”, following errors occurred,
> ./chukwa-daemon.sh: line 42: /home/chukwa/chukwa-src-0.8.0/bin/../libexec/chukwa-config.sh: No such file or directory
> starting agent, logging to /home/chukwa/chukwa-src-0.8.0/logs/chukwa-root-agent-s3538463-2.out
> /home/chukwa/chukwa-src-0.8.0/bin/chukwa: line 30: /home/chukwa/chukwa-src-0.8.0/bin/../libexec/chukwa-config.sh: No such file or directory
> [root@s3538463-2 bin]#
>
> I checked and found that the file chukwa-config.sh was in the $CHUKWA_HOME/bin directory, so I did following changes:
> on the file chukwa-daemon.sh, line 42==>. Change . "$bin"/../libexec/chukwa-config.sh. to . "$bin"/chukwa-config.sh
> on the file chukwa, line 30==>. Change . "$bin"/../libexec/chukwa-config.sh. to . "$bin"/chukwa-config.sh
>
> I executed the command “bin/chukwa-daemon.sh start agent” again after above changes were done.
>
> [root@s3538463-2 bin]# ./chukwa-daemon.sh start agent
> cat: /home/chukwa/chukwa-src-0.8.0/share/chukwa/VERSION: No such file or directory
> starting agent, logging to /home/chukwa/chukwa-src-0.8.0/logs/chukwa-root-agent-s3538463-2.out
> cat: /home/chukwa/chukwa-src-0.8.0/share/chukwa/VERSION: No such file or directory
> [root@s3538463-2 bin]#
>
> I found that the file VERSION was in the $CHUKWA_HOME/bin directory, and there was no share/chukwa directory, so I made the directory (share/chukwa)
> And copy the file VERSION from $CHUKWA_HOME/bin to $CHUKWA_HOME/share/chukwa and change the value of the file VERSION from 0.5.0 to 0.8.0
> Question: Why the value of the file VERSION is 0.5.0, I am pretty sure that the version of CHUKWA I downloaded is 0.8.0.
>
> And then I executed the command,“bin/chukwa-daemon.sh start agent”, there was no any error information. However, It could not telnet to the port 9093, as following:
> weiweis-MacBook-Air:~ weiwei$ telnet 192.168.1.105 9093
> Trying 192.168.1.105...
> telnet: connect to address 192.168.1.105: Connection refused
> telnet: Unable to connect to remote host
> weiweis-MacBook-Air:~ weiwei$
>
> I checked the log files and no more helpful information except the errors above.
>
>
> [root@s3538463-2 bin]# ./chukwa-daemon.sh start hicc
> starting hicc, logging to /home/chukwa/chukwa-src-0.8.0/logs/chukwa-root-hicc-s3538463-2.out
> ls: cannot access /home/chukwa/chukwa-src-0.8.0/share/chukwa/webapps/hicc.war: No such file or directory
> [root@s3538463-2 bin]#
>
> There is no this file hicc.war on the package I download.
>
> I also checked the root cause from the Google but I didn't find anything. So Could you help me to resolve them? Many thanks.
>
>
>
>
>
>
>
>