You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by Apache Wiki <wi...@apache.org> on 2011/11/27 20:32:15 UTC

[Hadoop Wiki] Update of "Chukwa_Quick_Start" by EricYang

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "Chukwa_Quick_Start" page has been changed by EricYang:
http://wiki.apache.org/hadoop/Chukwa_Quick_Start?action=diff&rev1=44&rev2=45

  == Pre-requisites ==
  Chukwa should work on any POSIX platform, but GNU/Linux is the only production platform that has been tested extensively. Chukwa has also been used successfully on Mac OS X, which several members of the Chukwa team use for development.
  
- The only absolute software requirements are Java 1.6 or better and Hadoop 0.20.203+. HICC, the Chukwa visualization interface, requires HBase 0.90.3.
+ The only absolute software requirements are Java 1.6 or better and Hadoop 0.20.205+. HICC, the Chukwa visualization interface, requires HBase 0.90.4.
  
  The Chukwa cluster management scripts rely on ssh; these scripts, however, are not required if you have some alternate mechanism for starting and stopping daemons.
  
@@ -24, +24 @@

  {{http://people.apache.org/~eyang/docs/chukwa-0.5-arch.png}}
  
  == Compiling and installing Chukwa ==
+  1. To compile Chukwa, just type 'mvn clean package -DskipTests -DTODO_HBASE_CONF_DIR=/path/to/$HBASE_CONF_DIR' in the project root directory.
-  1. Copy hbase-0.90.3.jar, hbase-0.90.3-test.jar and HBASE_HOME/lib/zookeeper-*.jar to CHUKWA_HOME/lib
-  1. To compile Chukwa, just say ''ant tar'' in the project root directory.
-  1. Extract the compiled tar file from build/chukwa-0.x.y.tar.gz to the Chukwa root directory.
+  1. Extract the compiled tar file from target/chukwa-0.x.y.tar.gz to the Chukwa root directory.
  
  == Setup Chukwa Cluster ==
  General Hadoop configuration is available at: [[http://hadoop.apache.org/common/docs/current/cluster_setup.html|Hadoop Configuration]]
@@ -43, +42 @@

    }}}
    Save the file.
   1. Copy CHUKWA_HOME/hadoop-metrics.properties to HADOOP_CONF_DIR.
-  1. Copy CHUKWA_HOME/chukwa-hadoop-0.5.0-client.jar to HADOOP_HOME/lib.
+  1. Copy CHUKWA_HOME/share/chukwa/chukwa-0.5.0-client.jar to HADOOP_HOME/share/hadoop/lib.
-  1. Copy CHUKWA_HOME/lib/json-simple-1.1.jar to HADOOP_HOME/lib.
+  1. Copy CHUKWA_HOME/share/chukwa/lib/json-simple-1.1.jar to HADOOP_HOME/share/hadoop/lib.
   1. Restart Hadoop Cluster.
   1. General HBASE configuration is available at:  [[http://hbase.apache.org/docs/current/api/overview-summary.html#overview_description|HBase Configuration]]
   1. After Hadoop and HBase has been configured properly, run: 
@@ -54, +53 @@

    This procedure initializes the default Chukwa HBase schema.
  
  == Configuring and starting the Collector ==
-  1. Copy conf/chukwa-collector-conf.xml.template to conf/chukwa-collector-conf.xml
   1. Edit conf/chukwa-collector-conf.xml and comment out the default properties for chukwaCollector.writerClass, and chukwaCollector.pipeline.  Uncomment block for HBaseWriter parameters, and save.
-  1. If you're running HBase in distributed mode, copy your hadoop-site.xml, hbase-site.xml file to the collectors conf/ directory. At a minimum, this file must contain a setting for hbase.zookeeper.quorum.
-  1. Copy conf/chukwa-env.sh-template to conf/chukwa-env.sh.
   1. Edit chukwa-env.sh.  You almost certainly need to set JAVA_HOME, HADOOP_HOME, HADOOP_CONF_DIR, HBASE_HOME, and HBASE_CONF_DIR at least.
-  1. In the chukwa root directory, say bash bin/chukwa collector'' ''
+  1. In the chukwa root directory, run 'bin/chukwa collector'
  
  == Configuring and starting the local agent ==
-  1. ''Copy conf/chukwa-agent-conf.xml.template to conf/chukwa-agent-conf.xml ''
-  1. ''Copy conf/collectors.template to conf/collectors ''
+  1. Verify etc/chukwa/chukwa-agent-conf.xml configuration
+  1. Verify etc/chukwa/collectors contains list of collector hostname
-  1. ''In the chukwa root directory, say bash bin/chukwa agent''
+  1. In the chukwa root directory, run 'bin/chukwa agent'
  
  == Starting Adaptors ==
  The local agent speaks a simple text-based protocol, by default over port 9093. Suppose you want Chukwa to monitor system metrics, hadoop metrics, and hadoop logs on the localhost: