You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by Apache Wiki <wi...@apache.org> on 2008/10/16 00:13:12 UTC

[Hadoop Wiki] Update of "Chukwa Quick Start" by AlexLoddengaard

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The following page has been changed by AlexLoddengaard:
http://wiki.apache.org/hadoop/Chukwa_Quick_Start

------------------------------------------------------------------------------
  (This is copied from the README.TXT file that comes with the Chukwa distribution)
+ 
+ (NOTE: I've made a few changes and called for a few revisions, so please incorporate them in your next README.txt file.  I've labeled necessary revisions with 'Document TODO:' - AlexLoddengaard)
+ 
  The Chukwa monitoring system has a number of components.
  This section gives guidance on starting each of them on your local machine. 
  
@@ -22, +25 @@

     - If you are not running hadoop, you can just juse a local path, of the form file:///tmp/chukwa.
      
     - Copy conf/chukwa-env.sh-template to conf/chukwa-env.sh.  Set JAVA_HOME in file.
+ 
+    - Download the Apache logging commons jar from http://commons.apache.org/downloads/download_logging.cgi
+ 
+    - Copy the 'commons-logging-X.Y.Z.jar' file to $HADOOP_HOME/src/contrib/chukwa/lib
      
     - In the chukwa root directory, say ``bash bin/jettyCollector.sh''
  
@@ -43, +50 @@

    - Type [without quotation marks] "ADD CharFileTailerUTF8 MyFileType /path/to/file 0"
  
    - Chukwa internal Namenode's type is NameNodeType so for namenode log type (without quotation marks): "ADD CharFileTailerUTF8 NameNodeType /path/to/nameNodeFie 0"
+ 
+   - (Document TODO: the above command does not work and errors with "don't recognize adaptor name CharFileTailerUTF8".  Similarly, it's not clear what /path/to/file should be in the case of tracking a name node.  Should it be $HDFS/dfs/name/current/fsimage?)
    
    - Type "list" -- you should see the adaptor you just started, listed as running. 
    
@@ -53, +62 @@

  *  Configuring and starting the demux job
  
    - Edit bin/chukwa-config.sh to match your system configuration
+ 
+   - (Document TODO: Say exactly what should change.  Anything other than the tomcat environment variable?)
    
    - In the chukwa root directory, say ``bash bin/processSinkFiles.sh'' 
+ 
+   - (Document TODO: This script has a hard-coded 54310 port.  Can you confirm that you must be running hdfs from 54310?)
    
  *  Configuring and starting HICC
  
@@ -64, +77 @@

  
    - Copy hicc.war into Apache Tomcat webapps directory.
  
+   - (Document TODO: where is hicc.war?  Is it created by one of the above services such as the demux?)
+ 
    - Startup Tomcat.
  
  RUNNING CHUKWA -- NETWORKED