[jira] Updated: (CHUKWA-575) Cluster Summarization script

["Eric Yang (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/CHUKWA-575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Yang updated CHUKWA-575:
-----------------------------

    Attachment: CHUKWA-575.patch

Usage:

pig -param START=[starting epoch millisecond] -Dpig.additional.jars=$PIG_PATH/pig.jar:$HBASE_HOME/hbase-0.20.6.jar $CHUKWA_HOME/script/pig/ClusterSummary.pig

> Cluster Summarization script
> ----------------------------
>
>                 Key: CHUKWA-575
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-575
>             Project: Chukwa
>          Issue Type: New Feature
>          Components: scripts
>         Environment: Java 6, Mac OS X 10.6
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>             Fix For: 0.5.0
>
>         Attachments: CHUKWA-575.patch
>
>
>  Chukwa record metrics from name node, data node, job tracker, task tracker, etc, but the raw metrics does not help determine all aspect of the cluster health.  For now, we have the following metrics in HBase:
>  * System
>  *   Disk
>  *   Memory
>  *   Network
>  * HDFS
>  *   Name Node
>  *   Data Node
>  * Map Reduce
>  *   Job Tracker
>  *   Task Tracker
> We can further analyze the data to provide a summary for the cluster as these categories:
>  * System - Performance profile of how busy the nodes are in the cluster
>  * HDFS - Capacity of the disk storage, and health of the data in the file system
>  * MapReduce - Capacity of the processing pipeline, and health of the processing system

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.