[jira] Commented: (CHUKWA-557) Make differentiation between recordName and contextName and clean up chukwa metrics

["Eric Yang (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CHUKWA-557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12931776#action_12931776 ] 

Eric Yang commented on CHUKWA-557:
----------------------------------

This patch adds:

ChukwaMetricsProcessor for demux.

Chukwa metrics are defined as the following column family:

- chukwaAgent_chunkQueue
- chukwaAgent_httpSender
- chukwaAgent_metrics

Hadoop metrics are defined as the following column family:

- jvm_metrics
- mapred_metrics
- dfs_metrics
- dfs_namenode
- dfs_FSDirectory
- dfs_FSNamesystem
- dfs_datanode
- mapred_jobtracker
- mapred_shuffleInput
- mapred_shuffleOutput
- mapred_tasktracker
- mapred_job
- rpc_metrics

> Make differentiation between recordName and contextName and clean up chukwa metrics
> -----------------------------------------------------------------------------------
>
>                 Key: CHUKWA-557
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-557
>             Project: Chukwa
>          Issue Type: Improvement
>          Components: data collection
>         Environment: Java 6, MacOSX 6
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>         Attachments: CHUKWA-557.patch
>
>
> Metrics emited by Chukwa Agent through MetricsContext is structured as:
> contextName: chukwaHttpSender
> recordName: chukwaHttpSender
> The same context is repeated twice in the naming hierarchy.
> Ideally, the structure should be:
> contextName: chukwaAgent
> recordName: httpSender
> Therefore, the metrics can be collected in chukwa table, column family: agent_httpSender.  In sequence file, it will be chukwa data type directory, and hashmap looks like:
> {noformat}
> { "contextName":"chukwaAgent","recordName":"httpSender",...}
> {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.