You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@chukwa.apache.org by "Eric Yang (JIRA)" <ji...@apache.org> on 2010/11/14 06:45:13 UTC
[jira] Created: (CHUKWA-557) Make differentiation between
recordName and contextName
Make differentiation between recordName and contextName
-------------------------------------------------------
Key: CHUKWA-557
URL: https://issues.apache.org/jira/browse/CHUKWA-557
Project: Chukwa
Issue Type: Improvement
Components: data collection
Environment: Java 6, MacOSX 6
Reporter: Eric Yang
Assignee: Eric Yang
Metrics emited by Chukwa Agent through MetricsContext is structured as:
contextName: chukwaHttpSender
recordName: chukwaHttpSender
The same context is repeated twice in the naming hierarchy.
Ideally, the structure should be:
contextName: agent
recordName: httpSender
Therefore, the metrics can be collected in chukwa table, column family: agent_httpSender. In sequence file, it will be chukwa data type directory, and hashmap looks like:
{noformat}
{ "contextName":"agent","recordName":"httpSender",...}
{noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-557) Make differentiation between
recordName and contextName and clean up chukwa metrics
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-557:
-----------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this.
> Make differentiation between recordName and contextName and clean up chukwa metrics
> -----------------------------------------------------------------------------------
>
> Key: CHUKWA-557
> URL: https://issues.apache.org/jira/browse/CHUKWA-557
> Project: Chukwa
> Issue Type: Improvement
> Components: data collection
> Environment: Java 6, MacOSX 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Fix For: 0.5.0
>
> Attachments: CHUKWA-557.patch
>
>
> Metrics emited by Chukwa Agent through MetricsContext is structured as:
> contextName: chukwaHttpSender
> recordName: chukwaHttpSender
> The same context is repeated twice in the naming hierarchy.
> Ideally, the structure should be:
> contextName: chukwaAgent
> recordName: httpSender
> Therefore, the metrics can be collected in chukwa table, column family: agent_httpSender. In sequence file, it will be chukwa data type directory, and hashmap looks like:
> {noformat}
> { "contextName":"chukwaAgent","recordName":"httpSender",...}
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-557) Make differentiation between
recordName and contextName and clean up chukwa metrics
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12931776#action_12931776 ]
Eric Yang commented on CHUKWA-557:
----------------------------------
This patch adds:
ChukwaMetricsProcessor for demux.
Chukwa metrics are defined as the following column family:
- chukwaAgent_chunkQueue
- chukwaAgent_httpSender
- chukwaAgent_metrics
Hadoop metrics are defined as the following column family:
- jvm_metrics
- mapred_metrics
- dfs_metrics
- dfs_namenode
- dfs_FSDirectory
- dfs_FSNamesystem
- dfs_datanode
- mapred_jobtracker
- mapred_shuffleInput
- mapred_shuffleOutput
- mapred_tasktracker
- mapred_job
- rpc_metrics
> Make differentiation between recordName and contextName and clean up chukwa metrics
> -----------------------------------------------------------------------------------
>
> Key: CHUKWA-557
> URL: https://issues.apache.org/jira/browse/CHUKWA-557
> Project: Chukwa
> Issue Type: Improvement
> Components: data collection
> Environment: Java 6, MacOSX 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-557.patch
>
>
> Metrics emited by Chukwa Agent through MetricsContext is structured as:
> contextName: chukwaHttpSender
> recordName: chukwaHttpSender
> The same context is repeated twice in the naming hierarchy.
> Ideally, the structure should be:
> contextName: chukwaAgent
> recordName: httpSender
> Therefore, the metrics can be collected in chukwa table, column family: agent_httpSender. In sequence file, it will be chukwa data type directory, and hashmap looks like:
> {noformat}
> { "contextName":"chukwaAgent","recordName":"httpSender",...}
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-557) Make differentiation between
recordName and contextName and clean up chukwa metrics
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-557:
-----------------------------
Fix Version/s: 0.5.0
Release Note: Improved grouping of Hadoop metrics and Chukwa metrics.
Status: Patch Available (was: Open)
> Make differentiation between recordName and contextName and clean up chukwa metrics
> -----------------------------------------------------------------------------------
>
> Key: CHUKWA-557
> URL: https://issues.apache.org/jira/browse/CHUKWA-557
> Project: Chukwa
> Issue Type: Improvement
> Components: data collection
> Environment: Java 6, MacOSX 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Fix For: 0.5.0
>
> Attachments: CHUKWA-557.patch
>
>
> Metrics emited by Chukwa Agent through MetricsContext is structured as:
> contextName: chukwaHttpSender
> recordName: chukwaHttpSender
> The same context is repeated twice in the naming hierarchy.
> Ideally, the structure should be:
> contextName: chukwaAgent
> recordName: httpSender
> Therefore, the metrics can be collected in chukwa table, column family: agent_httpSender. In sequence file, it will be chukwa data type directory, and hashmap looks like:
> {noformat}
> { "contextName":"chukwaAgent","recordName":"httpSender",...}
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-557) Make differentiation between
recordName and contextName and clean up chukwa metrics
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-557:
-----------------------------
Description:
Metrics emited by Chukwa Agent through MetricsContext is structured as:
contextName: chukwaHttpSender
recordName: chukwaHttpSender
The same context is repeated twice in the naming hierarchy.
Ideally, the structure should be:
contextName: chukwaAgent
recordName: httpSender
Therefore, the metrics can be collected in chukwa table, column family: agent_httpSender. In sequence file, it will be chukwa data type directory, and hashmap looks like:
{noformat}
{ "contextName":"chukwaAgent","recordName":"httpSender",...}
{noformat}
was:
Metrics emited by Chukwa Agent through MetricsContext is structured as:
contextName: chukwaHttpSender
recordName: chukwaHttpSender
The same context is repeated twice in the naming hierarchy.
Ideally, the structure should be:
contextName: agent
recordName: httpSender
Therefore, the metrics can be collected in chukwa table, column family: agent_httpSender. In sequence file, it will be chukwa data type directory, and hashmap looks like:
{noformat}
{ "contextName":"agent","recordName":"httpSender",...}
{noformat}
Summary: Make differentiation between recordName and contextName and clean up chukwa metrics (was: Make differentiation between recordName and contextName)
Chukwa Metrics also needs a cleaner parser.
> Make differentiation between recordName and contextName and clean up chukwa metrics
> -----------------------------------------------------------------------------------
>
> Key: CHUKWA-557
> URL: https://issues.apache.org/jira/browse/CHUKWA-557
> Project: Chukwa
> Issue Type: Improvement
> Components: data collection
> Environment: Java 6, MacOSX 6
> Reporter: Eric Yang
> Assignee: Eric Yang
>
> Metrics emited by Chukwa Agent through MetricsContext is structured as:
> contextName: chukwaHttpSender
> recordName: chukwaHttpSender
> The same context is repeated twice in the naming hierarchy.
> Ideally, the structure should be:
> contextName: chukwaAgent
> recordName: httpSender
> Therefore, the metrics can be collected in chukwa table, column family: agent_httpSender. In sequence file, it will be chukwa data type directory, and hashmap looks like:
> {noformat}
> { "contextName":"chukwaAgent","recordName":"httpSender",...}
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-557) Make differentiation between
recordName and contextName and clean up chukwa metrics
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-557:
-----------------------------
Attachment: CHUKWA-557.patch
> Make differentiation between recordName and contextName and clean up chukwa metrics
> -----------------------------------------------------------------------------------
>
> Key: CHUKWA-557
> URL: https://issues.apache.org/jira/browse/CHUKWA-557
> Project: Chukwa
> Issue Type: Improvement
> Components: data collection
> Environment: Java 6, MacOSX 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-557.patch
>
>
> Metrics emited by Chukwa Agent through MetricsContext is structured as:
> contextName: chukwaHttpSender
> recordName: chukwaHttpSender
> The same context is repeated twice in the naming hierarchy.
> Ideally, the structure should be:
> contextName: chukwaAgent
> recordName: httpSender
> Therefore, the metrics can be collected in chukwa table, column family: agent_httpSender. In sequence file, it will be chukwa data type directory, and hashmap looks like:
> {noformat}
> { "contextName":"chukwaAgent","recordName":"httpSender",...}
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.