You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Eric Yang (JIRA)" <ji...@apache.org> on 2011/06/30 21:43:30 UTC
[jira] [Created] (HADOOP-7436) Bundle Chukwa Metrics plugin in
Hadoop
Bundle Chukwa Metrics plugin in Hadoop
--------------------------------------
Key: HADOOP-7436
URL: https://issues.apache.org/jira/browse/HADOOP-7436
Project: Hadoop Common
Issue Type: New Feature
Environment: Java 6
Reporter: Eric Yang
Assignee: Eric Yang
For monitoring hadoop cluster with Chukwa, the current step is to copy chukwa-hadoop-*-client.jar and json-simple to hadoop classpath. (i.e. $HADOOP_HOME/lib or $HADOOP_PREFIX/share/hadoop/lib), and modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable chukwa monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7436) Bundle Chukwa Metrics plugin in
Hadoop
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13058051#comment-13058051 ]
Eric Yang commented on HADOOP-7436:
-----------------------------------
Metrics plugin is like a driver software. Linux kernel bundles compatible drivers in the source tarball. This is no different, it is easier to certify a software driver if it is included in the kernel source with test cases. If a broken driver is not fixed, it is easy to remove. The power and responsibilities are in the hand of the Hadoop PMC. If Hadoop community don't make integration easy, then it depends on third party to make the integration happen. The distributed integration approach only drains developers from Hadoop community. This is something I would like to avoid.
> Bundle Chukwa Metrics plugin in Hadoop
> --------------------------------------
>
> Key: HADOOP-7436
> URL: https://issues.apache.org/jira/browse/HADOOP-7436
> Project: Hadoop Common
> Issue Type: New Feature
> Environment: Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
>
> For monitoring hadoop cluster with Chukwa, the current step is to copy chukwa-hadoop-*-client.jar and json-simple to hadoop classpath. (i.e. $HADOOP_HOME/lib or $HADOOP_PREFIX/share/hadoop/lib), and modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable chukwa monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7436) Bundle Log4j socket appender Metrics
plugin in Hadoop
Posted by "Harsh J (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Harsh J updated HADOOP-7436:
----------------------------
Fix Version/s: (was: 0.24.0)
> Bundle Log4j socket appender Metrics plugin in Hadoop
> -----------------------------------------------------
>
> Key: HADOOP-7436
> URL: https://issues.apache.org/jira/browse/HADOOP-7436
> Project: Hadoop Common
> Issue Type: New Feature
> Affects Versions: 0.23.0
> Environment: Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-7436-1.patch, HADOOP-7436.patch
>
>
> Modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable other monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7436) Bundle Chukwa Metrics plugin in
Hadoop
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13058037#comment-13058037 ]
Todd Lipcon commented on HADOOP-7436:
-------------------------------------
I disagree -- I think what we need is a better plugin system. Contrib like this tends to aggregate broken code that no one wants to maintain (witness hdfsproxy tests that have been failing >1 year)
> Bundle Chukwa Metrics plugin in Hadoop
> --------------------------------------
>
> Key: HADOOP-7436
> URL: https://issues.apache.org/jira/browse/HADOOP-7436
> Project: Hadoop Common
> Issue Type: New Feature
> Environment: Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
>
> For monitoring hadoop cluster with Chukwa, the current step is to copy chukwa-hadoop-*-client.jar and json-simple to hadoop classpath. (i.e. $HADOOP_HOME/lib or $HADOOP_PREFIX/share/hadoop/lib), and modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable chukwa monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7436) Bundle Chukwa Metrics plugin in
Hadoop
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13060110#comment-13060110 ]
Hadoop QA commented on HADOOP-7436:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12485321/HADOOP-7436.patch
against trunk revision 1143149.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 5 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
+1 system test framework. The patch passed system test framework compile.
Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/694//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/694//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/694//console
This message is automatically generated.
> Bundle Chukwa Metrics plugin in Hadoop
> --------------------------------------
>
> Key: HADOOP-7436
> URL: https://issues.apache.org/jira/browse/HADOOP-7436
> Project: Hadoop Common
> Issue Type: New Feature
> Affects Versions: 0.23.0
> Environment: Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Fix For: 0.23.0
>
> Attachments: HADOOP-7436.patch
>
>
> For monitoring hadoop cluster with Chukwa, the current step is to copy chukwa-hadoop-*-client.jar and json-simple to hadoop classpath. (i.e. $HADOOP_HOME/lib or $HADOOP_PREFIX/share/hadoop/lib), and modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable chukwa monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7436) Bundle Chukwa Metrics plugin in
Hadoop
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated HADOOP-7436:
------------------------------
Fix Version/s: 0.23.0
Affects Version/s: 0.23.0
Release Note: New SocketSink plugin for Metrics2 framework to stream metrics to Chukwa SocketAdaptor
Status: Patch Available (was: Open)
> Bundle Chukwa Metrics plugin in Hadoop
> --------------------------------------
>
> Key: HADOOP-7436
> URL: https://issues.apache.org/jira/browse/HADOOP-7436
> Project: Hadoop Common
> Issue Type: New Feature
> Affects Versions: 0.23.0
> Environment: Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Fix For: 0.23.0
>
> Attachments: HADOOP-7436.patch
>
>
> For monitoring hadoop cluster with Chukwa, the current step is to copy chukwa-hadoop-*-client.jar and json-simple to hadoop classpath. (i.e. $HADOOP_HOME/lib or $HADOOP_PREFIX/share/hadoop/lib), and modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable chukwa monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7436) Bundle Chukwa Metrics plugin in
Hadoop
Posted by "Luke Lu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13058167#comment-13058167 ]
Luke Lu commented on HADOOP-7436:
---------------------------------
Yes, this is as reasonable as bundling Ganglia sinks, IMO.
> Bundle Chukwa Metrics plugin in Hadoop
> --------------------------------------
>
> Key: HADOOP-7436
> URL: https://issues.apache.org/jira/browse/HADOOP-7436
> Project: Hadoop Common
> Issue Type: New Feature
> Environment: Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
>
> For monitoring hadoop cluster with Chukwa, the current step is to copy chukwa-hadoop-*-client.jar and json-simple to hadoop classpath. (i.e. $HADOOP_HOME/lib or $HADOOP_PREFIX/share/hadoop/lib), and modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable chukwa monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7436) Bundle Chukwa Metrics plugin in
Hadoop
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13060152#comment-13060152 ]
Hadoop QA commented on HADOOP-7436:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12485339/HADOOP-7436-1.patch
against trunk revision 1143149.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 5 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
+1 system test framework. The patch passed system test framework compile.
Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/695//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/695//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/695//console
This message is automatically generated.
> Bundle Chukwa Metrics plugin in Hadoop
> --------------------------------------
>
> Key: HADOOP-7436
> URL: https://issues.apache.org/jira/browse/HADOOP-7436
> Project: Hadoop Common
> Issue Type: New Feature
> Affects Versions: 0.23.0
> Environment: Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Fix For: 0.23.0
>
> Attachments: HADOOP-7436-1.patch, HADOOP-7436.patch
>
>
> For monitoring hadoop cluster with Chukwa, the current step is to copy chukwa-hadoop-*-client.jar and json-simple to hadoop classpath. (i.e. $HADOOP_HOME/lib or $HADOOP_PREFIX/share/hadoop/lib), and modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable chukwa monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7436) Bundle Chukwa Metrics plugin in
Hadoop
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13058054#comment-13058054 ]
Todd Lipcon commented on HADOOP-7436:
-------------------------------------
The difference is that Linux has a sane maintainer system, where each subtree has someone who is committed to its maintenance. We don't have such a thing.
In theory, it's easy to remove broken code, but in practice, when we tried to do this with hdfxproxy, people -1ed its removal and then didn't step up to fix the tests (which are still failing).
> Bundle Chukwa Metrics plugin in Hadoop
> --------------------------------------
>
> Key: HADOOP-7436
> URL: https://issues.apache.org/jira/browse/HADOOP-7436
> Project: Hadoop Common
> Issue Type: New Feature
> Environment: Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
>
> For monitoring hadoop cluster with Chukwa, the current step is to copy chukwa-hadoop-*-client.jar and json-simple to hadoop classpath. (i.e. $HADOOP_HOME/lib or $HADOOP_PREFIX/share/hadoop/lib), and modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable chukwa monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7436) Bundle Chukwa Metrics plugin in
Hadoop
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13058126#comment-13058126 ]
Todd Lipcon commented on HADOOP-7436:
-------------------------------------
Yea, if it's that generic, I suppose it makes sense. I had figured it was a Chukwa-specific protocol and would have to pull in chukwa as a dependency.
> Bundle Chukwa Metrics plugin in Hadoop
> --------------------------------------
>
> Key: HADOOP-7436
> URL: https://issues.apache.org/jira/browse/HADOOP-7436
> Project: Hadoop Common
> Issue Type: New Feature
> Environment: Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
>
> For monitoring hadoop cluster with Chukwa, the current step is to copy chukwa-hadoop-*-client.jar and json-simple to hadoop classpath. (i.e. $HADOOP_HOME/lib or $HADOOP_PREFIX/share/hadoop/lib), and modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable chukwa monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7436) Bundle Log4j socket appender
Metrics plugin in Hadoop
Posted by "Harsh J (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13461268#comment-13461268 ]
Harsh J commented on HADOOP-7436:
---------------------------------
Hey Eric - Mind addressing Luke's comments above with a new patch please? :)
> Bundle Log4j socket appender Metrics plugin in Hadoop
> -----------------------------------------------------
>
> Key: HADOOP-7436
> URL: https://issues.apache.org/jira/browse/HADOOP-7436
> Project: Hadoop Common
> Issue Type: New Feature
> Affects Versions: 0.23.0
> Environment: Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-7436-1.patch, HADOOP-7436.patch
>
>
> Modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable other monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7436) Bundle Chukwa Metrics plugin in
Hadoop
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13058183#comment-13058183 ]
Todd Lipcon commented on HADOOP-7436:
-------------------------------------
If not for history, I'd have argued against the Ganglia sinks, too, fwiw :) Though worth noting that Ganglia is vastly more commonly used than Chukwa.
> Bundle Chukwa Metrics plugin in Hadoop
> --------------------------------------
>
> Key: HADOOP-7436
> URL: https://issues.apache.org/jira/browse/HADOOP-7436
> Project: Hadoop Common
> Issue Type: New Feature
> Environment: Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
>
> For monitoring hadoop cluster with Chukwa, the current step is to copy chukwa-hadoop-*-client.jar and json-simple to hadoop classpath. (i.e. $HADOOP_HOME/lib or $HADOOP_PREFIX/share/hadoop/lib), and modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable chukwa monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7436) Bundle Chukwa Metrics plugin in
Hadoop
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13058105#comment-13058105 ]
Eric Yang commented on HADOOP-7436:
-----------------------------------
Chukwa uses a simple mechanism, serialize metrics to JSON string, and stream JSON string to external system using Log4J socket appender. Chukwa metrics plugin is in fact generic. Hadoop currently has FileSink plugin to demo how to interface with Metrics 2 framework. It would be useful to have a generic Metrics 2 plugin that can stream metrics to any monitoring system that implements Log4J socket appender server. Hence, this should not generate unmaintained legacy code but a good interface for external monitoring systems. If I rename this plugin as Log4J Socket Metrics plugin, would this be a reasonable plugin to have in Hadoop?
> Bundle Chukwa Metrics plugin in Hadoop
> --------------------------------------
>
> Key: HADOOP-7436
> URL: https://issues.apache.org/jira/browse/HADOOP-7436
> Project: Hadoop Common
> Issue Type: New Feature
> Environment: Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
>
> For monitoring hadoop cluster with Chukwa, the current step is to copy chukwa-hadoop-*-client.jar and json-simple to hadoop classpath. (i.e. $HADOOP_HOME/lib or $HADOOP_PREFIX/share/hadoop/lib), and modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable chukwa monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7436) Bundle Log4j socket appender
Metrics plugin in Hadoop
Posted by "Luke Lu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13281324#comment-13281324 ]
Luke Lu commented on HADOOP-7436:
---------------------------------
IMO, We should avoid referencing chukwa in these patches, as they're just generic SocketSinks to send metrics as JSON, even though they're originally from chukwa.
> Bundle Log4j socket appender Metrics plugin in Hadoop
> -----------------------------------------------------
>
> Key: HADOOP-7436
> URL: https://issues.apache.org/jira/browse/HADOOP-7436
> Project: Hadoop Common
> Issue Type: New Feature
> Affects Versions: 0.23.0
> Environment: Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Fix For: 0.24.0
>
> Attachments: HADOOP-7436-1.patch, HADOOP-7436.patch
>
>
> Modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable other monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7436) Bundle Chukwa Metrics plugin in
Hadoop
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated HADOOP-7436:
------------------------------
Attachment: HADOOP-7436-1.patch
Fixed findbugs warning.
> Bundle Chukwa Metrics plugin in Hadoop
> --------------------------------------
>
> Key: HADOOP-7436
> URL: https://issues.apache.org/jira/browse/HADOOP-7436
> Project: Hadoop Common
> Issue Type: New Feature
> Affects Versions: 0.23.0
> Environment: Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Fix For: 0.23.0
>
> Attachments: HADOOP-7436-1.patch, HADOOP-7436.patch
>
>
> For monitoring hadoop cluster with Chukwa, the current step is to copy chukwa-hadoop-*-client.jar and json-simple to hadoop classpath. (i.e. $HADOOP_HOME/lib or $HADOOP_PREFIX/share/hadoop/lib), and modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable chukwa monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7436) Bundle Log4j socket appender Metrics
plugin in Hadoop
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated HADOOP-7436:
------------------------------
Description: Modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable other monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base. (was: For monitoring hadoop cluster with Chukwa, the current step is to copy chukwa-hadoop-*-client.jar and json-simple to hadoop classpath. (i.e. $HADOOP_HOME/lib or $HADOOP_PREFIX/share/hadoop/lib), and modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable chukwa monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base.)
Summary: Bundle Log4j socket appender Metrics plugin in Hadoop (was: Bundle Chukwa Metrics plugin in Hadoop)
> Bundle Log4j socket appender Metrics plugin in Hadoop
> -----------------------------------------------------
>
> Key: HADOOP-7436
> URL: https://issues.apache.org/jira/browse/HADOOP-7436
> Project: Hadoop Common
> Issue Type: New Feature
> Affects Versions: 0.23.0
> Environment: Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Fix For: 0.24.0
>
> Attachments: HADOOP-7436-1.patch, HADOOP-7436.patch
>
>
> Modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable other monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7436) Bundle Chukwa Metrics plugin in
Hadoop
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated HADOOP-7436:
------------------------------
Attachment: HADOOP-7436.patch
Added SocketSink for Metrics2 to stream metrics to Chukwa SocketAdaptor or generic Log4JSocketAppender server.
> Bundle Chukwa Metrics plugin in Hadoop
> --------------------------------------
>
> Key: HADOOP-7436
> URL: https://issues.apache.org/jira/browse/HADOOP-7436
> Project: Hadoop Common
> Issue Type: New Feature
> Environment: Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: HADOOP-7436.patch
>
>
> For monitoring hadoop cluster with Chukwa, the current step is to copy chukwa-hadoop-*-client.jar and json-simple to hadoop classpath. (i.e. $HADOOP_HOME/lib or $HADOOP_PREFIX/share/hadoop/lib), and modify the hadoop-metrics.properties to use org.apache.hadoop.chukwa.inputtools.log4j.Log4JMetricsContext for emitting metrics. It is preferred to reduce the number of manual steps that is required to enable chukwa monitored hadoop cluster by moving the plugin code into hadoop code base. It is similar to bundling Ganglia metrics plugin in Hadoop code base.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira