You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Elliott Clark (JIRA)" <ji...@apache.org> on 2012/05/17 01:47:06 UTC
[jira] [Created] (HBASE-6025) Expose Hadoop Metrics through JSON
Rest interface
Elliott Clark created HBASE-6025:
------------------------------------
Summary: Expose Hadoop Metrics through JSON Rest interface
Key: HBASE-6025
URL: https://issues.apache.org/jira/browse/HBASE-6025
Project: HBase
Issue Type: Improvement
Reporter: Elliott Clark
Assignee: Elliott Clark
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13278095#comment-13278095 ]
stack commented on HBASE-6025:
------------------------------
@Gary Thanks boss. Looking, I was running w/ 1.0.2 last night.
Elliott, you seeing something else?
BTW, going to update hadoop and jackson over in hbase-6034
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13450195#comment-13450195 ]
Hadoop QA commented on HBASE-6025:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12544132/HBASE-6025-4.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
+1 hadoop2.0. The patch compiles against the hadoop 2.0 profile.
-1 javadoc. The javadoc tool appears to have generated 106 warning messages.
-1 javac. The applied patch generated 5 javac compiler warnings (more than the trunk's current 4 warnings).
-1 findbugs. The patch appears to introduce 7 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.hbase.replication.TestReplication
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/2811//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2811//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2811//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2811//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2811//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2811//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2811//console
This message is automatically generated.
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.96.0
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: HBASE-6025-0.patch, HBASE-6025-1.patch, HBASE-6025-2.patch, HBASE-6025-3.patch, HBASE-6025-4.patch, hbase-jmx2.patch, hbase-jmx.patch, hbase-jmx.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6025) Expose Hadoop Dynamic Metrics through
JSON Rest interface
Posted by "Elliott Clark (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Elliott Clark updated HBASE-6025:
---------------------------------
Attachment: HBASE-6025-1.patch
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: HBASE-6025-0.patch, HBASE-6025-1.patch, hbase-jmx.patch, hbase-jmx.patch, hbase-jmx2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "Gary Helmling (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13278092#comment-13278092 ]
Gary Helmling commented on HBASE-6025:
--------------------------------------
@Stack
The UnsupportedOperationException is fixed in HADOOP-8207. It's flagged as fixed in 1.0.3.
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Metrics through JSON
Rest interface
Posted by "Enis Soztutar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13277279#comment-13277279 ]
Enis Soztutar commented on HBASE-6025:
--------------------------------------
How is this different than http://region-server:60030/jmx ? It works with hadoop-1.0.1+ (HBASE-5309)
> Expose Hadoop Metrics through JSON Rest interface
> -------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "Elliott Clark (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13278012#comment-13278012 ]
Elliott Clark commented on HBASE-6025:
--------------------------------------
The dynamic metrics don't show up unless NullContextWithUpdateThread is used as the hadoop metrics context. I opened HBASE-5802 a while ago. It looks like I should get the documentation stuff that Stack was asking for there so that everything shows up here without users having to do anything more.
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6025) Expose Hadoop Dynamic Metrics through
JSON Rest interface
Posted by "Enis Soztutar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Enis Soztutar updated HBASE-6025:
---------------------------------
Attachment: hbase-jmx.patch
Attaching simple patch to add /jmx links to the rs/master web UI's.
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: hbase-jmx.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "Elliott Clark (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13278302#comment-13278302 ]
Elliott Clark commented on HBASE-6025:
--------------------------------------
After the latest commits with new dependencies I am no longer seeing this error.
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Metrics through JSON
Rest interface
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13277276#comment-13277276 ]
stack commented on HBASE-6025:
------------------------------
A few folks have asked for this including a gentleman w/ gallic accent (A 'real' fr accent, not that quebecoispatois).
> Expose Hadoop Metrics through JSON Rest interface
> -------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "Enis Soztutar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13278019#comment-13278019 ]
Enis Soztutar commented on HBASE-6025:
--------------------------------------
I see. Then, +1 for HBASE-5802.
@Elliot, do you see the exception that Stack has pasted?
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13438102#comment-13438102 ]
Hadoop QA commented on HBASE-6025:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12541620/HBASE-6025-3.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
+1 hadoop2.0. The patch compiles against the hadoop 2.0 profile.
+1 javadoc. The javadoc tool did not generate any warning messages.
-1 javac. The applied patch generated 5 javac compiler warnings (more than the trunk's current 4 warnings).
-1 findbugs. The patch appears to introduce 6 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.hbase.TestMultiVersions
org.apache.hadoop.hbase.master.TestSplitLogManager
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/2629//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2629//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2629//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2629//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2629//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2629//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2629//console
This message is automatically generated.
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: HBASE-6025-0.patch, HBASE-6025-1.patch, HBASE-6025-2.patch, HBASE-6025-3.patch, hbase-jmx2.patch, hbase-jmx.patch, hbase-jmx.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13399889#comment-13399889 ]
Hadoop QA commented on HBASE-6025:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12533171/hbase-jmx2.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
+1 hadoop2.0. The patch compiles against the hadoop 2.0 profile.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 findbugs. The patch appears to introduce 11 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.hbase.security.access.TestAccessController
org.apache.hadoop.hbase.TestZooKeeper
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/2234//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2234//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2234//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2234//console
This message is automatically generated.
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: HBASE-6025-0.patch, HBASE-6025-1.patch, HBASE-6025-2.patch, hbase-jmx.patch, hbase-jmx.patch, hbase-jmx2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6025) Expose Hadoop Dynamic Metrics through
JSON Rest interface
Posted by "Elliott Clark (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Elliott Clark updated HBASE-6025:
---------------------------------
Attachment: HBASE-6025-0.patch
Added the link in all of the places.
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: HBASE-6025-0.patch, hbase-jmx.patch, hbase-jmx.patch, hbase-jmx2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13399891#comment-13399891 ]
Hadoop QA commented on HBASE-6025:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12533172/HBASE-6025-0.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
+1 hadoop2.0. The patch compiles against the hadoop 2.0 profile.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 findbugs. The patch appears to introduce 11 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.hbase.util.TestFSUtils
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/2235//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2235//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2235//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2235//console
This message is automatically generated.
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: HBASE-6025-0.patch, HBASE-6025-1.patch, HBASE-6025-2.patch, hbase-jmx.patch, hbase-jmx.patch, hbase-jmx2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6025) Expose Hadoop Dynamic Metrics through
JSON Rest interface
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-6025:
-------------------------
Status: Patch Available (was: Open)
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: hbase-jmx.patch, hbase-jmx.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6025) Expose Hadoop Dynamic Metrics through
JSON Rest interface
Posted by "Elliott Clark (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Elliott Clark updated HBASE-6025:
---------------------------------
Attachment: HBASE-6025-4.patch
rebase
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: HBASE-6025-0.patch, HBASE-6025-1.patch, HBASE-6025-2.patch, HBASE-6025-3.patch, HBASE-6025-4.patch, hbase-jmx2.patch, hbase-jmx.patch, hbase-jmx.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6025) Expose Hadoop Dynamic Metrics through
JSON Rest interface
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-6025:
-------------------------
Resolution: Fixed
Fix Version/s: 0.96.0
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Applied to trunk. Thanks for the patch Elliott.
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.96.0
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Fix For: 0.96.0
>
> Attachments: HBASE-6025-0.patch, HBASE-6025-1.patch, HBASE-6025-2.patch, HBASE-6025-3.patch, HBASE-6025-4.patch, hbase-jmx2.patch, hbase-jmx.patch, hbase-jmx.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13399863#comment-13399863 ]
Hadoop QA commented on HBASE-6025:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12533169/hbase-jmx.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2233//console
This message is automatically generated.
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: hbase-jmx.patch, hbase-jmx.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "Elliott Clark (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13278027#comment-13278027 ]
Elliott Clark commented on HBASE-6025:
--------------------------------------
I do. Testing on an up to date trunk build.
{code}
012-05-17 17:54:36,958 ERROR org.apache.hadoop.jmx.JMXJsonServlet: getting attribute UsageThresholdExceeded of java.lang:type=MemoryPool,name=Par Survivor Space threw an exception
javax.management.RuntimeMBeanException: java.lang.UnsupportedOperationException: Usage threshold is not supported
2012-05-17 17:54:36,944 ERROR org.apache.hadoop.jmx.JMXJsonServlet: getting attribute UsageThresholdExceeded of java.lang:type=MemoryPool,name=Par Eden Space threw an exception
javax.management.RuntimeMBeanException: java.lang.UnsupportedOperationException: Usage threshold is not supported
2012-05-17 17:54:36,932 ERROR org.apache.hadoop.jmx.JMXJsonServlet: getting attribute CollectionUsageThresholdExceeded of java.lang:type=MemoryPool,name=Code Cache threw an exception
javax.management.RuntimeMBeanException: java.lang.UnsupportedOperationException: CollectionUsage threshold is not supported
{code}
Seems like a different attribute but always a very similar exception and the same stack trace.
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6025) Expose Hadoop Dynamic Metrics through
JSON Rest interface
Posted by "Elliott Clark (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Elliott Clark updated HBASE-6025:
---------------------------------
Attachment: HBASE-6025-3.patch
patch rebased on trunk
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: HBASE-6025-0.patch, HBASE-6025-1.patch, HBASE-6025-2.patch, HBASE-6025-3.patch, hbase-jmx2.patch, hbase-jmx.patch, hbase-jmx.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6025) Expose Hadoop Dynamic Metrics through
JSON Rest interface
Posted by "Elliott Clark (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Elliott Clark updated HBASE-6025:
---------------------------------
Summary: Expose Hadoop Dynamic Metrics through JSON Rest interface (was: Expose Hadoop Metrics through JSON Rest interface)
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13399882#comment-13399882 ]
stack commented on HBASE-6025:
------------------------------
+1 on your patch Elliott (You intended to leave it off the zk page?)
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: HBASE-6025-0.patch, HBASE-6025-1.patch, hbase-jmx.patch, hbase-jmx.patch, hbase-jmx2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "Elliott Clark (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13278112#comment-13278112 ]
Elliott Clark commented on HBASE-6025:
--------------------------------------
Nope, it all looks like the UnsupportedOperationException
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6025) Expose Hadoop Dynamic Metrics through
JSON Rest interface
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-6025:
-------------------------
Status: Open (was: Patch Available)
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: hbase-jmx.patch, hbase-jmx.patch, hbase-jmx2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13399905#comment-13399905 ]
Hadoop QA commented on HBASE-6025:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12533174/HBASE-6025-2.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
+1 hadoop2.0. The patch compiles against the hadoop 2.0 profile.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 findbugs. The patch appears to introduce 11 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.hbase.master.TestHMasterRPCException
org.apache.hadoop.hbase.regionserver.TestSplitLogWorker
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/2236//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2236//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2236//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2236//console
This message is automatically generated.
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: HBASE-6025-0.patch, HBASE-6025-1.patch, HBASE-6025-2.patch, hbase-jmx.patch, hbase-jmx.patch, hbase-jmx2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13463731#comment-13463731 ]
Hudson commented on HBASE-6025:
-------------------------------
Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #193 (See [https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/193/])
HBASE-6025 Expose Hadoop Dynamic Metrics through JSON Rest interface; REAPPLY (Revision 1390240)
HBASE-6025 Expose Hadoop Dynamic Metrics through JSON Rest interface; REVERT -- OVERCOMMIT (Revision 1390239)
HBASE-6025 Expose Hadoop Dynamic Metrics through JSON Rest interface (Revision 1390238)
Result = FAILURE
stack :
Files :
* /hbase/trunk/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
* /hbase/trunk/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/RSStatusTmpl.jamon
* /hbase/trunk/hbase-server/src/main/resources/hbase-webapps/master/table.jsp
* /hbase/trunk/hbase-server/src/main/resources/hbase-webapps/master/tablesDetailed.jsp
* /hbase/trunk/hbase-server/src/main/resources/hbase-webapps/master/zk.jsp
stack :
Files :
* /hbase/trunk/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
* /hbase/trunk/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/RSStatusTmpl.jamon
* /hbase/trunk/hbase-server/src/main/resources/hbase-webapps/master/table.jsp
* /hbase/trunk/hbase-server/src/main/resources/hbase-webapps/master/tablesDetailed.jsp
* /hbase/trunk/hbase-server/src/main/resources/hbase-webapps/master/zk.jsp
* /hbase/trunk/hbase-server/src/main/ruby/hbase/admin.rb
* /hbase/trunk/hbase-server/src/main/ruby/hbase/hbase.rb
* /hbase/trunk/hbase-server/src/main/ruby/hbase/table.rb
* /hbase/trunk/hbase-server/src/main/ruby/shell.rb
* /hbase/trunk/hbase-server/src/main/ruby/shell/commands.rb
* /hbase/trunk/hbase-server/src/main/ruby/shell/formatter.rb
stack :
Files :
* /hbase/trunk/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
* /hbase/trunk/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/RSStatusTmpl.jamon
* /hbase/trunk/hbase-server/src/main/resources/hbase-webapps/master/table.jsp
* /hbase/trunk/hbase-server/src/main/resources/hbase-webapps/master/tablesDetailed.jsp
* /hbase/trunk/hbase-server/src/main/resources/hbase-webapps/master/zk.jsp
* /hbase/trunk/hbase-server/src/main/ruby/hbase/admin.rb
* /hbase/trunk/hbase-server/src/main/ruby/hbase/hbase.rb
* /hbase/trunk/hbase-server/src/main/ruby/hbase/table.rb
* /hbase/trunk/hbase-server/src/main/ruby/shell.rb
* /hbase/trunk/hbase-server/src/main/ruby/shell/commands.rb
* /hbase/trunk/hbase-server/src/main/ruby/shell/formatter.rb
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.96.0
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Fix For: 0.96.0
>
> Attachments: HBASE-6025-0.patch, HBASE-6025-1.patch, HBASE-6025-2.patch, HBASE-6025-3.patch, HBASE-6025-4.patch, hbase-jmx2.patch, hbase-jmx.patch, hbase-jmx.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13277545#comment-13277545 ]
stack commented on HBASE-6025:
------------------------------
@Enis You saying that what comes out of jmx will show in a hadoop webapp servlet mounted at /jmx? I did not know such a thing existed (I forgot hbase-5309).
I tried it. Had to copy in jackson and newer hadoop (we ship 1.0.0 even in 0.94 which needs to be fixed). I see /jmx metrics (We should add a 'metrics' link along the top beside the log level, thread dump, etc. servlets.
What other servlets are we missing out on @Enis? There was a configuration dump IIRC but maybe thats not till 2.0.0 hadoop?
Oh, it looks like the jmx per-region stuff is showing under /jmx because Elliott already added this to 0.94 and trunk.
So, seems like, to make this work for trunk, all we have to do is:
1. update jackson and hadoop versions
2. Add a metrics link to show on all pages
3. Fix this exception:
{code}
2012-05-16 21:24:06,077 ERROR org.apache.hadoop.jmx.JMXJsonServlet: getting attribute CollectionUsageThresholdCount of java.lang:type=MemoryPool,name=Code Cache threw an exception
javax.management.RuntimeMBeanException: java.lang.UnsupportedOperationException: CollectionUsage threshold is not supported
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.rethrow(DefaultMBeanServerInterceptor.java:856)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.rethrowMaybeMBeanException(DefaultMBeanServerInterceptor.java:869)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getAttribute(DefaultMBeanServerInterceptor.java:670)
at com.sun.jmx.mbeanserver.JmxMBeanServer.getAttribute(JmxMBeanServer.java:638)
at org.apache.hadoop.jmx.JMXJsonServlet.writeAttribute(JMXJsonServlet.java:251)
at org.apache.hadoop.jmx.JMXJsonServlet.listBeans(JMXJsonServlet.java:227)
at org.apache.hadoop.jmx.JMXJsonServlet.doGet(JMXJsonServlet.java:159)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)
at org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:835)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Caused by: java.lang.UnsupportedOperationException: CollectionUsage threshold is not supported
at sun.management.MemoryPoolImpl.getCollectionUsageThresholdCount(MemoryPoolImpl.java:229)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
{code}
Should at least be backported to 0.94.
This is great.
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Metrics through JSON
Rest interface
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13277275#comment-13277275 ]
stack commented on HBASE-6025:
------------------------------
One option is enable REST webapp and then the client can ask for the their metrics as pb, json, etc. (It does this encoding for you).
> Expose Hadoop Metrics through JSON Rest interface
> -------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13463471#comment-13463471 ]
Hudson commented on HBASE-6025:
-------------------------------
Integrated in HBase-TRUNK #3379 (See [https://builds.apache.org/job/HBase-TRUNK/3379/])
HBASE-6025 Expose Hadoop Dynamic Metrics through JSON Rest interface; REAPPLY (Revision 1390240)
HBASE-6025 Expose Hadoop Dynamic Metrics through JSON Rest interface; REVERT -- OVERCOMMIT (Revision 1390239)
HBASE-6025 Expose Hadoop Dynamic Metrics through JSON Rest interface (Revision 1390238)
Result = FAILURE
stack :
Files :
* /hbase/trunk/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
* /hbase/trunk/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/RSStatusTmpl.jamon
* /hbase/trunk/hbase-server/src/main/resources/hbase-webapps/master/table.jsp
* /hbase/trunk/hbase-server/src/main/resources/hbase-webapps/master/tablesDetailed.jsp
* /hbase/trunk/hbase-server/src/main/resources/hbase-webapps/master/zk.jsp
stack :
Files :
* /hbase/trunk/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
* /hbase/trunk/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/RSStatusTmpl.jamon
* /hbase/trunk/hbase-server/src/main/resources/hbase-webapps/master/table.jsp
* /hbase/trunk/hbase-server/src/main/resources/hbase-webapps/master/tablesDetailed.jsp
* /hbase/trunk/hbase-server/src/main/resources/hbase-webapps/master/zk.jsp
* /hbase/trunk/hbase-server/src/main/ruby/hbase/admin.rb
* /hbase/trunk/hbase-server/src/main/ruby/hbase/hbase.rb
* /hbase/trunk/hbase-server/src/main/ruby/hbase/table.rb
* /hbase/trunk/hbase-server/src/main/ruby/shell.rb
* /hbase/trunk/hbase-server/src/main/ruby/shell/commands.rb
* /hbase/trunk/hbase-server/src/main/ruby/shell/formatter.rb
stack :
Files :
* /hbase/trunk/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
* /hbase/trunk/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/RSStatusTmpl.jamon
* /hbase/trunk/hbase-server/src/main/resources/hbase-webapps/master/table.jsp
* /hbase/trunk/hbase-server/src/main/resources/hbase-webapps/master/tablesDetailed.jsp
* /hbase/trunk/hbase-server/src/main/resources/hbase-webapps/master/zk.jsp
* /hbase/trunk/hbase-server/src/main/ruby/hbase/admin.rb
* /hbase/trunk/hbase-server/src/main/ruby/hbase/hbase.rb
* /hbase/trunk/hbase-server/src/main/ruby/hbase/table.rb
* /hbase/trunk/hbase-server/src/main/ruby/shell.rb
* /hbase/trunk/hbase-server/src/main/ruby/shell/commands.rb
* /hbase/trunk/hbase-server/src/main/ruby/shell/formatter.rb
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.96.0
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Fix For: 0.96.0
>
> Attachments: HBASE-6025-0.patch, HBASE-6025-1.patch, HBASE-6025-2.patch, HBASE-6025-3.patch, HBASE-6025-4.patch, hbase-jmx2.patch, hbase-jmx.patch, hbase-jmx.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "Elliott Clark (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13278003#comment-13278003 ]
Elliott Clark commented on HBASE-6025:
--------------------------------------
@enis you're totally right it works well. Thanks for showing me that.
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6025) Expose Hadoop Dynamic Metrics through
JSON Rest interface
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-6025:
-------------------------
Attachment: hbase-jmx.patch
Update of Enis's patch to go against multi-module hbase. Also changed the text to be Metrics Dump instead of JMX Json Dump.
This OK to commit?
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: hbase-jmx.patch, hbase-jmx.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6025) Expose Hadoop Dynamic Metrics through
JSON Rest interface
Posted by "Elliott Clark (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Elliott Clark updated HBASE-6025:
---------------------------------
Attachment: HBASE-6025-2.patch
Haha nope. Hence why I opened HBASE-6259.
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: HBASE-6025-0.patch, HBASE-6025-1.patch, HBASE-6025-2.patch, hbase-jmx.patch, hbase-jmx.patch, hbase-jmx2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6025) Expose Hadoop Dynamic Metrics through
JSON Rest interface
Posted by "Elliott Clark (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Elliott Clark updated HBASE-6025:
---------------------------------
Affects Version/s: 0.96.0
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.96.0
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: HBASE-6025-0.patch, HBASE-6025-1.patch, HBASE-6025-2.patch, HBASE-6025-3.patch, HBASE-6025-4.patch, hbase-jmx2.patch, hbase-jmx.patch, hbase-jmx.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6025) Expose Hadoop Dynamic Metrics through
JSON Rest interface
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-6025:
-------------------------
Attachment: hbase-jmx2.patch
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: hbase-jmx.patch, hbase-jmx.patch, hbase-jmx2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Metrics through JSON
Rest interface
Posted by "Elliott Clark (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13277280#comment-13277280 ]
Elliott Clark commented on HBASE-6025:
--------------------------------------
RegionServerDynamicStatistics need to be exposed. Sorry I wasn't very clear.
> Expose Hadoop Metrics through JSON Rest interface
> -------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "Enis Soztutar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13278011#comment-13278011 ]
Enis Soztutar commented on HBASE-6025:
--------------------------------------
bq. You saying that what comes out of jmx will show in a hadoop webapp servlet mounted at /jmx?
Yes, it comes from the Hadoop HttpServer class, which adds JMXJsonServlet to serve for /jmx. That servlet finds all registered MBeans (including metrics) and exports them via json.
bq. we ship 1.0.0 even in 0.94 which needs to be fixed
hadoop-1.0.3 is recently released with fixes for non-oracle jvms and other bug fixes. We can switch to that.
bq. We should add a 'metrics' link along the top beside the log level, thread dump, etc. servlets
Agreed. I learned about this from the Hadoop folks. We should make it more visible.
bq. Oh, it looks like the jmx per-region stuff is showing under /jmx because Elliott already added this to 0.94 and trunk
In my near-trunk test, I saw the dynamic metrics json, but nothing reported underneath (did not spend much time on it). If it works for you, than what you outlined seems like a good plan.
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6025) Expose Hadoop Dynamic Metrics
through JSON Rest interface
Posted by "Enis Soztutar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13277481#comment-13277481 ]
Enis Soztutar commented on HBASE-6025:
--------------------------------------
Makes sense. Thanks for changing the issue title. Is the plan to add them to jmx, which in turn will make them available under /jmx?
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6025) Expose Hadoop Dynamic Metrics through
JSON Rest interface
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-6025:
-------------------------
Status: Patch Available (was: Open)
> Expose Hadoop Dynamic Metrics through JSON Rest interface
> ---------------------------------------------------------
>
> Key: HBASE-6025
> URL: https://issues.apache.org/jira/browse/HBASE-6025
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Elliott Clark
> Attachments: hbase-jmx.patch, hbase-jmx.patch, hbase-jmx2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira