You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Al Thompson (JIRA)" <ji...@apache.org> on 2010/08/26 18:48:56 UTC

[jira] Created: (HADOOP-6927) Herriot NN and DN clients should vend statistics

Herriot NN and DN clients should vend statistics
------------------------------------------------

                 Key: HADOOP-6927
                 URL: https://issues.apache.org/jira/browse/HADOOP-6927
             Project: Hadoop Common
          Issue Type: Improvement
          Components: test
            Reporter: Al Thompson


The HDFS web user interface serves useful information through dfshealth.jsp and dfsnodelist.jsp.

The Herriot interface to the namenode and datanode (as implemented in NNClient and DNClient, respectively) would benefit from the addition of some way to channel this information. In the case of DNClient this can be an injected method that returns a DatanodeDescriptor relevant to the underlying datanode.

There seems to be no analagous NamenodeDescriptor. It may be useful to add this as a facade to a visitor that aggregates values across the filesystem datanodes. These values are (from dfshealth JSP):

Configured Capacity
DFS Used
Non DFS Used
DFS Remaining
DFS Used%
DFS Remaining%
Live Nodes
Dead Nodes
Decommissioning Nodes
Number of Under-Replicated Blocks

Attributes reflecting the web user interface header may also be useful such as When-Started, Version, When-Compiled, and Upgrade-Status.

A NamenodeDescriptor would essentially "push down" the code in dfshealth web UI behind a more general abstraction. If it is objectionable to make this class available in HDFS, perhaps this could be packaged in a Herriot specific way.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Reopened: (HADOOP-6927) Herriot NN and DN clients should vend statistics

Posted by "Al Thompson (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Al Thompson reopened HADOOP-6927:
---------------------------------


This work should be restricted to providing access DataNodeDescriptor in Herriot's DNClient interface.
Certain metrics such as blocks-per-datanode are not yet supported in HDFS' JMX MBeans.

> Herriot NN and DN clients should vend statistics
> ------------------------------------------------
>
>                 Key: HADOOP-6927
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6927
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: test
>            Reporter: Al Thompson
>
> The HDFS web user interface serves useful information through dfshealth.jsp and dfsnodelist.jsp.
> The Herriot interface to the namenode and datanode (as implemented in NNClient and DNClient, respectively) would benefit from the addition of some way to channel this information. In the case of DNClient this can be an injected method that returns a DatanodeDescriptor relevant to the underlying datanode.
> There seems to be no analagous NamenodeDescriptor. It may be useful to add this as a facade to a visitor that aggregates values across the filesystem datanodes. These values are (from dfshealth JSP):
> Configured Capacity
> DFS Used
> Non DFS Used
> DFS Remaining
> DFS Used%
> DFS Remaining%
> Live Nodes
> Dead Nodes
> Decommissioning Nodes
> Number of Under-Replicated Blocks
> Attributes reflecting the web user interface header may also be useful such as When-Started, Version, When-Compiled, and Upgrade-Status.
> A NamenodeDescriptor would essentially "push down" the code in dfshealth web UI behind a more general abstraction. If it is objectionable to make this class available in HDFS, perhaps this could be packaged in a Herriot specific way.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Resolved: (HADOOP-6927) Herriot NN and DN clients should vend statistics

Posted by "Al Thompson (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Al Thompson resolved HADOOP-6927.
---------------------------------

    Resolution: Invalid

Best to use HDFS JMX support for gathering this info.

> Herriot NN and DN clients should vend statistics
> ------------------------------------------------
>
>                 Key: HADOOP-6927
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6927
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: test
>            Reporter: Al Thompson
>
> The HDFS web user interface serves useful information through dfshealth.jsp and dfsnodelist.jsp.
> The Herriot interface to the namenode and datanode (as implemented in NNClient and DNClient, respectively) would benefit from the addition of some way to channel this information. In the case of DNClient this can be an injected method that returns a DatanodeDescriptor relevant to the underlying datanode.
> There seems to be no analagous NamenodeDescriptor. It may be useful to add this as a facade to a visitor that aggregates values across the filesystem datanodes. These values are (from dfshealth JSP):
> Configured Capacity
> DFS Used
> Non DFS Used
> DFS Remaining
> DFS Used%
> DFS Remaining%
> Live Nodes
> Dead Nodes
> Decommissioning Nodes
> Number of Under-Replicated Blocks
> Attributes reflecting the web user interface header may also be useful such as When-Started, Version, When-Compiled, and Upgrade-Status.
> A NamenodeDescriptor would essentially "push down" the code in dfshealth web UI behind a more general abstraction. If it is objectionable to make this class available in HDFS, perhaps this could be packaged in a Herriot specific way.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.