You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Hairong Kuang (JIRA)" <ji...@apache.org> on 2010/12/13 21:07:02 UTC
[jira] Created: (HDFS-1536) Improve HDFS WebUI
Improve HDFS WebUI
------------------
Key: HDFS-1536
URL: https://issues.apache.org/jira/browse/HDFS-1536
Project: Hadoop HDFS
Issue Type: Improvement
Affects Versions: 0.23.0
Reporter: Hairong Kuang
Assignee: Hairong Kuang
Fix For: 0.23.0
1. Make the missing blocks count accurate;
2. Make the under replicated blocks count excluding missing blocks.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-1536) Improve HDFS WebUI
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12971180#action_12971180 ]
Nigel Daley commented on HDFS-1536:
-----------------------------------
Hairong, can you add a tooltip that describes the new meaning of this value in context? Something like:
{code}
private String colTxt(String title) {
return "<td id=\"col" + ++colNum + "\" title=\"" + title + "\"> ";
}
...
colTxt("Excludes missing blocks.")
{code}
We should probably do this for other fields too, but that's a separate jira.
> Improve HDFS WebUI
> ------------------
>
> Key: HDFS-1536
> URL: https://issues.apache.org/jira/browse/HDFS-1536
> Project: Hadoop HDFS
> Issue Type: Improvement
> Affects Versions: 0.23.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.23.0
>
> Attachments: missingBlocksWebUI.patch
>
>
> 1. Make the missing blocks count accurate;
> 2. Make the under replicated blocks count excluding missing blocks.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-1536) Improve HDFS WebUI
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979840#action_12979840 ]
Hairong Kuang commented on HDFS-1536:
-------------------------------------
[exec] +1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 3 new or modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
[exec]
[exec] +1 release audit. The applied patch does not increase the total number of release au
[exec] dit warnings.
[exec]
[exec] +1 system test framework. The patch passed system test framework compile.
Failed unit tests are TestHDFSServrPorts, TestHDFSTrash, TestBackupNode, TestStorageRestore, and TestDFSRollback.
> Improve HDFS WebUI
> ------------------
>
> Key: HDFS-1536
> URL: https://issues.apache.org/jira/browse/HDFS-1536
> Project: Hadoop HDFS
> Issue Type: Improvement
> Affects Versions: 0.23.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.23.0
>
> Attachments: missingBlocksWebUI.patch, missingBlocksWebUI1.patch
>
>
> 1. Make the missing blocks count accurate;
> 2. Make the under replicated blocks count excluding missing blocks.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-1536) Improve HDFS WebUI
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hairong Kuang updated HDFS-1536:
--------------------------------
Resolution: Fixed
Release Note: On web UI, missing block number now becomes accurate and under-replicated blocks do not include missing blocks.
Status: Resolved (was: Patch Available)
I've just committed this. Thank Dhruba and Nigel for reviewing this!
> Improve HDFS WebUI
> ------------------
>
> Key: HDFS-1536
> URL: https://issues.apache.org/jira/browse/HDFS-1536
> Project: Hadoop HDFS
> Issue Type: Improvement
> Affects Versions: 0.23.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.23.0
>
> Attachments: missingBlocksWebUI.patch, missingBlocksWebUI1.patch
>
>
> 1. Make the missing blocks count accurate;
> 2. Make the under replicated blocks count excluding missing blocks.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-1536) Improve HDFS WebUI
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hairong Kuang updated HDFS-1536:
--------------------------------
Attachment: missingBlocksWebUI.patch
The patch adds a separate queue in neededReplication for replicas that has only zero replica. The missing block count is set to be the size of this queue, while the under-replication blocks count is equal to the number of the rest of under-replicated blocks.
> Improve HDFS WebUI
> ------------------
>
> Key: HDFS-1536
> URL: https://issues.apache.org/jira/browse/HDFS-1536
> Project: Hadoop HDFS
> Issue Type: Improvement
> Affects Versions: 0.23.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.23.0
>
> Attachments: missingBlocksWebUI.patch
>
>
> 1. Make the missing blocks count accurate;
> 2. Make the under replicated blocks count excluding missing blocks.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-1536) Improve HDFS WebUI
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12977557#action_12977557 ]
dhruba borthakur commented on HDFS-1536:
----------------------------------------
+1
> Improve HDFS WebUI
> ------------------
>
> Key: HDFS-1536
> URL: https://issues.apache.org/jira/browse/HDFS-1536
> Project: Hadoop HDFS
> Issue Type: Improvement
> Affects Versions: 0.23.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.23.0
>
> Attachments: missingBlocksWebUI.patch, missingBlocksWebUI1.patch
>
>
> 1. Make the missing blocks count accurate;
> 2. Make the under replicated blocks count excluding missing blocks.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-1536) Improve HDFS WebUI
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hairong Kuang updated HDFS-1536:
--------------------------------
Attachment: missingBlocksWebUI1.patch
MissingBlocksWebUI1.patch addressed Nigel's comments.
> Improve HDFS WebUI
> ------------------
>
> Key: HDFS-1536
> URL: https://issues.apache.org/jira/browse/HDFS-1536
> Project: Hadoop HDFS
> Issue Type: Improvement
> Affects Versions: 0.23.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.23.0
>
> Attachments: missingBlocksWebUI.patch, missingBlocksWebUI1.patch
>
>
> 1. Make the missing blocks count accurate;
> 2. Make the under replicated blocks count excluding missing blocks.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-1536) Improve HDFS WebUI
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hairong Kuang updated HDFS-1536:
--------------------------------
Status: Patch Available (was: Open)
> Improve HDFS WebUI
> ------------------
>
> Key: HDFS-1536
> URL: https://issues.apache.org/jira/browse/HDFS-1536
> Project: Hadoop HDFS
> Issue Type: Improvement
> Affects Versions: 0.23.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.23.0
>
> Attachments: missingBlocksWebUI.patch, missingBlocksWebUI1.patch
>
>
> 1. Make the missing blocks count accurate;
> 2. Make the under replicated blocks count excluding missing blocks.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] [Commented] (HDFS-1536) Improve HDFS WebUI
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022467#comment-13022467 ]
Hudson commented on HDFS-1536:
------------------------------
Integrated in Hadoop-Hdfs-trunk #643 (See [https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk/643/])
> Improve HDFS WebUI
> ------------------
>
> Key: HDFS-1536
> URL: https://issues.apache.org/jira/browse/HDFS-1536
> Project: Hadoop HDFS
> Issue Type: Improvement
> Affects Versions: 0.23.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.23.0
>
> Attachments: missingBlocksWebUI.patch, missingBlocksWebUI1.patch
>
>
> 1. Make the missing blocks count accurate;
> 2. Make the under replicated blocks count excluding missing blocks.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira