You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Todd Lipcon (Created) (JIRA)" <ji...@apache.org> on 2012/02/18 01:31:59 UTC
[jira] [Created] (HDFS-2972) HA: small optimization building
incremental block report
HA: small optimization building incremental block report
--------------------------------------------------------
Key: HDFS-2972
URL: https://issues.apache.org/jira/browse/HDFS-2972
Project: Hadoop HDFS
Issue Type: Sub-task
Components: data-node, ha
Affects Versions: HA branch (HDFS-1623)
Reporter: Todd Lipcon
Assignee: Todd Lipcon
Priority: Minor
Current the incremental block report is a List. However, we only really need to send the most recent information for each block. So, if a block becomes RBW and is then becomes FINALIZED before the next incremental block report, we should just report the FINALIZED replica. It's an easy change to just switch to a map by blockid.
This is on the HA branch since HA changes the code to send RBWs in the incremental reports, hence it's more important for maintaining performance parity with trunk.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HDFS-2972) HA: small optimization building
incremental block report
Posted by "Todd Lipcon (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon resolved HDFS-2972.
-------------------------------
Resolution: Fixed
Fix Version/s: HA branch (HDFS-1623)
Hadoop Flags: Reviewed
Committed to branch. I also tested this on a 100-node cluster.
> HA: small optimization building incremental block report
> --------------------------------------------------------
>
> Key: HDFS-2972
> URL: https://issues.apache.org/jira/browse/HDFS-2972
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: data-node, ha
> Affects Versions: HA branch (HDFS-1623)
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Priority: Minor
> Fix For: HA branch (HDFS-1623)
>
> Attachments: hdfs-2972.txt
>
>
> Current the incremental block report is a List. However, we only really need to send the most recent information for each block. So, if a block becomes RBW and is then becomes FINALIZED before the next incremental block report, we should just report the FINALIZED replica. It's an easy change to just switch to a map by blockid.
> This is on the HA branch since HA changes the code to send RBWs in the incremental reports, hence it's more important for maintaining performance parity with trunk.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira