You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "dhruba borthakur (JIRA)" <ji...@apache.org> on 2010/05/12 07:22:41 UTC
[jira] Created: (HDFS-1147) Reduce NN startup time by reducing the
processing time of block reports
Reduce NN startup time by reducing the processing time of block reports
-----------------------------------------------------------------------
Key: HDFS-1147
URL: https://issues.apache.org/jira/browse/HDFS-1147
Project: Hadoop HDFS
Issue Type: Improvement
Components: name-node
Reporter: dhruba borthakur
The NameNode restart times are impacted to a large extent by the processing time of block reports. For a cluster with 150 millions blocks, the block report processing in the NN can take upto 20 minutes or so. The NN is open for business only after it has processed the block reports from most of the datanodes. If we can reduce the processing time of a block report, that will directly reduce the restart time of the NN.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HDFS-1147) Reduce NN startup time by reducing the
processing time of block reports
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur resolved HDFS-1147.
------------------------------------
Resolution: Duplicate
> Reduce NN startup time by reducing the processing time of block reports
> -----------------------------------------------------------------------
>
> Key: HDFS-1147
> URL: https://issues.apache.org/jira/browse/HDFS-1147
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: name-node
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
>
> The NameNode restart times are impacted to a large extent by the processing time of block reports. For a cluster with 150 millions blocks, the block report processing in the NN can take upto 20 minutes or so. The NN is open for business only after it has processed the block reports from most of the datanodes. If we can reduce the processing time of a block report, that will directly reduce the restart time of the NN.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.