You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Hairong Kuang (JIRA)" <ji...@apache.org> on 2010/11/29 22:32:10 UTC
[jira] Created: (HDFS-1520) HDFS 20 append: Lightweight NameNode
operations to trigger lease recovery
HDFS 20 append: Lightweight NameNode operations to trigger lease recovery
-------------------------------------------------------------------------
Key: HDFS-1520
URL: https://issues.apache.org/jira/browse/HDFS-1520
Project: Hadoop HDFS
Issue Type: New Feature
Affects Versions: 0.20-append
Reporter: Hairong Kuang
Assignee: Hairong Kuang
Fix For: 0.20-append
Currently HBase uses append to trigger the close of HLog during Hlog split. Append is a very expensive operation, which involves not only NameNode operations but creating a writing pipeline. If one of datanodes on the pipeline has a problem, this recovery may takes minutes. I'd like implement a lightweight NameNode operation to trigger lease recovery and make HBase to use this instead.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HDFS-1520) HDFS 20 append: Lightweight NameNode
operation to trigger lease recovery
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur resolved HDFS-1520.
------------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
I just committed this. Thanks Hairong!
> HDFS 20 append: Lightweight NameNode operation to trigger lease recovery
> ------------------------------------------------------------------------
>
> Key: HDFS-1520
> URL: https://issues.apache.org/jira/browse/HDFS-1520
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 0.20-append
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.20-append
>
> Attachments: recoverLeaseApache20.patch
>
>
> Currently HBase uses append to trigger the close of HLog during Hlog split. Append is a very expensive operation, which involves not only NameNode operations but creating a writing pipeline. If one of datanodes on the pipeline has a problem, this recovery may takes minutes. I'd like implement a lightweight NameNode operation to trigger lease recovery and make HBase to use this instead.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.