You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Jing Zhao (JIRA)" <ji...@apache.org> on 2015/02/03 01:34:37 UTC
[jira] [Updated] (HDFS-7728) Avoid updating quota usage while
loading edits
[ https://issues.apache.org/jira/browse/HDFS-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jing Zhao updated HDFS-7728:
----------------------------
Attachment: HDFS-7728.000.patch
The initial patch for review.
The main challenge here is that for an INodeReference instance (along with the subtree underneath) we have to double count its quota usage. Thus the patch defines a QuotaDelta class which contains quota usage updates along all the necessary paths, and pass it to {{INode#cleanSubtree}} and {{INode#destroyAndCollectBlocks}}.
> Avoid updating quota usage while loading edits
> ----------------------------------------------
>
> Key: HDFS-7728
> URL: https://issues.apache.org/jira/browse/HDFS-7728
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: Jing Zhao
> Assignee: Jing Zhao
> Attachments: HDFS-7728.000.patch
>
>
> Per the discussion [here|https://issues.apache.org/jira/browse/HDFS-7611?focusedCommentId=14292454&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14292454], currently we call {{INode#addSpaceConsumed}} while file/dir/snapshot deletion, even if this is still in the edits loading process. This is unnecessary and can cause issue like HDFS-7611. We should collect quota change and call {{FSDirectory#updateCount}} at the end of the operation.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)