[jira] [Updated] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

["Mingliang Liu (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mingliang Liu updated HDFS-10810:
---------------------------------
    Attachment: HDFS-10810-003.patch

Hi, [~brahmareddy], I can understand that the block is removed from {{neededReconstruction}}, but I don't see why the block is counted as corrupt. I slightly simplified the unit test (correct me if I'm wrong) which mainly checks the missing block count first, but it did not fail the assertion without this patch. Also I think it's not tightly connected with batch IBR without which the IBR may still get delayed.

The basic idea of counting pending replicas when updating the neededReconstructions makes sense to me. We need 2nd opinion here. Ping  [~szetszwo]. Thanks.

>  Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.
> --------------------------------------------------------------------------------------------
>
>                 Key: HDFS-10810
>                 URL: https://issues.apache.org/jira/browse/HDFS-10810
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Brahma Reddy Battula
>            Assignee: Brahma Reddy Battula
>         Attachments: HDFS-10810-002.patch, HDFS-10810-003.patch, HDFS-10810.patch
>
>
> 1)Batch IBR is enabled with number of committed blocks allowed=1
> 2) Written one block and closed the file without waiting for IBR
> 3)Setreplication called immediately on the file. 
> SO till the finalized IBR Received, this block will be marked as corrupt.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org