You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Wei-Chiu Chuang (Jira)" <ji...@apache.org> on 2019/08/20 10:08:00 UTC
[jira] [Assigned] (HDFS-14699) Erasure Coding: Can NOT trigger the
reconstruction when have the dup internal blocks and missing one internal
block
[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wei-Chiu Chuang reassigned HDFS-14699:
--------------------------------------
Assignee: Zhao Yi Ming
> Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block
> -------------------------------------------------------------------------------------------------------------------
>
> Key: HDFS-14699
> URL: https://issues.apache.org/jira/browse/HDFS-14699
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: ec
> Affects Versions: 3.1.1
> Reporter: Zhao Yi Ming
> Assignee: Zhao Yi Ming
> Priority: Critical
>
> We are tried the EC function on 80 node cluster with hadoop 3.1.1, we hit the same scenario as you said. Could we ask when and which version the fix can be merged? Thanks! Following are our testing steps, hope it can helpful.(following DNs have the testing internal blocks)
> # we customized a new 10-2-1024k policy and use it on a path, now we have 12 internal block(12 live block)
> # decommission one DN, after the decommission complete. now we have 13 internal block(12 live block and 1 decommission block)
> # then shutdown one DN which did not have the same block id as 1 decommission block, now we have 12 internal block(11 live block and 1 decommission block)
> # after wait for about 600s (before the heart beat come) commission the decommissioned DN again, now we have 12 internal block(11 live block and 1 duplicate block)
> # Then the EC is not reconstruct the missed block
> We think this is a critical issue for using the EC function in a production env. Could you help? Thanks a lot!
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org