You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2025/02/20 12:47:00 UTC
[jira] [Updated] (HDFS-17732) addExpectedReplicasToPending should add EC block expectedStorages in PendingReconstructionBlocks
[ https://issues.apache.org/jira/browse/HDFS-17732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ASF GitHub Bot updated HDFS-17732:
----------------------------------
Labels: pull-request-available (was: )
> addExpectedReplicasToPending should add EC block expectedStorages in PendingReconstructionBlocks
> --------------------------------------------------------------------------------------------------
>
> Key: HDFS-17732
> URL: https://issues.apache.org/jira/browse/HDFS-17732
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: liuguanghua
> Priority: Major
> Labels: pull-request-available
>
> Now when a block is commit , it should add expectedStorages into
> PendingReconstructionBlocks if the ibr is not sent from expected locations. And for ec groups , only blkStriped.getRealTotalBlockNum() == expectedStorages.length will be added into PendingReconstructionBlocks.
>
> But the following situations need to be considered：
> (1)A EC file with XOR-2-1-1024k，when we write lower than 1024k into the file，close it.
> (2)Now The file has only one ec block group, indics=(0,1,2) and suppose only 0 replica ibr is received. Then the block group commit and will be completed.
> (3) When block group commit , blkStriped.getRealTotalBlockNum()=1 expectedStorages.length=3 , so it can not add EC block expectedStorages in PendingReconstructionBlocks
> (4) This will result in the ec group reconstruction
> (5) The 1 and 2 replicas ibr is recived.
> (6) This maybe lead two same block group indics on same datanode if reconstruction choose the same datanode
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org