You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/06/02 00:35:00 UTC
[jira] [Commented] (HDFS-16899) Fix TestAddOverReplicatedStripedBlocks#testProcessOverReplicatedAndCorruptStripedBlock failed
[ https://issues.apache.org/jira/browse/HDFS-16899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17728522#comment-17728522 ]
ASF GitHub Bot commented on HDFS-16899:
---------------------------------------
haiyang1987 commented on PR #5414:
URL: https://github.com/apache/hadoop/pull/5414#issuecomment-1572960734
hi sir @ZanderXu @Hexiaoqiao @ayushtkn @tomscut please help me review this occasionally trigger failed UT fix when you are available, Thanks.
> Fix TestAddOverReplicatedStripedBlocks#testProcessOverReplicatedAndCorruptStripedBlock failed
> ---------------------------------------------------------------------------------------------
>
> Key: HDFS-16899
> URL: https://issues.apache.org/jira/browse/HDFS-16899
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: Haiyang Hu
> Assignee: Haiyang Hu
> Priority: Major
> Labels: pull-request-available
>
> TestAddOverReplicatedStripedBlocks#testProcessOverReplicatedAndCorruptStripedBlock occasionally appear failed.
> Failed code Line is
> {code:java}
> // verify that all internal blocks exists except b0
> // the redundant internal blocks will not be deleted before the corrupted
> // block gets reconstructed. but since we set
> // DFS_NAMENODE_REPLICATION_MAX_STREAMS_KEY to 0, the reconstruction will
> // not happen
> lbs = cluster.getNameNodeRpc().getBlockLocations(filePath.toString(), 0,
> fileLen);
> bg = (LocatedStripedBlock) (lbs.get(0));
> assertEquals(groupSize + 1, bg.getBlockIndices().length); //here not equals. {code}
> From the perspective of normal logic, the internal blocks that need to be obtained are 10, 8 live and 2 redundant internal blocks,
> but due to the processing logic that occasionally triggers invalidate to remove redundant internal block,
> the final obtained internal blocks value does not meet expectations.
> So need avoid the redundant internal blocks will be deleted.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org