You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Inigo Goiri (JIRA)" <ji...@apache.org> on 2016/03/06 23:04:40 UTC
[jira] [Resolved] (HDFS-9910) Datanode heartbeats can get blocked
by disk in FsDatasetImpl#checkBlock()
[ https://issues.apache.org/jira/browse/HDFS-9910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Inigo Goiri resolved HDFS-9910.
-------------------------------
Resolution: Duplicate
> Datanode heartbeats can get blocked by disk in FsDatasetImpl#checkBlock()
> -------------------------------------------------------------------------
>
> Key: HDFS-9910
> URL: https://issues.apache.org/jira/browse/HDFS-9910
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: datanode
> Affects Versions: 2.7.2
> Reporter: Inigo Goiri
> Assignee: Hua Liu
>
> When a data node needs to transfer a block, it validates the block in the heartbeat thread invoking the {{checkBlock()}} method of {{FsDatasetImpl}}, where it checks whether the block exists and gets the block length. If the block is valid, it then spins off a thread to do the actual block transfer. We found that during heavy disk IO the heartbeat thread hangs on {{replicaInfo.getBlockFile().exists()}} for more than 10 minutes.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)