You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "Daryn Sharp (JIRA)" <ji...@apache.org> on 2017/10/12 14:35:00 UTC

[jira] [Created] (HDFS-12647) DN commands processing should be async

Daryn Sharp created HDFS-12647:
----------------------------------

             Summary: DN commands processing should be async
                 Key: HDFS-12647
                 URL: https://issues.apache.org/jira/browse/HDFS-12647
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: datanode
    Affects Versions: 2.8.0
            Reporter: Daryn Sharp


Due to dataset lock contention, service actors may encounter significant latency while processing  DN commands.  Even the queuing of async deletions require multiple lock acquisitions.  A slow disk will cause a backlog of xceivers instantiating block sender/receivers which starves the actor and leads to the NN falsely declaring the node dead.

Async processing of all commands will free the actor to perform its primary purpose of heartbeating and block reporting.  Note that FBRs will be dependent on queued block invalidations not being included in the report.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org