You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "Daryn Sharp (JIRA)" <ji...@apache.org> on 2017/07/14 15:00:00 UTC

[jira] [Created] (HDFS-12140) Remove BPOfferService lock contention to get block pool id

Daryn Sharp created HDFS-12140:
----------------------------------

             Summary: Remove BPOfferService lock contention to get block pool id
                 Key: HDFS-12140
                 URL: https://issues.apache.org/jira/browse/HDFS-12140
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: datanode
    Affects Versions: 2.8.0
            Reporter: Daryn Sharp
            Assignee: Daryn Sharp
            Priority: Critical


The block pool id is protected by a lock in {{BPOfferService}}.  This creates excessive contention especially for xceivers threads attempting to queue IBRs and heartbeat processing.  When the latter is delayed due to excessive FSDataset lock contention, it causes pipelines to collapse.

Accessing the block pool id should be lockless after registration.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org