You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "ZhangHB (Jira)" <ji...@apache.org> on 2023/01/29 13:12:00 UTC

[jira] [Created] (HDFS-16898) Make write lock fine-grain in processCommandFromActor method

ZhangHB created HDFS-16898:
------------------------------

             Summary: Make write lock fine-grain in processCommandFromActor method
                 Key: HDFS-16898
                 URL: https://issues.apache.org/jira/browse/HDFS-16898
             Project: Hadoop HDFS
          Issue Type: Improvement
    Affects Versions: 3.3.4
            Reporter: ZhangHB


Now in method processCommandFromActor,  we have code like below:

 
{code:java}
writeLock();
try {
  if (actor == bpServiceToActive) {
    return processCommandFromActive(cmd, actor);
  } else {
    return processCommandFromStandby(cmd, actor);
  }
} finally {
  writeUnlock();
} {code}
if method processCommandFromActive costs much time, the write lock would not release.

 

It maybe block the updateActorStatesFromHeartbeat method in offerService,furthermore, it can cause the lastcontact of datanode very high, even dead when lastcontact beyond 600s.
{code:java}
bpos.updateActorStatesFromHeartbeat(
    this, resp.getNameNodeHaState());{code}
here we can make write lock fine-grain in processCommandFromActor method to address this problem

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org