You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-issues@hadoop.apache.org by "ZanderXu (Jira)" <ji...@apache.org> on 2022/06/24 07:30:00 UTC

[jira] [Created] (HDFS-16642) [HDFS] Moving selecting inputstream from JN in EditlogTailer out of FSNLock

ZanderXu created HDFS-16642:
-------------------------------

             Summary: [HDFS] Moving selecting inputstream from JN in EditlogTailer out of FSNLock
                 Key: HDFS-16642
                 URL: https://issues.apache.org/jira/browse/HDFS-16642
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: ZanderXu
            Assignee: ZanderXu


EditlogTailer cost a long time for selecting InputStreams from Journalnode while holding the write lock of FSNLock.
During this period, 8020 handlers of Observer NameNode will be blocked by the FSN Lock.

In theory, selecting inputstreams from JournalNode does not involve changing memory information in NameNode, so we can move the selecting out of the FSN Lock, and it can improve the throughput of Observer NameNode.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org