You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "Hui Fei (Jira)" <ji...@apache.org> on 2022/08/04 03:08:00 UTC

[jira] [Resolved] (HDFS-16642) [SBN read] Moving selecting inputstream from JN in EditlogTailer out of FSNLock

     [ https://issues.apache.org/jira/browse/HDFS-16642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hui Fei resolved HDFS-16642.
----------------------------
    Fix Version/s: 3.4.0
       Resolution: Fixed

> [SBN read] Moving selecting inputstream from JN in EditlogTailer out of FSNLock
> -------------------------------------------------------------------------------
>
>                 Key: HDFS-16642
>                 URL: https://issues.apache.org/jira/browse/HDFS-16642
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: ZanderXu
>            Assignee: ZanderXu
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 3.4.0
>
>          Time Spent: 1h 50m
>  Remaining Estimate: 0h
>
> EditlogTailer cost a long time for selecting InputStreams from Journalnode while holding the write lock of FSNLock.
> During this period, 8020 handlers of Observer NameNode will be blocked by the FSN Lock.
> In theory, selecting inputstreams from JournalNode does not involve changing memory information in NameNode, so we can move the selecting out of the FSN Lock, and it can improve the throughput of Observer NameNode.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org