You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "JiangHua Zhu (Jira)" <ji...@apache.org> on 2022/01/06 07:55:00 UTC

[jira] [Assigned] (HDFS-16414) Improve asynchronous edit: reduce the time that edit waits to enter editPendingQ

     [ https://issues.apache.org/jira/browse/HDFS-16414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

JiangHua Zhu reassigned HDFS-16414:
-----------------------------------

    Assignee: JiangHua Zhu

> Improve asynchronous edit: reduce the time that edit waits to enter editPendingQ
> --------------------------------------------------------------------------------
>
>                 Key: HDFS-16414
>                 URL: https://issues.apache.org/jira/browse/HDFS-16414
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: fs async, namenode
>    Affects Versions: 2.9.2
>            Reporter: JiangHua Zhu
>            Assignee: JiangHua Zhu
>            Priority: Major
>
> When dfs.namenode.edits.asynclogging=true, FSEditLogAsync starts to work, which is very helpful for improving the speed of NameNode processing Call.
> But there is a strange phenomenon here. When a lot of calls enter the NameNode through RPC within a period of time, the handler will be forced to wait, in seconds:
> FSEditLogAsync#enqueueEdit():
> if (Thread.holdsLock(this)) {
>            int permits = overflowMutex.drainPermits();
>            try {
>              do {
>                this.wait(1000); // will be notified by next logSync.
>              } while (!editPendingQ.offer(edit));
>            } finally {
>              overflowMutex.release(permits);
>            }
>          }
> We should reduce this.wait(1000) here so that edit can be processed quickly.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org