You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "JiangHua Zhu (Jira)" <ji...@apache.org> on 2022/01/06 07:55:00 UTC
[jira] [Assigned] (HDFS-16414) Improve asynchronous edit: reduce the time that edit waits to enter editPendingQ
[ https://issues.apache.org/jira/browse/HDFS-16414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
JiangHua Zhu reassigned HDFS-16414:
-----------------------------------
Assignee: JiangHua Zhu
> Improve asynchronous edit: reduce the time that edit waits to enter editPendingQ
> --------------------------------------------------------------------------------
>
> Key: HDFS-16414
> URL: https://issues.apache.org/jira/browse/HDFS-16414
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: fs async, namenode
> Affects Versions: 2.9.2
> Reporter: JiangHua Zhu
> Assignee: JiangHua Zhu
> Priority: Major
>
> When dfs.namenode.edits.asynclogging=true, FSEditLogAsync starts to work, which is very helpful for improving the speed of NameNode processing Call.
> But there is a strange phenomenon here. When a lot of calls enter the NameNode through RPC within a period of time, the handler will be forced to wait, in seconds:
> FSEditLogAsync#enqueueEdit():
> if (Thread.holdsLock(this)) {
> int permits = overflowMutex.drainPermits();
> try {
> do {
> this.wait(1000); // will be notified by next logSync.
> } while (!editPendingQ.offer(edit));
> } finally {
> overflowMutex.release(permits);
> }
> }
> We should reduce this.wait(1000) here so that edit can be processed quickly.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org