You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Wei-Chiu Chuang (Jira)" <ji...@apache.org> on 2020/05/04 20:16:00 UTC
[jira] [Commented] (HDFS-15311) [SBN Read] High frequency reQueue
cause Reader's performance to degrade
[ https://issues.apache.org/jira/browse/HDFS-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099321#comment-17099321 ]
Wei-Chiu Chuang commented on HDFS-15311:
----------------------------------------
[~cliang] [~xkrogen] [~shv] thoughts?
> [SBN Read] High frequency reQueue cause Reader's performance to degrade
> -----------------------------------------------------------------------
>
> Key: HDFS-15311
> URL: https://issues.apache.org/jira/browse/HDFS-15311
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: xuzq
> Priority: Major
>
> If _autoMsyncPeriodMs_ is 0, will do _msync_ for each read rpc.
> On the observer server side, it will cause high frequency reQueue in Handler.
> As the Queue is BlockingQueue, so it will cause Readers(small number) and Handlers(large number) competing for BlockingQueue locks.
> It will cause the throughput decrease.
>
> Maybe we can let the handler sleep a little time to wait the StateId to decrease ReQueue.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org