You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Wei-Chiu Chuang (Jira)" <ji...@apache.org> on 2020/05/04 20:16:00 UTC

[jira] [Commented] (HDFS-15311) [SBN Read] High frequency reQueue cause Reader's performance to degrade

    [ https://issues.apache.org/jira/browse/HDFS-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099321#comment-17099321 ] 

Wei-Chiu Chuang commented on HDFS-15311:
----------------------------------------

[~cliang] [~xkrogen] [~shv] thoughts?

> [SBN Read] High frequency reQueue cause Reader's performance to degrade
> -----------------------------------------------------------------------
>
>                 Key: HDFS-15311
>                 URL: https://issues.apache.org/jira/browse/HDFS-15311
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: xuzq
>            Priority: Major
>
> If _autoMsyncPeriodMs_ is 0, will do _msync_ for each read rpc.
> On the observer server side, it will cause high frequency reQueue in Handler.
> As the Queue is BlockingQueue, so it will cause Readers(small number)  and Handlers(large number) competing for BlockingQueue locks.
> It will cause the throughput decrease.
>  
> Maybe we can let the handler sleep a little time to wait the StateId to decrease ReQueue.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org