You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-issues@hadoop.apache.org by "tianhang tang (Jira)" <ji...@apache.org> on 2021/02/05 12:35:00 UTC

[jira] [Updated] (HDFS-15822) Client retry mechanism may invalid when use hedgedRead

     [ https://issues.apache.org/jira/browse/HDFS-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

tianhang tang updated HDFS-15822:
---------------------------------
    Attachment: HDFS-15822.001.patch

> Client retry mechanism may invalid when use hedgedRead
> ------------------------------------------------------
>
>                 Key: HDFS-15822
>                 URL: https://issues.apache.org/jira/browse/HDFS-15822
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs-client
>            Reporter: tianhang tang
>            Assignee: tianhang tang
>            Priority: Major
>         Attachments: HDFS-15822.001.patch
>
>
> Hedgedread uses ignoreNodes to ensure that multiple requests fall on different nodes. But the ignoreNodes never been cleared. So if the request of 1st round all failed, and the refetched location is not changed, HDFS client would not request the same nodes which are in the ignoreNodes. It just sleep time by time until reach the retry num, then throw a exception.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org