You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Mukund Thakur (Jira)" <ji...@apache.org> on 2022/06/17 21:03:00 UTC

[jira] [Commented] (HADOOP-18283) Review s3a prefetching input stream retry code

    [ https://issues.apache.org/jira/browse/HADOOP-18283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17555764#comment-17555764 ] 

Mukund Thakur commented on HADOOP-18283:
----------------------------------------

Also move Retryer to invoker.retry() methods.

> Review s3a prefetching input stream retry code
> ----------------------------------------------
>
>                 Key: HADOOP-18283
>                 URL: https://issues.apache.org/jira/browse/HADOOP-18283
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 3.4.0
>            Reporter: Steve Loughran
>            Priority: Major
>
> Need to review S3A prefetching stream retry logic
> * no attempt to retry on unrecoverable errors
> * do try on recoverable ones
> * no wrap of retry by retry.
> * annotate classes with Retries annotations to aid the review.
> a key concern has to be that transient failure of  prefetch is recovered from; things like deleted/shortened file fails properly on the next read call



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org