You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Anuj Modi (Jira)" <ji...@apache.org> on 2023/06/05 13:57:00 UTC
[jira] [Updated] (HADOOP-18759) [ABFS][Backoff-Optimization] Have a Linear retry policy for connection timeout failures
[ https://issues.apache.org/jira/browse/HADOOP-18759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anuj Modi updated HADOOP-18759:
-------------------------------
Summary: [ABFS][Backoff-Optimization] Have a Linear retry policy for connection timeout failures (was: [ABFS}[Backoff-Optimization] Have a Linear retry policy for connection timeout failures)
> [ABFS][Backoff-Optimization] Have a Linear retry policy for connection timeout failures
> ---------------------------------------------------------------------------------------
>
> Key: HADOOP-18759
> URL: https://issues.apache.org/jira/browse/HADOOP-18759
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Affects Versions: 3.3.4
> Reporter: Anuj Modi
> Assignee: Anuj Modi
> Priority: Major
>
> Today when a request fails with connection timeout, it falls back into the loop for exponential retry. Unlike Azure Storage, there are no guarantees of success on exponentially retried request or recommendations for ideal retry policies for Azure network or any other general failures. Faster failure and retry might be more beneficial for such generic connection timeout failures.
> This PR introduces a new Linear Retry Policy which will currently be used only for Connection Timeout failures.
> Two types of Linear Backoff calculations will be supported:
> # min-backoff starts with 500 ms and with each attempted retry, back-off increments double, capped at 30 sec max
> # min-backoff starts with 500 ms and with each attempted retry, back-off increments by 1 sec, capped at 30 sec max
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org