You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Manika Joshi (Jira)" <ji...@apache.org> on 2024/12/05 05:17:00 UTC

[jira] [Created] (HADOOP-19357) ABFS: Optimizations for Retry Handling and Throttling

Manika Joshi created HADOOP-19357:
-------------------------------------

             Summary: ABFS: Optimizations for Retry Handling and Throttling
                 Key: HADOOP-19357
                 URL: https://issues.apache.org/jira/browse/HADOOP-19357
             Project: Hadoop Common
          Issue Type: Improvement
          Components: fs/azure
    Affects Versions: 3.4.1, 3.4.0
            Reporter: Manika Joshi
            Assignee: Manika Joshi


Given the significant improvements on the service side over the past few years, the current client-side retry mechanism, which enforces 5-6 minutes of sleep time with jitter, is now excessive. Therefore, we are realigning the retry and throttling logic thresholds.

Since the service can now handle higher traffic rates, we aim to enhance driver performance by setting the following configurations as default:
 * {*}Client-side throttling (CST){*}: Off
 * *Client Backoff* - 500ms
 * *Max Backoff* - 500ms
 * *Min Backoff* - 500ms



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org