[jira] [Updated] (HADOOP-18501) [ABFS]: Partial Read should add to throttling metric

["Pranav Saxena (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HADOOP-18501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Pranav Saxena updated HADOOP-18501:
-----------------------------------
    Description: 
Error Description:
For partial read (due to account backend throttling), the ABFS driver doesn't retry and doesn't add up in the throttling metrics.

Mitigation:
Abfs Driver should retry for the remaining bytes. Also, it should be added in throttling metrics.

  was:
Error Description:
At present, SAS Tokens generated from the Azure Portal may or may not contain a ? as a prefix. SAS Tokens that contain the ? prefix will lead to an error in the driver due to a clash of query parameters. This leads to customers having to manually remove the ? prefix before passing the SAS Tokens.

Mitigation:
After receiving the SAS Token from the provider, check if any prefix ? is present or not. If present, remove it and pass the SAS Token.


> [ABFS]: Partial Read should add to throttling metric
> ----------------------------------------------------
>
>                 Key: HADOOP-18501
>                 URL: https://issues.apache.org/jira/browse/HADOOP-18501
>             Project: Hadoop Common
>          Issue Type: Bug
>            Reporter: Pranav Saxena
>            Assignee: Pranav Saxena
>            Priority: Minor
>
> Error Description:
> For partial read (due to account backend throttling), the ABFS driver doesn't retry and doesn't add up in the throttling metrics.
> Mitigation:
> Abfs Driver should retry for the remaining bytes. Also, it should be added in throttling metrics.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org