You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@drill.apache.org by "James Turton (Jira)" <ji...@apache.org> on 2022/11/02 09:01:00 UTC

[jira] [Closed] (DRILL-8342) Add Automatic Retry for Rate Limited APIs

     [ https://issues.apache.org/jira/browse/DRILL-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

James Turton closed DRILL-8342.
-------------------------------
    Resolution: Fixed

> Add Automatic Retry for Rate Limited APIs
> -----------------------------------------
>
>                 Key: DRILL-8342
>                 URL: https://issues.apache.org/jira/browse/DRILL-8342
>             Project: Apache Drill
>          Issue Type: Improvement
>          Components: Storage - HTTP
>    Affects Versions: 1.20.2
>            Reporter: Charles Givre
>            Assignee: Charles Givre
>            Priority: Major
>             Fix For: 2.0.0
>
>
> Many APIs have a burst limit for number of requests.  This PR adds a retry capability to the HTTP Storage Plugin, whereby if a 429 response code is received, Drill will wait a configurable amount of time, and retry the request once. 
> To prevent runaway pagination, this retry will only happen once per request. 
> This PR adds a new configuration option called retryDelay which is the number of milliseconds that Drill should wait between retrys.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)