[jira] [Updated] (FLINK-39366) [connector-http] Add retry support with exponential backoff for HTTP Sink

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLINK-39366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated FLINK-39366:
-----------------------------------
    Labels: pull-request-available  (was: )

> [connector-http] Add retry support with exponential backoff for HTTP Sink
> -------------------------------------------------------------------------
>
>                 Key: FLINK-39366
>                 URL: https://issues.apache.org/jira/browse/FLINK-39366
>             Project: Flink
>          Issue Type: New Feature
>          Components: Connectors / HTTP
>            Reporter: featzhang
>            Priority: Minor
>              Labels: pull-request-available
>
> h2. Summary
> Add retry support for HTTP Sink connector. When HTTP requests fail due to network errors (IOException), the sink should automatically retry with exponential backoff strategy, improving fault tolerance and reliability in unstable network environments.
> h2. Motivation
> The current HTTP Sink implementation does not retry failed requests. Once a network error occurs, the failed requests are counted in error metrics but not re-submitted, leading to silent data loss. A configurable retry mechanism with exponential backoff is needed to handle transient failures gracefully.
> h2.
> Proposed Changes
>  Add SINKHTTPRETRY_TIMES* constant to HttpConnectorConfigConstants
>  Add RETRY_TIMES* ConfigOption to HttpDynamicSinkConnectorOptions (default: 3)
>  Register RETRY_TIMES* as an optional option in HttpDynamicTableSinkFactory
> * Pass retry configuration via Properties in HttpDynamicSink
> * Implement exponential backoff retry logic in HttpSinkWriter:
> ** Retry only on IOException (network-level errors)
> ** Exponential backoff with initial delay of 1 second (1s → 2s → 4s → ...)
> ** Set retry.times=0 to disable retries
> * Update unit tests to cover retry behavior
> * Update documentation (English and Chinese) with new option description
> h2. New Configuration Option
>   Option Key    Default    Description  
> | sink.http.retry.times | 3 | Number of retry attempts on IOException. Set to 0 to disable. |
> h2. Acceptance Criteria
> HttpSinkWriter retries failed requests up to the configured number of times on IOException.
> Retry interval follows exponential backoff (initial delay 1s, doubles each attempt).
> Setting retry.times=0 disables retry behavior.
> All existing tests pass; new unit tests cover retry scenarios.
> Documentation updated in both English and Chinese.
> h2. Related
> * PR: https://github.com/apache/flink-connector-http/pull/33



--
This message was sent by Atlassian Jira
(v8.20.10#820010)