You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iggy.apache.org by "mmodzelewski (via GitHub)" <gi...@apache.org> on 2025/11/28 11:52:10 UTC
[I] Add Retry Mechanism to Connectors HTTP Config Provider [iggy]
mmodzelewski opened a new issue, #2416:
URL: https://github.com/apache/iggy/issues/2416
Currently, HTTP requests to the configuration server can fail due to transient network issues, temporary server unavailability, or rate limiting. The requests fail immediately without retry, reducing reliability.
## Proposed Solution
Implement exponential backoff retry logic for HTTP requests in the connectors' config provider. The retry mechanism could be configurable. Below is the example of how the configuration could look, but any other ideas can be discussed.
```toml
[connectors]
config_type = "http"
base_url = "http://api.example.com"
[connectors.retry]
enabled = true
max_attempts = 3
initial_backoff = "1 s"
max_backoff = "30 s"
backoff_multiplier = 2.0
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add Retry Mechanism to Connectors HTTP Config Provider [iggy]
Posted by "spetz (via GitHub)" <gi...@apache.org>.
spetz commented on issue #2416:
URL: https://github.com/apache/iggy/issues/2416#issuecomment-3589081459
@hubcio https://github.com/TrueLayer/reqwest-middleware is usually good enough.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add Retry Mechanism to Connectors HTTP Config Provider [iggy]
Posted by "mmodzelewski (via GitHub)" <gi...@apache.org>.
mmodzelewski commented on issue #2416:
URL: https://github.com/apache/iggy/issues/2416#issuecomment-3596000724
@tungtose sure, assigned :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add Retry Mechanism to Connectors HTTP Config Provider [iggy]
Posted by "spetz (via GitHub)" <gi...@apache.org>.
spetz closed issue #2416: Add Retry Mechanism to Connectors HTTP Config Provider
URL: https://github.com/apache/iggy/issues/2416
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add Retry Mechanism to Connectors HTTP Config Provider [iggy]
Posted by "hubcio (via GitHub)" <gi...@apache.org>.
hubcio commented on issue #2416:
URL: https://github.com/apache/iggy/issues/2416#issuecomment-3589057333
Let's make it more strict. Just use some crate, like https://docs.rs/backoff/latest/backoff and expose its settings in config.
@spetz @mmodzelewski what do you think?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add Retry Mechanism to Connectors HTTP Config Provider [iggy]
Posted by "tungtose (via GitHub)" <gi...@apache.org>.
tungtose commented on issue #2416:
URL: https://github.com/apache/iggy/issues/2416#issuecomment-3595918296
@mmodzelewski Could you please assign this to me?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org