You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "arthurgaubil (via GitHub)" <gi...@apache.org> on 2026/09/16 14:27:45 UTC
[PR] [ADPS-1364][iceberg] Retry transient REST DNS failures [paimon]
arthurgaubil opened a new pull request, #9903:
URL: https://github.com/apache/paimon/pull/9903
### Purpose
Retry Iceberg REST catalog DNS lookup failures with configurable exponential backoff. Five retries with a one-second initial delay are used by default; setting `metadata.iceberg.unknown-host-retry.max-retries` to `0` preserves immediate failure. Exhausted retries still propagate so publication cleanup and durable recovery remain safe.
Motivation: https://datadoghq.atlassian.net/browse/ADPS-1364
### Tests
`mvn -o -Ppaimon-iceberg,fast-build -pl paimon-iceberg -DwildcardSuites=none -Dtest=IcebergRestMetadataCommitterTest test`
All 30 tests passed, including transient recovery, exponential delay, disabled retries, exhaustion, and non-DNS failures. Generated configuration documentation was refreshed with `mvn -o package -Pgenerate-docs -pl paimon-docs -DskipTests`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [iceberg] Retry transient REST DNS failures [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi merged PR #9903:
URL: https://github.com/apache/paimon/pull/9903
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [iceberg] Retry transient REST DNS failures [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on PR #9903:
URL: https://github.com/apache/paimon/pull/9903#issuecomment-5708351533
Retrying a transient DNS failure on the commit path is reasonable, and the cause-chain walk correctly handles wrapped exceptions.
One note for the record: with the defaults (max-retries 5, initial delay 1 s, doubling), a genuinely dead host pins the commit thread for ~31 s (1+2+4+8+16) before failing. That is a reasonable trade-off and both knobs are configurable, but worth spelling out in the option docs so commit latency is not surprising. Also, this intentionally only covers `UnknownHostException` and not other transient connection errors — fine as a narrow scope, just worth documenting.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org