You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2022/01/14 09:07:49 UTC
[GitHub] [iceberg] timothy-khom opened a new issue #3903: Make retry number and backoff policy configurable
timothy-khom opened a new issue #3903:
URL: https://github.com/apache/iceberg/issues/3903
Hi colleagues,
Could the hard-coded value of numRetries at https://github.com/apache/iceberg/blob/0.12.x/core/src/main/java/org/apache/iceberg/BaseMetastoreTableOperations.java#L160 and backoff policy at https://github.com/apache/iceberg/blob/0.12.x/core/src/main/java/org/apache/iceberg/BaseMetastoreTableOperations.java#L175 be specified via configuration somehow? When there is an intermittent network issue or so it is usually enough to retry less times. Otherwise, for instance if there is a stale information in metadata for some reason and the underlying files do not exist this retry mechanism causes overall process to “stuck” for 10 mins unnecessarily retrying the read operation.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] timothy-khom commented on issue #3903: Make retry number and backoff policy configurable
Posted by GitBox <gi...@apache.org>.
timothy-khom commented on issue #3903:
URL: https://github.com/apache/iceberg/issues/3903#issuecomment-1015097098
Hi @szehon-ho,
Thank you for suggestion. However it seems it will be available in 0.13.x won't it ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] szehon-ho commented on issue #3903: Make retry number and backoff policy configurable
Posted by GitBox <gi...@apache.org>.
szehon-ho commented on issue #3903:
URL: https://github.com/apache/iceberg/issues/3903#issuecomment-1016706748
Yea i think in current versions there is no good way I could find, unfortunately.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] szehon-ho commented on issue #3903: Make retry number and backoff policy configurable
Posted by GitBox <gi...@apache.org>.
szehon-ho commented on issue #3903:
URL: https://github.com/apache/iceberg/issues/3903#issuecomment-1013345533
Hi,I think this is solved by https://github.com/apache/iceberg/pull/3099, (you can pass the relevant configs now supported by RetryingHiveMetaStoreClient) can you check?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org