You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "CsengerG (via GitHub)" <gi...@apache.org> on 2024/03/25 20:19:54 UTC
[I] Ci: Throttling causes flakyness in link checker [iceberg]
CsengerG opened a new issue, #10038:
URL: https://github.com/apache/iceberg/issues/10038
### Apache Iceberg version
1.5.0 (latest release)
### Query engine
None
### Please describe the bug 🐞
When you open a new Iceberg PR, the link checker CI step sometimes errors out because of HTTP 429 (Slow down) errors. This was seen in a [recent PR](https://github.com/apache/iceberg/pull/9963), so opening this issue to track.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Ci: Throttling causes flakyness in link checker [iceberg]
Posted by "nk1506 (via GitHub)" <gi...@apache.org>.
nk1506 commented on issue #10038:
URL: https://github.com/apache/iceberg/issues/10038#issuecomment-2021948988
With my patch https://github.com/apache/iceberg/actions/runs/8441938550/job/23122220366?pr=9852
Those errors are related to medium ,
```
ERROR: 10 dead links found!
[✖] https://medium.com/@ajanthabhat/how-not-to-use-apache-iceberg-046ae7e7c884 → Status: 429
[✖] https://medium.com/@ayushtkn/apache-hive-4-x-with-iceberg-branches-tags-3d52293ac0bf/ → Status: 429
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Ci: Throttling causes flakyness in link checker [iceberg]
Posted by "CsengerG (via GitHub)" <gi...@apache.org>.
CsengerG commented on issue #10038:
URL: https://github.com/apache/iceberg/issues/10038#issuecomment-2019838760
I see the link checker failed again. Thinking about how much a retry makes sense on a 429, I am not sure. If we are already getting throttled, it is unlikely we are putting ourselves into a better place by retrying an additional time. I wonder if there is a backoff on this retry or if there is another feature like rate limiting that would work better.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Ci: Throttling causes flakyness in link checker [iceberg]
Posted by "nastra (via GitHub)" <gi...@apache.org>.
nastra closed issue #10038: Ci: Throttling causes flakyness in link checker
URL: https://github.com/apache/iceberg/issues/10038
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Ci: Throttling causes flakyness in link checker [iceberg]
Posted by "manuzhang (via GitHub)" <gi...@apache.org>.
manuzhang commented on issue #10038:
URL: https://github.com/apache/iceberg/issues/10038#issuecomment-2019389582
429 error can be mitigated with config `"retryOn429": true` as per https://github.com/tcort/markdown-link-check?tab=readme-ov-file#config-file-format while there are on such options for other status codes like 503.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Ci: Throttling causes flakyness in link checker [iceberg]
Posted by "manuzhang (via GitHub)" <gi...@apache.org>.
manuzhang commented on issue #10038:
URL: https://github.com/apache/iceberg/issues/10038#issuecomment-2019388084
I'm also seeing 503 error in https://github.com/apache/iceberg/actions/runs/8423700634/job/23065932581?pr=10037
```
[✖] https://medium.com/@ayushtkn/apache-hive-4-x-with-iceberg-branches-tags-3d52293ac0bf/ → Status: 503
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org