You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "adoroszlai (via GitHub)" <gi...@apache.org> on 2024/11/14 07:55:33 UTC
[PR] HDDS-11698. Use hadoop image from GitHub in CI [ozone]
adoroszlai opened a new pull request, #7432:
URL: https://github.com/apache/ozone/pull/7432
## What changes were proposed in this pull request?
Starting with Hadoop 3.3.6, Docker image is available from GitHub Container Registry. Use it in CI to reduce intermittent failures like:
```
Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit
```
https://github.com/apache/ozone/actions/runs/11823273130/job/32942963396#step:5:147
and
```
Error response from daemon: Head "https://registry-1.docker.io/v2/apache/hadoop/manifests/3.3.6": Get "https://auth.docker.io/...": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
```
https://github.com/apache/ozone/actions/runs/11823273130/job/32942963396#step:5:147
Acceptance check uses Hadoop image for two purposes:
1. KMS in all secure tests to manage encryption key
- updated to use `$HADOOP_IMAGE`
2. Test compatibility of Ozone FS jars with multiple Hadoop versions
- changed not to redefine `$HADOOP_IMAGE` for each version
- images for older versions of Hadoop are still used from Docker Hub
- `HADOOP_TEST_VERSIONS` (recently added in HDDS-11641) renamed to `HADOOP_TEST_IMAGES` for consistency
https://issues.apache.org/jira/browse/HDDS-11698
## How was this patch tested?
CI:
https://github.com/adoroszlai/ozone/actions/runs/11827932547
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
Re: [PR] HDDS-11698. Use hadoop image from GitHub in CI [ozone]
Posted by "adoroszlai (via GitHub)" <gi...@apache.org>.
adoroszlai commented on PR #7432:
URL: https://github.com/apache/ozone/pull/7432#issuecomment-2481081772
Thanks @smengcl for the review.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
Re: [PR] HDDS-11698. Use hadoop image from GitHub in CI [ozone]
Posted by "adoroszlai (via GitHub)" <gi...@apache.org>.
adoroszlai merged PR #7432:
URL: https://github.com/apache/ozone/pull/7432
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org