You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2021/03/11 08:10:33 UTC
[GitHub] [druid] viatcheslavmogilevsky opened a new pull request #10979: Apache archive mirror
viatcheslavmogilevsky opened a new pull request #10979:
URL: https://github.com/apache/druid/pull/10979
Fixes the issue of builds were failed cause apache.org bandwitch limits
<!-- If you are a committer, follow the PR action item checklist for committers:
https://github.com/apache/druid/blob/master/dev/committer-instructions.md#pr-and-issue-action-item-checklist-for-committers. -->
### Description
There were intermittent downloading issues during massive integration tests outside travis such as:
```
[2021-03-09T21:27:53.027Z] Step 13/53 : RUN curl -s https://archive.apache.org/dist/hadoop/core/hadoop-2.8.5/hadoop-2.8.5.tar.gz | tar -xz -C /usr/local/
[2021-03-09T21:27:53.027Z] ---> Running in e1bebb15f9ac
[2021-03-09T21:27:53.600Z]
[2021-03-09T21:27:53.600Z] gzip: stdin: not in gzip format
[2021-03-09T21:27:53.600Z] tar: Child returned status 1
[2021-03-09T21:27:53.600Z] tar: Error is not recoverable: exiting now
```
or
```
[2021-03-09T22:19:00.605Z] The command '/bin/sh -c /root/base-setup.sh && rm -f /root/base-setup.sh' returned a non-zero code: 8
[2021-03-09T22:19:00.605Z] [ERROR] Command execution failed.
[2021-03-09T22:19:00.605Z] org.apache.commons.exec.ExecuteException: Process exited with an error: 8 (Exit value: 8)
[2021-03-09T22:19:00.605Z] at org.apache.commons.exec.DefaultExecutor.executeInternal (DefaultExecutor.java:404)
[2021-03-09T22:19:00.605Z] at org.apache.commons.exec.DefaultExecutor.execute (DefaultExecutor.java:166)
```
These are because `archive.apache.org` isn't available by bandwitch limits
The solution is to use mirror of this host, such as artifactory generic remote repository which points to https://archive.apache.org/
### Changes:
Added `ARG` instructions to the following dockerfiles `examples/quickstart/tutorial/hadoop/docker/Dockerfile` and `integration-tests/docker/Dockerfile`, changed `integration-tests/docker/base-setup.sh` to support `APACHE_ARCHIVE_MIRROR_HOST` variable and added optional `--build-arg` arguments to `integration-tests/script/docker_build_containers.sh`
Added a tip in documentation: `integration-tests/README.md` about how to override `archive.apache.org`
`archive.apache.org` host is still used by default
### Labels:
`Area - Testing`
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] suneet-s merged pull request #10979: Apache archive mirror
Posted by GitBox <gi...@apache.org>.
suneet-s merged pull request #10979:
URL: https://github.com/apache/druid/pull/10979
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org