You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Joe McDonnell (Jira)" <ji...@apache.org> on 2025/06/12 19:07:00 UTC
[jira] [Commented] (IMPALA-14129) Native-toolchain's hadoop-client build should not contact Apache servers
[ https://issues.apache.org/jira/browse/IMPALA-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17966293#comment-17966293 ]
Joe McDonnell commented on IMPALA-14129:
----------------------------------------
Merged [https://github.com/cloudera/native-toolchain/commit/a1f257d5b75745670d43af20d254f3f3260e7070] to native-toolchain:
{noformat}
commit a1f257d5b75745670d43af20d254f3f3260e7070
Author: Joe McDonnell <jo...@cloudera.com>
Date: Thu Jun 5 16:42:08 2025 -0700 IMPALA-14129: Patch hadoop-client to disable repository.apache.org
This applies a patch on top of hadoop that disables two
Maven repositories: repository.jboss.org and repository.apache.org
The build does not actually need those repositories. All the
artifacts needed for this build are available from central.
Repeated requests to repository.apache.org are discouraged and
can lead to an IP being banned.
Applying a patch changes some of the directories names, so this
needed further adjustments to handle that.
Testing:
- Ran ARM build and used that to build Impala on ARM
- Verified that the hadoop-client build did not access
repository.apache.org based on the logs
Change-Id: I2a441c1dc2c43e5fdcd467486b50e531daff62eb
Reviewed-on: http://gerrit.cloudera.org:8080/22992
Reviewed-by: Michael Smith <mi...@cloudera.com>
Tested-by: Joe McDonnell <jo...@cloudera.com>
{noformat}
> Native-toolchain's hadoop-client build should not contact Apache servers
> ------------------------------------------------------------------------
>
> Key: IMPALA-14129
> URL: https://issues.apache.org/jira/browse/IMPALA-14129
> Project: IMPALA
> Issue Type: Task
> Components: Infrastructure
> Affects Versions: Impala 5.0.0
> Reporter: Joe McDonnell
> Assignee: Joe McDonnell
> Priority: Major
>
> The hadoop-client build (needed for ARM) does not get all of its dependencies from the central repository. Instead, it has some attempts to download from repository.jboss.org and repository.apache.org:
> {noformat}
> [INFO] Downloading from apache.snapshots.https: https://repository.apache.org/content/repositories/snapshots/org/apache/apache/24/apache-24.pom
> [INFO] Downloading from repository.jboss.org: https://repository.jboss.org/nexus/content/groups/public/org/apache/apache/24/apache-24.pom
> [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/24/apache-24.pom
> [INFO] Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/24/apache-24.pom (20 kB at 140 kB/s){noformat}
> Everything that it needs to download is available in central, so these extra requests don't do anything. We should find a way to avoid contacting repository.apache.org. One option is to apply a patch to hadoop to specifically disable those repositories so that it only uses central.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org