You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hop.apache.org by Phillip Brown <ph...@gmail.com> on 2023/10/01 22:50:25 UTC
problem building Hop 2.6
Hi
I am trying to build Hop 2.6, and running into issues with maven and proxy.
Caveat - I am not a developer per se, more of an infrastructure person,
so I don't use the tools on a regular basis, but I know my way around
My set up
I have a Virtualbox VM running Oracle Enterprise Linux 9. All my VM's
use 'host only' networking, so I have another VM as a gateway with a
bridge to the host adapter, which runs tinyproxy. This set up works
works for everything, including most of the build process
[apache@apchop01 ~]$ mvn -version
Apache Maven 3.6.3 (Red Hat 3.6.3-15)
Maven home: /usr/share/maven
Java version: 11.0.20, vendor: Red Hat, Inc., runtime:
/usr/lib/jvm/java-11-openjdk-11.0.20.0.8-2.0.1.el9.x86_64
Default locale: en_AU, platform encoding: UTF-8
OS name: "linux", version: "5.15.0-105.125.6.2.2.el9uek.x86_64", arch:
"amd64", family: "unix"
[apache@apchop01 ~]$ cat .m2/settings.xml
<settings>
<proxies>
<proxy>
<id>example-proxy</id>
<active>true</active>
<protocol>http</protocol>
<host>util.example.com</host>
<port>8888</port>
<nonProxyHosts>*.example.com</nonProxyHosts>
</proxy>
</proxies>
</settings>
relevant part of the build output - as you can see it can download stuff
from https://repo1.maven.org just fine until it gets to:
[INFO] -------------------<
org.apache.hop:hop-engine-beam>-------------------
[INFO] Building hop-engine-beam 2.6.0
[4/559]
[INFO] --------------------------------[ jar
]---------------------------------
Downloading from apache.snapshots:
https://repository.apache.org/snapshots/io/grpc/grpc-api/maven-metadata.xml
Downloading from central:
https://repo1.maven.org/maven2/io/grpc/grpc-api/maven-metadata.xml
Downloaded from central:
https://repo1.maven.org/maven2/io/grpc/grpc-api/maven-metadata.xml (3.4
kB at 2.0 kB/s)
Downloading from central:
https://repo1.maven.org/maven2/io/grpc/grpc-core/maven-metadata.xml
Downloading from apache.snapshots:
https://repository.apache.org/snapshots/io/grpc/grpc-core/maven-metadata.xml
Downloaded from central:
https://repo1.maven.org/maven2/io/grpc/grpc-core/maven-metadata.xml (5.0
kB at 12 kB/s)
Downloading from central:
https://repo1.maven.org/maven2/io/grpc/grpc-netty-shaded/maven-metadata.xml
Downloading from apache.snapshots:
https://repository.apache.org/snapshots/io/grpc/grpc-netty-shaded/maven-metadata.xml
Downloaded from central:
https://repo1.maven.org/maven2/io/grpc/grpc-netty-shaded/maven-metadata.xml
(4.0 kB at 11 kB/s)
[INFO]
[INFO] --- maven-clean-plugin:3.1.0:clean(default-clean)@ hop-engine-beam---
[INFO] Deleting /home/apache/source/apache-hop-2.6.0/engine-beam/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.4.1:enforce(enforce-maven-version)@
hop-engine-beam---
[INFO]
[INFO] ---
build-helper-maven-plugin:3.0.0:parse-version(set-doc-version-property)@
hop-engine-beam---
[INFO]
[INFO] ---
build-helper-maven-plugin:3.0.0:rootlocation(set-root-dir-property)@
hop-engine-beam---
[INFO]
[INFO] --- jacoco-maven-plugin:0.8.7:prepare-agent(coverage-initialize)@
hop-engine-beam---
[INFO] argLine set to
-javaagent:/home/apache/.m2/repository/org/jacoco/org.jacoco.agent/0.8.7/org.jacoco.agent-0.8.7-runtime.jar=destfile=/h
ome/apache/source/apache-hop-2.6.0/engine-beam/target/jacoco.exec,excludes=**/*Dialog*
[INFO]
[INFO] ---
maven-remote-resources-plugin:1.7.0:process(process-resource-bundles)@
hop-engine-beam---
[INFO] Preparing remote bundle org.apache:apache-jar-resource-bundle:1.4
[INFO] Copying 3 resources from 1 bundle.
[INFO] artifact io.grpc:grpc-api: checking for updates from central
[INFO] I/O exception (java.net.SocketException) caught when processing
request to {s}->https://repo1.maven.org:443: Network is unreachable
(connect failed)
[INFO] Retrying request to {s}->https://repo1.maven.org:443
[INFO] I/O exception (java.net.SocketException) caught when processing
request to {s}->https://repo1.maven.org:443: Network is unreachable
(connect failed)
[INFO] Retrying request to {s}->https://repo1.maven.org:443
[INFO] I/O exception (java.net.SocketException) caught when processing
request to {s}->https://repo1.maven.org:443: Network is unreachable
(connect failed)
[INFO] Retrying request to {s}->https://repo1.maven.org:443
[WARNING] repository metadata for: 'artifact io.grpc:grpc-api' could not
be retrieved from repository: central due to an error: transfer failed
for https://repo1.maven.org/maven2/io/grpc/grpc-api/maven-metadata.xml,
proxy: ProxyInfo{host='util.example.com', userName='null', port=8888,
type='http', nonProxyHosts='null'}
For the life of me I cannot see why it would fail here, so hoping
someone has seen something like this, or can point me in the right
direction. About the only thing that stands out is mvn reports
"nonProxyHosts='null'" when my settings.xml has
"<nonProxyHosts>*.example.com</nonProxyHosts>"
Thanks in anticipation
Phil Brown.
Re: problem building Hop 2.6
Posted by Phillip Brown <ph...@gmail.com>.
So, it turns out I needed to set MAVEN_OPTS as well
export MAVEN_OPTS="-Dhttp.proxyHost=util.example.com
-Dhttp.proxyPort=8889 -Dhttps.proxyHost=util.example
.com -Dhttps.proxyPort=8888"
and it now works
Sorry for the disturbance
pjb.
On 2/10/23 09:50, Phillip Brown wrote:
>
> Hi
>
> I am trying to build Hop 2.6, and running into issues with maven and
> proxy.
>
> Caveat - I am not a developer per se, more of an infrastructure
> person, so I don't use the tools on a regular basis, but I know my way
> around
>
> My set up
>
> I have a Virtualbox VM running Oracle Enterprise Linux 9. All my VM's
> use 'host only' networking, so I have another VM as a gateway with a
> bridge to the host adapter, which runs tinyproxy. This set up works
> works for everything, including most of the build process
>
> [apache@apchop01 ~]$ mvn -version
> Apache Maven 3.6.3 (Red Hat 3.6.3-15)
> Maven home: /usr/share/maven
> Java version: 11.0.20, vendor: Red Hat, Inc., runtime:
> /usr/lib/jvm/java-11-openjdk-11.0.20.0.8-2.0.1.el9.x86_64
> Default locale: en_AU, platform encoding: UTF-8
> OS name: "linux", version: "5.15.0-105.125.6.2.2.el9uek.x86_64", arch:
> "amd64", family: "unix"
>
> [apache@apchop01 ~]$ cat .m2/settings.xml
> <settings>
> <proxies>
> <proxy>
> <id>example-proxy</id>
> <active>true</active>
> <protocol>http</protocol>
> <host>util.example.com</host>
> <port>8888</port>
> <nonProxyHosts>*.example.com</nonProxyHosts>
> </proxy>
> </proxies>
> </settings>
>
> relevant part of the build output - as you can see it can download
> stuff from https://repo1.maven.org just fine until it gets to:
>
> [INFO] -------------------<
> org.apache.hop:hop-engine-beam>-------------------
> [INFO] Building hop-engine-beam 2.6.0
> [4/559]
> [INFO] --------------------------------[ jar
> ]---------------------------------
> Downloading from apache.snapshots:
> https://repository.apache.org/snapshots/io/grpc/grpc-api/maven-metadata.xml
> Downloading from central:
> https://repo1.maven.org/maven2/io/grpc/grpc-api/maven-metadata.xml
> Downloaded from central:
> https://repo1.maven.org/maven2/io/grpc/grpc-api/maven-metadata.xml
> (3.4 kB at 2.0 kB/s)
> Downloading from central:
> https://repo1.maven.org/maven2/io/grpc/grpc-core/maven-metadata.xml
> Downloading from apache.snapshots:
> https://repository.apache.org/snapshots/io/grpc/grpc-core/maven-metadata.xml
> Downloaded from central:
> https://repo1.maven.org/maven2/io/grpc/grpc-core/maven-metadata.xml
> (5.0 kB at 12 kB/s)
> Downloading from central:
> https://repo1.maven.org/maven2/io/grpc/grpc-netty-shaded/maven-metadata.xml
> Downloading from apache.snapshots:
> https://repository.apache.org/snapshots/io/grpc/grpc-netty-shaded/maven-metadata.xml
> Downloaded from central:
> https://repo1.maven.org/maven2/io/grpc/grpc-netty-shaded/maven-metadata.xml
> (4.0 kB at 11 kB/s)
> [INFO]
> [INFO] --- maven-clean-plugin:3.1.0:clean(default-clean)@
> hop-engine-beam---
> [INFO] Deleting /home/apache/source/apache-hop-2.6.0/engine-beam/target
> [INFO]
> [INFO] --- maven-enforcer-plugin:1.4.1:enforce(enforce-maven-version)@
> hop-engine-beam---
> [INFO]
> [INFO] ---
> build-helper-maven-plugin:3.0.0:parse-version(set-doc-version-property)@
> hop-engine-beam---
> [INFO]
> [INFO] ---
> build-helper-maven-plugin:3.0.0:rootlocation(set-root-dir-property)@
> hop-engine-beam---
> [INFO]
> [INFO] ---
> jacoco-maven-plugin:0.8.7:prepare-agent(coverage-initialize)@
> hop-engine-beam---
> [INFO] argLine set to
> -javaagent:/home/apache/.m2/repository/org/jacoco/org.jacoco.agent/0.8.7/org.jacoco.agent-0.8.7-runtime.jar=destfile=/h
> ome/apache/source/apache-hop-2.6.0/engine-beam/target/jacoco.exec,excludes=**/*Dialog*
>
> [INFO]
> [INFO] ---
> maven-remote-resources-plugin:1.7.0:process(process-resource-bundles)@
> hop-engine-beam---
> [INFO] Preparing remote bundle org.apache:apache-jar-resource-bundle:1.4
> [INFO] Copying 3 resources from 1 bundle.
> [INFO] artifact io.grpc:grpc-api: checking for updates from central
> [INFO] I/O exception (java.net.SocketException) caught when processing
> request to {s}->https://repo1.maven.org:443: Network is unreachable
> (connect failed)
> [INFO] Retrying request to {s}->https://repo1.maven.org:443
> [INFO] I/O exception (java.net.SocketException) caught when processing
> request to {s}->https://repo1.maven.org:443: Network is unreachable
> (connect failed)
> [INFO] Retrying request to {s}->https://repo1.maven.org:443
> [INFO] I/O exception (java.net.SocketException) caught when processing
> request to {s}->https://repo1.maven.org:443: Network is unreachable
> (connect failed)
> [INFO] Retrying request to {s}->https://repo1.maven.org:443
> [WARNING] repository metadata for: 'artifact io.grpc:grpc-api' could
> not be retrieved from repository: central due to an error: transfer
> failed for
> https://repo1.maven.org/maven2/io/grpc/grpc-api/maven-metadata.xml,
> proxy: ProxyInfo{host='util.example.com', userName='null', port=8888,
> type='http', nonProxyHosts='null'}
>
> For the life of me I cannot see why it would fail here, so hoping
> someone has seen something like this, or can point me in the right
> direction. About the only thing that stands out is mvn reports
> "nonProxyHosts='null'" when my settings.xml has
> "<nonProxyHosts>*.example.com</nonProxyHosts>"
>
>
> Thanks in anticipation
>
> Phil Brown.
>