You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/09/20 11:16:59 UTC
[GitHub] [hudi] pratyakshsharma opened a new issue, #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
pratyakshsharma opened a new issue, #6724:
URL: https://github.com/apache/hudi/issues/6724
**_Tips before filing an issue_**
- Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? yes
- Join the mailing list to engage in conversations and get faster support at dev-subscribe@hudi.apache.org.
- If you have triaged this as a bug, then file an [issue](https://issues.apache.org/jira/projects/HUDI/issues) directly.
**Describe the problem you faced**
Tried building the latest master using the command `mvn clean install -DskipTests`. It fails with the below error -
[ERROR] Failed to execute goal com.github.os72:protoc-jar-maven-plugin:3.11.4:run (proto-compile) on project hudi-utilities_2.11: Error extracting protoc for version 3.21.5: Unsupported platform: protoc-3.21.5-osx-x86_64.exe -> [Help 1]
**To Reproduce**
Steps to reproduce the behavior:
1. Use M1 mac
2. Try building the project using `mvn clean install -DskipTests`
**Expected behavior**
Build should finish successfully.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] slachiewicz commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
slachiewicz commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1253839339
Yours output looks truncated - maybe yours proxy blocks downloading .zip .exe files?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] slachiewicz commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
slachiewicz commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1253978595
https://stackoverflow.com/questions/67001968/how-to-disable-maven-blocking-external-http-repositories
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua closed issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
yihua closed issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
URL: https://github.com/apache/hudi/issues/6724
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] slachiewicz commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
slachiewicz commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1253780430
Maybe you have Rosseta installed and you use Java for x86 and not one dedicated to aarm64? Please paste Yours output of ```mvn -v```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1255001395
The simple fix was removing the settings.xml file from `.m2` folder. I am now wondering what is the content of settings.xml file for you @slachiewicz . Do you mind sharing your settings.xml file here? I am just curious to see what was it with my settings.xml that was causing all this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
codope commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1252295217
@the-other-tim-brown any workaround for this issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1253973838
I have been getting these warnings continuously before the build fails. Is this happening in your build as well @slachiewicz?
[INFO] ----------------< org.apache.hudi:hudi-utilities_2.11 >-----------------
[INFO] Building hudi-utilities_2.11 0.13.0-SNAPSHOT [17/48]
[INFO] --------------------------------[ jar ]---------------------------------
[WARNING] net.minidev:json-smart/maven-metadata.xmlfailed to transfer from http://0.0.0.0/ during a previous attempt. This failure was cached in the local repository and resolution will not be reattempted until the update interval of maven-default-http-blocker has elapsed or updates are forced. Original error: Could not transfer metadata net.minidev:json-smart/maven-metadata.xml from/to maven-default-http-blocker (http://0.0.0.0/): transfer failed for http://0.0.0.0/net/minidev/json-smart/maven-metadata.xml
[INFO]
[INFO] --- maven-clean-plugin:3.1.0:clean (default-clean) @ hudi-utilities_2.11 ---
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce-maven-version) @ hudi-utilities_2.11 ---
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce-logging) @ hudi-utilities_2.11 ---
[WARNING] net.minidev:json-smart/maven-metadata.xmlfailed to transfer from http://0.0.0.0/ during a previous attempt. This failure was cached in the local repository and resolution will not be reattempted until the update interval of maven-default-http-blocker has elapsed or updates are forced. Original error: Could not transfer metadata net.minidev:json-smart/maven-metadata.xml from/to maven-default-http-blocker (http://0.0.0.0/): transfer failed for http://0.0.0.0/net/minidev/json-smart/maven-metadata.xml
[INFO]
[INFO] --- protoc-jar-maven-plugin:3.11.4:run (proto-compile) @ hudi-utilities_2.11 ---
[INFO] Protoc version: 3.21.5
protoc-jar: protoc version: 3.21.5, detected platform: osx-aarch_64 (mac os x/aarch64)
protoc-jar: downloading: http://0.0.0.0/com/google/protobuf/protoc/maven-metadata.xml
protoc-jar: downloading: http://0.0.0.0/com/github/os72/protoc/maven-metadata.xml
protoc-jar: downloading: http://0.0.0.0/com/google/protobuf/protoc/maven-metadata.xml
protoc-jar: downloading: http://0.0.0.0/com/github/os72/protoc/maven-metadata.xml
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] jonvex commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
jonvex commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1253736767
I'm using an M1 mac. My java version is:
`openjdk version "1.8.0_345"
OpenJDK Runtime Environment (Zulu 8.64.0.19-CA-macos-aarch64) (build 1.8.0_345-b01)
OpenJDK 64-Bit Server VM (Zulu 8.64.0.19-CA-macos-aarch64) (build 25.345-b01, mixed mode)`
You can download it from:
https://www.azul.com/downloads/?package=jdk
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
yihua commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1254143520
@pratyakshsharma I can build the latest master on M1 Mac as well. Looks like dependency management is the issue for you.
```
[INFO] --- protoc-jar-maven-plugin:3.11.4:run (proto-compile) @ hudi-utilities_2.11 ---
[INFO] Protoc version: 3.21.5
protoc-jar: protoc version: 3.21.5, detected platform: osx-x86_64 (mac os x/x86_64)
protoc-jar: using default maven settings, didn't find user settings.xml
protoc-jar: downloading: https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/maven-metadata.xml
protoc-jar: saved: /var/folders/v7/mp77wy6j7bgfhn_bcnvr9ync0000gn/T/protocjar.webcache/com/google/protobuf/protoc/maven-metadata.xml
protoc-jar: using default maven settings, didn't find user settings.xml
protoc-jar: downloading: https://repo.maven.apache.org/maven2/com/github/os72/protoc/maven-metadata.xml
protoc-jar: saved: /var/folders/v7/mp77wy6j7bgfhn_bcnvr9ync0000gn/T/protocjar.webcache/com/github/os72/protoc/maven-metadata.xml
protoc-jar: using default maven settings, didn't find user settings.xml
protoc-jar: cached: /var/folders/v7/mp77wy6j7bgfhn_bcnvr9ync0000gn/T/protocjar.webcache/com/google/protobuf/protoc/maven-metadata.xml
protoc-jar: downloading: https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/3.21.5/protoc-3.21.5-osx-x86_64.exe
protoc-jar: saved: /var/folders/v7/mp77wy6j7bgfhn_bcnvr9ync0000gn/T/protocjar.webcache/com/google/protobuf/protoc/3.21.5/protoc-3.21.5-osx-x86_64.exe
protoc-jar: executing: [/var/folders/v7/mp77wy6j7bgfhn_bcnvr9ync0000gn/T/protocjar8811481423096289491/bin/protoc.exe, --version]
libprotoc 3.21.5
```
Here are my versions:
```
mvn -v
Apache Maven 3.8.6 (84538c9988a25aec085021c365c560670ad80f63)
Maven home: /opt/homebrew/Cellar/maven/3.8.6/libexec
Java version: 1.8.0_292, vendor: AdoptOpenJDK, runtime: /Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.16", arch: "x86_64", family: "mac"
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1253807965
Here is the output -
`[INFO] --- protoc-jar-maven-plugin:3.11.4:run (proto-compile) @ hudi-utilities_2.11 ---
[INFO] Protoc version: 3.21.5
protoc-jar: protoc version: 3.21.5, detected platform: osx-aarch_64 (mac os x/aarch64)
protoc-jar: downloading: http://0.0.0.0/com/google/protobuf/protoc/maven-metadata.xml
protoc-jar: downloading: http://0.0.0.0/com/github/os72/protoc/maven-metadata.xml
protoc-jar: downloading: http://0.0.0.0/com/google/protobuf/protoc/maven-metadata.xml
protoc-jar: downloading: http://0.0.0.0/com/github/os72/protoc/maven-metadata.xml
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Hudi 0.13.0-SNAPSHOT:
[INFO]
[INFO] Hudi ............................................... SUCCESS [ 1.247 s]
[INFO] hudi-tests-common .................................. SUCCESS [ 0.650 s]
[INFO] hudi-common ........................................ SUCCESS [ 8.589 s]
[INFO] hudi-hadoop-mr ..................................... SUCCESS [ 2.369 s]
[INFO] hudi-sync-common ................................... SUCCESS [ 0.980 s]
[INFO] hudi-hive-sync ..................................... SUCCESS [ 2.461 s]
[INFO] hudi-aws ........................................... SUCCESS [ 1.334 s]
[INFO] hudi-timeline-service .............................. SUCCESS [ 0.861 s]
[INFO] hudi-client ........................................ SUCCESS [ 0.057 s]
[INFO] hudi-client-common ................................. SUCCESS [ 5.473 s]
[INFO] hudi-spark-client .................................. SUCCESS [ 11.633 s]
[INFO] hudi-spark-datasource .............................. SUCCESS [ 0.026 s]
[INFO] hudi-spark-common_2.11 ............................. SUCCESS [ 13.727 s]
[INFO] hudi-spark2_2.11 ................................... SUCCESS [ 8.732 s]
[INFO] hudi-java-client ................................... SUCCESS [ 1.424 s]
[INFO] hudi-spark_2.11 .................................... SUCCESS [ 22.576 s]
[INFO] hudi-utilities_2.11 ................................ FAILURE [ 0.269 s]`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] the-other-tim-brown commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
the-other-tim-brown commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1252583774
I see that there was a fix for m1 macs here https://github.com/apache/hudi/pull/6535/files. We can also try another popular proto plugin https://www.xolstice.org/protobuf-maven-plugin/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1253468039
@jonvex You mention in this comment - https://github.com/apache/hudi/pull/6535#issuecomment-1233210913 that if processor is aarch64, what do you mean by that? Does it have anything to do with the java architecture as well? I would like to know the java version that you are using. I am actually using x86_64 java 8 as is visible in the output below -
` 1.8.0_311 (x86_64) "Oracle Corporation" - "Java SE 8" /Library/Java/JavaVirtualMachines/jdk1.8.0_311.jdk/Contents/Home`
Can this be the reason behind the build failing?
I tried on the latest master and using the fix in this PR - https://github.com/apache/hudi/pull/6535. Also tried invalidating caches on Intellij if that might help at all. Nothing seems to work so far.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1253955309
I have not made any changes to the intellij settings or .m2 settings.xml file. Let me try to see why https://repo.maven.apache.org/maven2 is getting converted to http://0.0.0.0 in my case. This is weird.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1253303826
@jonvex which machine are you using? Is it an M1 mac?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] jackwener commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
jackwener commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1378303492
I also meet this problem😂.
```log
[INFO]
[INFO] --- protoc-jar-maven-plugin:3.11.4:run (proto-compile) @ hudi-utilities_2.11 ---
Downloading from aliyunmaven: https://maven.aliyun.com/repository/central/com/github/os72/protoc-jar/3.11.4/protoc-jar-3.11.4.pom
Downloaded from aliyunmaven: https://maven.aliyun.com/repository/central/com/github/os72/protoc-jar/3.11.4/protoc-jar-3.11.4.pom (3.1 kB at 2.4 kB/s)
Downloading from aliyunmaven: https://maven.aliyun.com/repository/central/com/github/os72/protoc-jar/3.11.4/protoc-jar-3.11.4.jar
Downloaded from aliyunmaven: https://maven.aliyun.com/repository/central/com/github/os72/protoc-jar/3.11.4/protoc-jar-3.11.4.jar (10 MB at 1.1 MB/s)
[INFO] Protoc version: 3.21.5
protoc-jar: protoc version: 3.21.5, detected platform: osx-aarch_64 (mac os x/aarch64)
protoc-jar: downloading: http://repo1.maven.org/maven2/com/google/protobuf/protoc/maven-metadata.xml
protoc-jar: downloading: http://repo1.maven.org/maven2/com/github/os72/protoc/maven-metadata.xml
protoc-jar: downloading: http://repo1.maven.org/maven2/com/google/protobuf/protoc/maven-metadata.xml
protoc-jar: downloading: http://repo1.maven.org/maven2/com/github/os72/protoc/maven-metadata.xml
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Hudi 0.13.0-SNAPSHOT:
[INFO]
[INFO] Hudi ............................................... SUCCESS [ 1.119 s]
[INFO] hudi-tests-common .................................. SUCCESS [ 0.669 s]
[INFO] hudi-common ........................................ SUCCESS [ 17.117 s]
[INFO] hudi-hadoop-mr ..................................... SUCCESS [ 2.618 s]
[INFO] hudi-sync-common ................................... SUCCESS [ 0.688 s]
[INFO] hudi-hive-sync ..................................... SUCCESS [ 2.448 s]
[INFO] hudi-aws ........................................... SUCCESS [ 1.328 s]
[INFO] hudi-timeline-service .............................. SUCCESS [ 0.874 s]
[INFO] hudi-client ........................................ SUCCESS [ 0.035 s]
[INFO] hudi-client-common ................................. SUCCESS [ 5.351 s]
[INFO] hudi-spark-client .................................. SUCCESS [ 13.140 s]
[INFO] hudi-spark-datasource .............................. SUCCESS [ 0.028 s]
[INFO] hudi-spark-common_2.11 ............................. SUCCESS [ 15.296 s]
[INFO] hudi-spark2_2.11 ................................... SUCCESS [ 9.354 s]
[INFO] hudi-java-client ................................... SUCCESS [ 1.313 s]
[INFO] hudi-spark_2.11 .................................... SUCCESS [ 39.928 s]
[INFO] hudi-gcp ........................................... SUCCESS [ 3.932 s]
[INFO] hudi-utilities_2.11 ................................ FAILURE [ 28.878 s]
```
```
mvn -v
mvn -v
Apache Maven 3.8.6 (84538c9988a25aec085021c365c560670ad80f63)
Maven home: /opt/homebrew/Cellar/maven/3.8.6/libexec
Java version: 1.8.0_352, vendor: Amazon.com Inc., runtime: /Library/Java/JavaVirtualMachines/corretto-1.8.0_352/Contents/Home/jre
Default locale: en_CN, platform encoding: UTF-8
OS name: "mac os x", version: "12.6.1", arch: "aarch64", family: "mac"
```
---------------
After I delete `settings.xml` and `cached protoc binary(os72, google/protobuf)`.
It run successfully. The key is that delete `settings.xml`, just remove cache is useless
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] blackcheckren commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by "blackcheckren (via GitHub)" <gi...@apache.org>.
blackcheckren commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1614020609
I added this to the protoc-jar-maven-plugin configuration in the hudi-kafka-connect module's pom.xml file: The < protocArtifact > com. Google. Protobuf: protoc: 3.21.5 < / protocArtifact >. Then recompiled Hudi source code, can be compiled through.
Note that I have encountered this problem with ubuntu systems.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
codope commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1252293049
Looks like `protoc-jar-maven-plugin` is not yet support for mac osx arm64 architecture. There is a fix but it has not been merged: https://github.com/os72/protoc-jar-maven-plugin/issues/99
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1252490726
As per this link - https://repo1.maven.org/maven2/com/google/protobuf/protoc/3.17.3/, we have the .exe file for M1 mac. I tried degrading the protoc version to 3.17.3 and got the below error -
`[ERROR] Failed to execute goal com.github.os72:protoc-jar-maven-plugin:3.11.4:run (proto-compile) on project hudi-utilities_2.11: Execution proto-compile of goal com.github.os72:protoc-jar-maven-plugin:3.11.4:run failed.: NullPointerException -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal com.github.os72:protoc-jar-maven-plugin:3.11.4:run (proto-compile) on project hudi-utilities_2.11: Execution proto-compile of goal com.github.os72:protoc-jar-maven-plugin:3.11.4:run failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:375)
at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:351)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:215)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:171)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:163)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:294)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:960)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:293)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:196)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
Caused by: org.apache.maven.plugin.PluginExecutionException: Execution proto-compile of goal com.github.os72:protoc-jar-maven-plugin:3.11.4:run failed.
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:148)
at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:370)
at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:351)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:215)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:171)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:163)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:294)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:960)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:293)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:196)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
Caused by: java.lang.NullPointerException
at com.github.os72.protocjar.Protoc.extractStdTypes (Protoc.java:372)
at com.github.os72.protocjar.maven.ProtocJarMojo.performProtoCompilation (ProtocJarMojo.java:397)
at com.github.os72.protocjar.maven.ProtocJarMojo.execute (ProtocJarMojo.java:374)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:137)
at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:370)
at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:351)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:215)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:171)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:163)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:294)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:960)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:293)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:196)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1253772665
Downloaded the arm64 java 8 from the link you suggested. The build still fails with the error -
`[ERROR] Failed to execute goal com.github.os72:protoc-jar-maven-plugin:3.11.4:run (proto-compile) on project hudi-utilities_2.11: Error extracting protoc for version 3.21.5: Unsupported platform: protoc-3.21.5-osx-aarch_64.exe`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
yihua commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1254144971
Closing this as the issue is not related to Hudi. @pratyakshsharma feel free to post your solution once the build succeeds on your side.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] jonvex commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
jonvex commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1252781383
I just tried building on master and it worked for me.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] slachiewicz commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
slachiewicz commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1255846881
i was able to run successful build locally without any customisations and with empty `setting.xml` and deleted previously cached protoc binary
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1255924022
alright, this is what I wanted to know.
Thank you for all the support @yihua @slachiewicz @codope @jonvex @the-other-tim-brown
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] slachiewicz commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
slachiewicz commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1253796088
please check output from plugin
```
[INFO] --- protoc-jar-maven-plugin:3.11.4:run (proto-compile) @ hudi-utilities_2.11 ---
[INFO] Protoc version: 3.21.5
protoc-jar: protoc version: 3.21.5, detected platform: osx-aarch_64 (mac os x/aarch64)
protoc-jar: cached: /var/folders/46/zh5s3qfd0j7gr6x4ffj03s_h0000gn/T/protocjar.webcache/com/google/protobuf/protoc/maven-metadata.xml
protoc-jar: cached: /var/folders/46/zh5s3qfd0j7gr6x4ffj03s_h0000gn/T/protocjar.webcache/com/google/protobuf/protoc/3.21.5/protoc-3.21.5-osx-aarch_64.exe
protoc-jar: executing: [/var/folders/46/zh5s3qfd0j7gr6x4ffj03s_h0000gn/T/protocjar254269478082102386/bin/protoc.exe, --version]
libprotoc 3.21.5
[INFO] Protoc command: /var/folders/46/zh5s3qfd0j7gr6x4ffj03s_h0000gn/T/protocjar254269478082102386/bin/protoc.exe
[INFO] Additional include types: /var/folders/46/zh5s3qfd0j7gr6x4ffj03s_h0000gn/T/protocjar1724190897946461159/include
[INFO] Input directories:
[INFO] /Users/slachiewicz/oss/hudi/hudi-utilities/src/main/resources
[INFO] Include directories:
[INFO] /var/folders/46/zh5s3qfd0j7gr6x4ffj03s_h0000gn/T/protocjar1724190897946461159/include
[INFO] Output targets:
[INFO] java: /Users/slachiewicz/oss/hudi/hudi-utilities/target/generated-sources (add: main, clean: false, plugin: null, outputOptions: null)
[INFO] /Users/slachiewicz/oss/hudi/hudi-utilities/target/generated-sources does not exist. Creating...
[WARNING] /Users/slachiewicz/oss/hudi/hudi-utilities/src/main/resources does not exist
[INFO] Adding generated sources (java): /Users/slachiewicz/oss/hudi/hudi-utilities/target/generated-sources
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ hudi-utilities_2.11 ---
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] slachiewicz commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
slachiewicz commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1253774888
i've double checked and it works on my computer and I can build latest master without issues.
```
mvn -v
Apache Maven 3.8.6 (84538c9988a25aec085021c365c560670ad80f63)
Maven home: /opt/homebrew/Cellar/maven/3.8.6/libexec
Java version: 1.8.0_345, vendor: Azul Systems, Inc., runtime: /Users/slachiewicz/Library/Java/JavaVirtualMachines/azul-1.8.0_345/Contents/Home/jre
Default locale: en_PL, platform encoding: UTF-8
OS name: "mac os x", version: "12.6", arch: "aarch64", family: "mac"
```
please check Maven settings like enabled profiles - maybe you have some overwrites ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1254033304
I guess something else is wrong. I do not have any mirror specified in my settings.xml. So maven cannot pick any http repository for fetching the artifacts.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1254789521
For now, the only way out is to skip the concerned classes from compiling. Need to dig deep further to see why maven tries to use http://0.0.0.0 to resolve protobuf dependencies in my case.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1253787492
Here is the output -
`mvn -v
Apache Maven 3.8.6 (84538c9988a25aec085021c365c560670ad80f63)
Maven home: /opt/homebrew/Cellar/maven/3.8.6/libexec
Java version: 1.8.0_345, vendor: Azul Systems, Inc., runtime: /Library/Java/JavaVirtualMachines/zulu-8.jdk/Contents/Home/jre
Default locale: en_IN, platform encoding: US-ASCII
OS name: "mac os x", version: "12.0", arch: "aarch64", family: "mac"`
yes I have rosetta installed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on issue #6724:
URL: https://github.com/apache/hudi/issues/6724#issuecomment-1252208346
@codope @nsivabalan @the-other-tim-brown
I see the changes were introduced in this PR - https://github.com/apache/hudi/pull/6135.
I tried few ways to fix this, but the error does not seem to resolve.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org