You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/05/29 14:34:30 UTC
[GitHub] [hudi] arun990 opened a new issue #3009: Dependency error when attempt to build Hudi from git source ..
arun990 opened a new issue #3009:
URL: https://github.com/apache/hudi/issues/3009
Hi,
Followed the steps to get the hudi soruce from git and build it and getting the build failure error as mentioned below:
Please help.
[INFO] Hudi ............................................... SUCCESS [ 7.032 s]
[INFO] hudi-common ........................................ SUCCESS [ 31.071 s]
[INFO] hudi-timeline-service .............................. SUCCESS [ 4.266 s]
[INFO] hudi-client ........................................ SUCCESS [ 0.173 s]
[INFO] hudi-client-common ................................. SUCCESS [ 19.735 s]
[INFO] hudi-hadoop-mr ..................................... FAILURE [ 1.005 s]
[INFO] hudi-spark-client .................................. SKIPPED
[INFO] hudi-sync-common ................................... SKIPPED
[INFO] hudi-hive-sync ..................................... SKIPPED
[INFO] hudi-spark-datasource .............................. SKIPPED
[INFO] hudi-spark-common .................................. SKIPPED
[INFO] hudi-spark2_2.12 ................................... SKIPPED
[INFO] hudi-spark3_2.12 ................................... SKIPPED
[INFO] hudi-spark_2.12 .................................... SKIPPED
[INFO] hudi-utilities_2.12 ................................ SKIPPED
[INFO] hudi-utilities-bundle_2.12 ......................... SKIPPED
[INFO] hudi-cli ........................................... SKIPPED
[INFO] hudi-java-client ................................... SKIPPED
[INFO] hudi-flink-client .................................. SKIPPED
[INFO] hudi-dla-sync ...................................... SKIPPED
[INFO] hudi-sync .......................................... SKIPPED
[INFO] hudi-hadoop-mr-bundle .............................. SKIPPED
[INFO] hudi-hive-sync-bundle .............................. SKIPPED
[INFO] hudi-spark-bundle_2.12 ............................. SKIPPED
[INFO] hudi-presto-bundle ................................. SKIPPED
[INFO] hudi-timeline-server-bundle ........................ SKIPPED
[INFO] hudi-hadoop-docker ................................. SKIPPED
[INFO] hudi-hadoop-base-docker ............................ SKIPPED
[INFO] hudi-hadoop-namenode-docker ........................ SKIPPED
[INFO] hudi-hadoop-datanode-docker ........................ SKIPPED
[INFO] hudi-hadoop-history-docker ......................... SKIPPED
[INFO] hudi-hadoop-hive-docker ............................ SKIPPED
[INFO] hudi-hadoop-sparkbase-docker ....................... SKIPPED
[INFO] hudi-hadoop-sparkmaster-docker ..................... SKIPPED
[INFO] hudi-hadoop-sparkworker-docker ..................... SKIPPED
[INFO] hudi-hadoop-sparkadhoc-docker ...................... SKIPPED
[INFO] hudi-hadoop-presto-docker .......................... SKIPPED
[INFO] hudi-integ-test .................................... SKIPPED
[INFO] hudi-integ-test-bundle ............................. SKIPPED
[INFO] hudi-examples ...................................... SKIPPED
[INFO] hudi-flink_2.12 .................................... SKIPPED
[INFO] hudi-flink-bundle_2.12 ............................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 56.107 s
[INFO] Finished at: 2021-05-29T14:04:47Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project hudi-hadoop-mr: Could not resolve dependencies for project org.apache.hudi
:hudi-hadoop-mr:jar:0.8.0: Failed to collect dependencies at org.apache.hive:hive-exec:jar:core:2.3.1 -> org.apache.
calcite:calcite-core:jar:1.10.0 -> org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde: Failed to read artifac
t descriptor for org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde: Could not transfer artifact org.pentaho:
pentaho-aggdesigner-algorithm:pom:5.1.5-jhyde from/to maven-default-http-blocker (http://0.0.0.0/): Blocked mirror f
or repositories: [datanucleus (http://www.datanucleus.org/downloads/maven2, default, releases), glassfish-repository
(http://maven.glassfish.org/content/groups/glassfish, default, disabled), glassfish-repo-archive (http://maven.glas
sfish.org/content/groups/glassfish, default, disabled), apache.snapshots (http://repository.apache.org/snapshots, de
fault, snapshots), central (http://repo.maven.apache.org/maven2, default, releases), conjars (http://conjars.org/rep
o, default, releases+snapshots)] -> [Help 1]
[ERROR]
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] arun990 commented on issue #3009: Dependency error when attempt to build Hudi from git source ..
Posted by GitBox <gi...@apache.org>.
arun990 commented on issue #3009:
URL: https://github.com/apache/hudi/issues/3009#issuecomment-851285496
Hi,
Even after cloning the https://github.com/vinothchandar/hudi/tree/remove-spring-deps and attempt to mvn build, getting the same error.
Please help.
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project hudi-hadoop-mr: Could not resolve dependencies for project org.apache.hudi
:hudi-hadoop-mr:jar:0.9.0-SNAPSHOT: Failed to collect dependencies at org.apache.hive:hive-exec:jar:core:2.3.1 -> or
g.apache.calcite:calcite-core:jar:1.10.0 -> org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde: Failed to rea
d artifact descriptor for org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde: Could not transfer artifact org
.pentaho:pentaho-aggdesigner-algorithm:pom:5.1.5-jhyde from/to maven-default-http-blocker (http://0.0.0.0/): Blocked
mirror for repositories: [datanucleus (http://www.datanucleus.org/downloads/maven2, default, releases), glassfish-r
epository (http://maven.glassfish.org/content/groups/glassfish, default, disabled), glassfish-repo-archive (http://m
aven.glassfish.org/content/groups/glassfish, default, disabled), apache.snapshots (http://repository.apache.org/snap
shots, default, snapshots), central (http://repo.maven.apache.org/maven2, default, releases), conjars (http://conjar
s.org/repo, default, releases+snapshots)] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <args> -rf :hudi-hadoop-mr
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] arun990 commented on issue #3009: Dependency error when attempt to build Hudi from git source ..
Posted by GitBox <gi...@apache.org>.
arun990 commented on issue #3009:
URL: https://github.com/apache/hudi/issues/3009#issuecomment-855328928
Hi, checked it and the build was completed without the reported error.
Thank you.
Closing the issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Doorwood commented on issue #3009: Dependency error when attempt to build Hudi from git source ..
Posted by GitBox <gi...@apache.org>.
Doorwood commented on issue #3009:
URL: https://github.com/apache/hudi/issues/3009#issuecomment-851591922
I met the same question and how I solved this question is to change the settings of maven by changing the mirrors config.But you may still have some jar files which could not be supported.I downloaded them by myself.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] arun990 commented on issue #3009: Dependency error when attempt to build Hudi from git source ..
Posted by GitBox <gi...@apache.org>.
arun990 commented on issue #3009:
URL: https://github.com/apache/hudi/issues/3009#issuecomment-851726266
Hi, The mentioned error is observed in hudi-hadoop-mr module. We can download the jar for hudi-hadoop-mr.
To resolve this error where to keep the jar and what config changes need to be made for successfully mvn build?
Anyway having perm fix or/and hudi-cli binary download would help.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] n3nash commented on issue #3009: Dependency error when attempt to build Hudi from git source ..
Posted by GitBox <gi...@apache.org>.
n3nash commented on issue #3009:
URL: https://github.com/apache/hudi/issues/3009#issuecomment-855184359
@arun990 A fix for this was landed today -> https://github.com/apache/hudi/pull/3034 Can you check if the master works for you now ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] arun990 closed issue #3009: Dependency error when attempt to build Hudi from git source ..
Posted by GitBox <gi...@apache.org>.
arun990 closed issue #3009:
URL: https://github.com/apache/hudi/issues/3009
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] arun990 commented on issue #3009: Dependency error when attempt to build Hudi from git source ..
Posted by GitBox <gi...@apache.org>.
arun990 commented on issue #3009:
URL: https://github.com/apache/hudi/issues/3009#issuecomment-852930223
Hi, Tried to mvn build using the settings.xml and getting the same error as pasted below.
[INFO] Building hudi-hadoop-mr 0.8.0 [6/42]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Hudi 0.8.0:
[INFO]
[INFO] Hudi ............................................... SUCCESS [02:09 min]
[INFO] hudi-common ........................................ SUCCESS [01:00 min]
[INFO] hudi-timeline-service .............................. SUCCESS [ 5.223 s]
[INFO] hudi-client ........................................ SUCCESS [ 0.229 s]
[INFO] hudi-client-common ................................. SUCCESS [ 31.635 s]
[INFO] hudi-hadoop-mr ..................................... FAILURE [ 0.327 s]
[INFO] hudi-spark-client .................................. SKIPPED
[INFO] hudi-sync-common ................................... SKIPPED
[INFO] hudi-hive-sync ..................................... SKIPPED
-----------do ----------------------------------------------skipped
[INFO] hudi-flink_2.12 .................................... SKIPPED
[INFO] hudi-flink-bundle_2.12 ............................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 03:48 min
[INFO] Finished at: 2021-06-02T10:53:56Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project hudi-hadoop-mr: Could not resolve dependencies for project org.apache.hudi
:hudi-hadoop-mr:jar:0.8.0: Failed to collect dependencies at org.apache.hive:hive-exec:jar:core:2.3.1 -> org.apache.
calcite:calcite-core:jar:1.10.0 -> org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde: Failed to read artifac
t descriptor for org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde: Could not transfer artifact org.pentaho:
pentaho-aggdesigner-algorithm:pom:5.1.5-jhyde from/to maven-default-http-blocker (http://0.0.0.0/): Blocked mirror f
or repositories: [datanucleus (http://www.datanucleus.org/downloads/maven2, default, releases), glassfish-repository
(http://maven.glassfish.org/content/groups/glassfish, default, disabled), glassfish-repo-archive (http://maven.glas
sfish.org/content/groups/glassfish, default, disabled), apache.snapshots (http://repository.apache.org/snapshots, de
fault, snapshots), conjars (http://conjars.org/repo, default, releases+snapshots)] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <args> -rf :hudi-hadoop-mr
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Tandoy commented on issue #3009: Dependency error when attempt to build Hudi from git source ..
Posted by GitBox <gi...@apache.org>.
Tandoy commented on issue #3009:
URL: https://github.com/apache/hudi/issues/3009#issuecomment-852891970
[settings.md](https://github.com/apache/hudi/files/6583594/settings.md)
You can try this maven configuration file.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] n3nash commented on issue #3009: Dependency error when attempt to build Hudi from git source ..
Posted by GitBox <gi...@apache.org>.
n3nash commented on issue #3009:
URL: https://github.com/apache/hudi/issues/3009#issuecomment-851707523
@Doorwood Thanks for chiming in. Have you found any fixes that can address this permanently ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org