You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "iwasakims (via GitHub)" <gi...@apache.org> on 2023/04/13 04:04:28 UTC
[GitHub] [bigtop] iwasakims opened a new pull request, #1103: BIGTOP-3926. Fix build failure of Hive against Hadoop 3.3.5.
iwasakims opened a new pull request, #1103:
URL: https://github.com/apache/bigtop/pull/1103
https://issues.apache.org/jira/browse/BIGTOP-3926
```
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-shade-plugin:3.1.0:shade (default) on project hive-jdbc: Error creating shaded jar: null: IllegalArgumentException -> [Help 1
```
The error was caused by upgrading Bouncy Castle on Hadoop side. [maven-shade-plugin must be upgraded](https://issues.apache.org/jira/browse/MSHADE-337) to handle multi-JVM jar.
This is follow-up of #1101 and depending on #1102.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] sekikn commented on pull request #1103: BIGTOP-3926. Fix build failure of Hive against Hadoop 3.3.5.
Posted by "sekikn (via GitHub)" <gi...@apache.org>.
sekikn commented on PR #1103:
URL: https://github.com/apache/bigtop/pull/1103#issuecomment-1522951598
+1, tested on master with CentOS 7 using the following command:
```
$ ./docker-hadoop.sh -d -C config_centos-7.yaml -L -k hdfs,yarn,hive -s hive -c 3
```
and on branch-3.2 with Ubuntu 20.04 using the following command:
```
$ ./docker-hadoop.sh -d -C config_ubuntu-20.04.yaml -G -L -k hdfs,yarn,hive -s hive -c 3
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] guyuqi commented on pull request #1103: BIGTOP-3926. Fix build failure of Hive against Hadoop 3.3.5.
Posted by "guyuqi (via GitHub)" <gi...@apache.org>.
guyuqi commented on PR #1103:
URL: https://github.com/apache/bigtop/pull/1103#issuecomment-1511101865
oops, I didn't notice [BIGTOP-3927](https://issues.apache.org/jira/browse/BIGTOP-3927) there.
I'm used to running smoke tests of hdfs, yarn ,mapreduce hbase and hive together.
Let me test it separately and thanks for the heads up.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] sekikn merged pull request #1103: BIGTOP-3926. Fix build failure of Hive against Hadoop 3.3.5.
Posted by "sekikn (via GitHub)" <gi...@apache.org>.
sekikn merged PR #1103:
URL: https://github.com/apache/bigtop/pull/1103
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] guyuqi commented on pull request #1103: BIGTOP-3926. Fix build failure of Hive against Hadoop 3.3.5.
Posted by "guyuqi (via GitHub)" <gi...@apache.org>.
guyuqi commented on PR #1103:
URL: https://github.com/apache/bigtop/pull/1103#issuecomment-1510988445
It failed to build Hbase (running `Hadoop`, `Hive `smoke tests ) when I applied PR #1101, #1102 and #1103 on Ubuntu-22.04 (x86_64/Arm64).
```
[INFO] Dependencies classpath:
/ws/bigtop/output/hbase/hbase-2.4.13/hbase-shaded/hbase-shaded-client/target/hbase-shaded-client-2.4.13.jar
[INFO]
[INFO] --- exec-maven-plugin:1.6.0:exec (check-jar-contents-for-stuff-with-hadoop) @ hbase-shaded-with-hadoop-check-invariants ---
[ERROR] Found artifact with unexpected contents: '/ws/bigtop/output/hbase/hbase-2.4.13/hbase-shaded/hbase-shaded-client/target/hbase-shaded-client-2.4.13.jar'
Please check the following and either correct the build or update
......
...
com/sun/xml/txw2/output/XmlSerializer.class
[ERROR] Command execution failed.
org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal (DefaultExecutor.java:404)
...
..
.
[INFO] Apache HBase - Assembly ............................ SUCCESS [ 36.068 s]
[INFO] Apache HBase - Shaded - Testing Util ............... SUCCESS [ 51.800 s]
[INFO] Apache HBase - Shaded - Testing Util Tester ........ SUCCESS [ 3.054 s]
[INFO] Apache HBase Shaded Packaging Invariants ........... SUCCESS [ 2.608 s]
[INFO] Apache HBase Shaded Packaging Invariants (with Hadoop bundled) FAILURE [ 1.547 s]
[INFO] Apache HBase - Archetypes .......................... SKIPPED
[INFO] Apache HBase - Exemplar for hbase-client archetype . SKIPPED
[INFO] Apache HBase - Exemplar for hbase-shaded-client archetype SKIPPED
[INFO] Apache HBase - Archetype builder ................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 07:48 min
[INFO] Finished at: 2023-04-17T08:23:28Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:
exec (check-jar-contents-for-stuff-with-hadoop) on project hbase-shaded-with-hadoop-check-invariants:
Command execution failed.: Process exited with an error: 1 (Exit value: 1) -> [Help 1]
[ERROR]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] iwasakims commented on pull request #1103: BIGTOP-3926. Fix build failure of Hive against Hadoop 3.3.5.
Posted by "iwasakims (via GitHub)" <gi...@apache.org>.
iwasakims commented on PR #1103:
URL: https://github.com/apache/bigtop/pull/1103#issuecomment-1511083550
> It failed to build Hbase (running Hadoop, Hive smoke tests ) when I applied PR https://github.com/apache/bigtop/pull/1101, https://github.com/apache/bigtop/pull/1102 and https://github.com/apache/bigtop/pull/1103 on Ubuntu-22.04 (x86_64/Arm64).
The issue will be addressed by [BIGTOP-3927](https://issues.apache.org/jira/browse/BIGTOP-3927). This(#1103) is a patch for Hive. HBase issue is not related at all. @guyuqi
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] sekikn commented on pull request #1103: BIGTOP-3926. Fix build failure of Hive against Hadoop 3.3.5.
Posted by "sekikn (via GitHub)" <gi...@apache.org>.
sekikn commented on PR #1103:
URL: https://github.com/apache/bigtop/pull/1103#issuecomment-1522959690
Merged into master and branch-3.2.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org