You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by GitBox <gi...@apache.org> on 2021/01/28 07:34:32 UTC
[GitHub] [bigtop] sekikn opened a new pull request #718: BIGTOP-3480. Bump Hive to 3.1.2.
sekikn opened a new pull request #718:
URL: https://github.com/apache/bigtop/pull/718
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] tasanuma commented on pull request #718: BIGTOP-3480. Bump Hive to 3.1.2.
Posted by GitBox <gi...@apache.org>.
tasanuma commented on pull request #718:
URL: https://github.com/apache/bigtop/pull/718#issuecomment-970176470
@iwasakims Thank you for your quick reply. It seems that the `-Dguava.version=27.0-jre` option is the cause of the compilation failure. So, is `HIVE-21569.diff` required because of #763?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] sekikn commented on pull request #718: BIGTOP-3480. Bump Hive to 3.1.2.
Posted by GitBox <gi...@apache.org>.
sekikn commented on pull request #718:
URL: https://github.com/apache/bigtop/pull/718#issuecomment-768861737
This should be merged after #717, because it contains a patch for addressing Tez upgrade.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] tasanuma commented on pull request #718: BIGTOP-3480. Bump Hive to 3.1.2.
Posted by GitBox <gi...@apache.org>.
tasanuma commented on pull request #718:
URL: https://github.com/apache/bigtop/pull/718#issuecomment-969858255
There's something I'd like to ask. Is there any reason that it had to apply HIVE-21569 and upgrade guava version of Hive?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] iwasakims commented on pull request #718: BIGTOP-3480. Bump Hive to 3.1.2.
Posted by GitBox <gi...@apache.org>.
iwasakims commented on pull request #718:
URL: https://github.com/apache/bigtop/pull/718#issuecomment-970071974
@tasanuma
removing the patch causes the following compilation error.
```
$ git checkout rel/3.0.0
$ rm bigtop-packages/src/common/hive/patch3-HIVE-21569.diff
$ ./gradlew hive-clean hive-pkg
...
+ mvn -Dhbase.version=2.2.6 -Dzookeeper.version=3.4.14 -Dhadoop.version=3.2.2 -DskipTests -Dtez.version=0.10.0 -Dspark.version=3.0.1 -Dscala.binary.version=2.12 -Dscala.version=2.12.13 -Dguava.version=27.0-jre clean install -Pdist
...
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.6.1:compile (default-compile) on project hive-llap-common: Compilation failure: Compilation failure:
[ERROR] /home/centos/srcs/bigtop/build/hive/rpm/BUILD/apache-hive-3.1.2-src/llap-common/src/java/org/apache/hadoop/hive/llap/AsyncPbRpcProxy.java:[173,16] method addCallback in class com.google.common.util.concurrent.Futures cannot be applied to given types;
[ERROR] required: com.google.common.util.concurrent.ListenableFuture<V>,com.google.common.util.concurrent.FutureCallback<? super V>,java.util.concurrent.Executor
[ERROR] found: com.google.common.util.concurrent.ListenableFuture<U>,org.apache.hadoop.hive.llap.AsyncPbRpcProxy.ResponseCallback<U>
[ERROR] reason: cannot infer type-variable(s) V
[ERROR] (actual and formal argument lists differ in length)
[ERROR] /home/centos/srcs/bigtop/build/hive/rpm/BUILD/apache-hive-3.1.2-src/llap-common/src/java/org/apache/hadoop/hive/llap/AsyncPbRpcProxy.java:[274,12] method addCallback in class com.google.common.util.concurrent.Futures cannot be applied to given types;
[ERROR] required: com.google.common.util.concurrent.ListenableFuture<V>,com.google.common.util.concurrent.FutureCallback<? super V>,java.util.concurrent.Executor
[ERROR] found: com.google.common.util.concurrent.ListenableFuture<java.lang.Void>,<anonymous com.google.common.util.concurrent.FutureCallback<java.lang.Void>>
[ERROR] reason: cannot infer type-variable(s) V
[ERROR] (actual and formal argument lists differ in length)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] iwasakims commented on pull request #718: BIGTOP-3480. Bump Hive to 3.1.2.
Posted by GitBox <gi...@apache.org>.
iwasakims commented on pull request #718:
URL: https://github.com/apache/bigtop/pull/718#issuecomment-970357889
@tasanuma Removing `-Dguava.version=27.0-jre` fixed the compilation error and caused failure of starting up Hive Metastore server. I guess @sekiken needed the patch3-HIVE-21569.diff for this.
```
[root@de21f85aaab5 /]# cat /var/log/hive/hive-metastore.out
2021-11-16 14:47:07: Starting Hive Metastore Server
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Exception in thread "main" java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1357)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1338)
at org.apache.hadoop.hive.metastore.conf.MetastoreConf.lambda$newMetastoreConf$1(MetastoreConf.java:1191)
at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
at org.apache.hadoop.hive.metastore.conf.MetastoreConf.newMetastoreConf(MetastoreConf.java:1188)
at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:8770)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] iwasakims merged pull request #718: BIGTOP-3480. Bump Hive to 3.1.2.
Posted by GitBox <gi...@apache.org>.
iwasakims merged pull request #718:
URL: https://github.com/apache/bigtop/pull/718
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] tasanuma commented on pull request #718: BIGTOP-3480. Bump Hive to 3.1.2.
Posted by GitBox <gi...@apache.org>.
tasanuma commented on pull request #718:
URL: https://github.com/apache/bigtop/pull/718#issuecomment-971024683
@iwasakims Thank you for the confirmation! Now I got it. Since it specifies `-Dhadoop.version=3.2.2`, it also needs to conform to the guava version of hadoop-3.2.2, or such problems will occur.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org