[jira] [Created] (KYLIN-4645) Start kylin3.1.0-hadoop3 failed due to Guava version conflict with query-module

["zhou pengbo (Jira)" <ji...@apache.org>]

zhou pengbo created KYLIN-4645:
----------------------------------

             Summary: Start kylin3.1.0-hadoop3 failed due to Guava version conflict with query-module
                 Key: KYLIN-4645
                 URL: https://issues.apache.org/jira/browse/KYLIN-4645
             Project: Kylin
          Issue Type: Bug
          Components: Query Engine
    Affects Versions: v3.1.0
         Environment: HDP-3.1.4.0-315  with  Hadoop(3.1.1) and Hive(3.1.0) and Spark2(2.3.2)  and Hbase(2.0.2) .And the cluster guava version  is guava-28.0-jre。
            Reporter: zhou pengbo
         Attachments: guava截图.png, kylin.png, 日志.png

this is my development environment ： 

HDP-3.1.4.0-315  with  Hadoop(3.1.1) and Hive(3.1.0) and Spark2(2.3.2)  and Hbase(2.0.2) .

the cluster guava version  is guava-28.0-jre.

when I run bin/kylin.sh start , the error appear ：
{code:java}
2020-07-16 18:07:56,373 DEBUG [main] common.KylinConfig:346 : KYLIN_CONF property was not set, will seek KYLIN_HOME env variable2020-07-16 18:07:56,373 DEBUG [main] common.KylinConfig:346 : KYLIN_CONF property was not set, will seek KYLIN_HOME env variable2020-07-16 18:07:56,375 INFO  [main] common.KylinConfig:352 : Use KYLIN_HOME=/home/kylin/apache-kylin-3.1.0-bin-hadoop32020-07-16 18:07:56,378 INFO  [main] common.KylinConfig:153 : Initialized a new KylinConfig from getInstanceFromEnv : 79673072020-07-16 18:07:56,417 INFO  [main] persistence.ResourceStore:90 : Using metadata url kylin_metadata@hbase for resource storeException in thread "main" java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin_metadata@hbase at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:101) at org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:113) at org.apache.kylin.rest.service.AclTableMigrationTool.checkIfNeedMigrate(AclTableMigrationTool.java:99) at org.apache.kylin.tool.AclTableMigrationCLI.main(AclTableMigrationCLI.java:43)Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:94) ... 3 moreCaused by: java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V at org.apache.hadoop.conf.Configuration.set(Configuration.java:1358) at org.apache.hadoop.conf.Configuration.set(Configuration.java:1339) at org.apache.kylin.common.util.HadoopUtil.healSickConfig(HadoopUtil.java:77) at org.apache.kylin.common.util.HadoopUtil.getCurrentConfiguration(HadoopUtil.java:63) at org.apache.kylin.storage.hbase.HBaseConnection.newHBaseConfiguration(HBaseConnection.java:170) at org.apache.kylin.storage.hbase.HBaseConnection.get(HBaseConnection.java:259) at org.apache.kylin.storage.hbase.HBaseResourceStore.getConnection(HBaseResourceStore.java:96) at org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:119) at org.apache.kylin.storage.hbase.HBaseResourceStore.<init>(HBaseResourceStore.java:89) ... 8 more2020-07-16 18:07:56,630 INFO  [close-hbase-conn] hbase.HBaseConnection:138 : Closing HBase connections...ERROR: Unknown error. Please check full log.{code}
then I  chat with  shaofeng_shi@kyligence  with this issue， confirm the problem  maybe:

in kylin-3.1.0, have fix the issue KYLIN-4394 about the problem of guava version , and add shade-guava version in kylin-3.1.0. but in  the query-module ， because of calcite dependent on guava-14.0, so now kylin depent on two version of guava . thus, Caused the above problem. but This is also a guess.

Related Links ： https://www.mail-archive.com/search?l=user@kylin.apache.org&q=subject:%22Re%5C%3A%22&o=newest&f=1



--
This message was sent by Atlassian Jira
(v8.3.4#803005)