[jira] [Commented] (KYLIN-5160) kylin4无法连接AWS Glue元数据存储

["ASF subversion and git services (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KYLIN-5160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17524011#comment-17524011 ] 

ASF subversion and git services commented on KYLIN-5160:
--------------------------------------------------------

Commit c29b8f5b5ffa4d33ea2120a4efe261a6fbab1b01 in kylin's branch refs/heads/kylin-soft-affinity-local-cache from Xiaoxiang Yu
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=c29b8f5b5f ]

KYLIN-5160 Fix driver extra classpath


> kylin4无法连接AWS Glue元数据存储
> -----------------------
>
>                 Key: KYLIN-5160
>                 URL: https://issues.apache.org/jira/browse/KYLIN-5160
>             Project: Kylin
>          Issue Type: New Feature
>          Components: Metadata
>            Reporter: skyfeng
>            Priority: Major
>
> 在AWS EMR5.33版本中，连接AWS Glue时，报无法连接错误，在kylin3中使用是ok的。信息如下：
> 2021-11-23 02:35:05,254 ERROR [pool-5-thread-1] metadata.Hive : Unable to instantiate a metastore client factory com.amazonaws.glue.catalog.metastore.AWSGlueDataCatalogHiveClientFactory due to: java.lang.ClassNotFoundException: Class com.amazonaws.glue.catalog.metastore .AWSGlueDataCatalogHiveClientFactory not found java.lang.ClassNotFoundException: Class com.amazonaws.glue.catalog.metastore.AWSGlueDataCatalogHiveClientFactory not found at org.apache.hadoop.conf.Configuration.getClassByName([Configuration.java:2273 |http://configuration.java:2273/]) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClientFactory([Hive.java:3015 |http://hive.java:3015/]) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient([Hive.java:3006 |http://hive.java:3006/])
>  
> 另一个日志如下：
> 2021-11-25 07:07:57,025 ERROR [http-bio-7070-exec-5] controller.TableController:200 : Unable to create M etaStoreClient for gluecatalog java.lang.IllegalStateException: Unable to create MetaStoreClient for gluecatalog at org.apache.kylin.source.hive.HiveMetaStoreClientFactory.getHiveMetaStoreClient(HiveMetaStoreC [lientFactory.java:55 |http://lientfactory.java:55/]) at org.apache.kylin.source.hive.CLIHiveClient.getMetaStoreClient([CLIHiveClient.java:164 |http://clihiveclient.java:164/]) at org.apache.kylin.source.hive.CLIHiveClient.getHiveDbNames([CLIHiveClient.java:118 |http://clihiveclient.java:118/]) at org.apache.kylin.source.hive.HiveMetadataExplorer.listDatabases([HiveMetadataExplorer.java:51 |http://hivemetadataexplorer.java:51/]) at org.apache.kylin.rest.service.TableService.getSourceDbNames([TableService.java:274 |http://tableservice.java:274/]) at org.apache.kylin.rest.controller.TableController.showHiveDatabases([TableController.java:198 |http://tablecontroller.java:198/]) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke([NativeMethodAccessorImpl.java:62 |http://nativemethodaccessorimpl.java:62/]) at sun.reflect.DelegatingMethodAccessorImpl.invoke([DelegatingMethodAccessorImpl.java:43 |http://delegatingmethodaccessorimpl.java:43/]) at java.lang.reflect.Method.invoke([Method.java:498 |http://method.java:498/]) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod .java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandl [erMethod.java:133 |http://ermethod.java:133/]) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAnd Handle([ServletInvocableHandlerMethod.java:97 |http://servletinvocablehandlermethod.java:97/]) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHand lerMethod([RequestMappingHandlerAdapter.java:854 |http://requestmappinghandleradapter.java:854/]) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInte rnal([RequestMappingHandlerAdapter.java:765 |http://requestmappinghandleradapter.java:765/]) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandle [rMethodAdapter.java:85 |http://rmethodadapter.java:85/]) at org.springframework.web.servlet.DispatcherServlet.doDispatch([DispatcherServlet.java:967 |http://dispatcherservlet.java:967/]) at org.springframework.web.servlet.DispatcherServlet.doService([DispatcherServlet.java:901 |http://dispatcherservlet.java:901/]) at org.springframework.web.servlet.FrameworkServlet.processRequest([FrameworkServlet.java:970 |http://frameworkservlet.java:970/]) at org.springframework.web.servlet.FrameworkServlet.doGet([FrameworkServlet.java:861 |http://frameworkservlet.java:861/]) at javax.servlet.http.HttpServlet.service([HttpServlet.java:621 |http://httpservlet.java:621/]) at org.springframework.web.servlet.FrameworkServlet.service([FrameworkServlet.java:846 |http://frameworkservlet.java:846/]) at javax.servlet.http.HttpServlet.service([HttpServlet.java:728 |http://httpservlet.java:728/]) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter([ApplicationFilterChain.java |http://applicationfilterchain.java/]: 303) ..... at [org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run |http://org.apache.tomcat.util.net.jioendpoint%24socketprocessor.run/]([JIoEndpoint.java:317 |http://jioendpoint.java:317/]) at java.util.concurrent.ThreadPoolExecutor.runWorker([ThreadPoolExecutor.java:1149 |http://threadpoolexecutor.java:1149/]) at [java.util.concurrent.ThreadPoolExecutor$Worker.run |http://java.util.concurrent.threadpoolexecutor%24worker.run/]([ThreadPoolExecutor.java:624 |http://threadpoolexecutor.java:624/]) at [org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run |http://org.apache.tomcat.util.threads.taskthread%24wrappingrunnable.run/]([TaskThread.java:61 |http://taskthread.java:61/]) at [java.lang.Thread.run |http://java.lang.thread.run/]([Thread.java:748 |http://thread.java:748/]) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke([NativeMethodAccessorImpl.java:62 |http://nativemethodaccessorimpl.java:62/]) at sun.reflect.DelegatingMethodAccessorImpl.invoke([DelegatingMethodAccessorImpl.java:43 |http://delegatingmethodaccessorimpl.java:43/]) at java.lang.reflect.Method.invoke([Method.java:498 |http://method.java:498/]) at org.apache.kylin.source.hive.HiveMetaStoreClientFactory.getHiveMetaStoreClient(HiveMetaStoreC [lientFactory.java:53 |http://lientfactory.java:53/]) ... 81 more Caused by: com.google.common.util.concurrent.ExecutionError: java.lang.NoSuchFieldError: INSTANCE at com.google.common.cache.LocalCache$Segment.get([LocalCache.java:2261 |http://localcache.java:2261/]) at com.google.common.cache.LocalCache.get([LocalCache.java:4000 |http://localcache.java:4000/]) at com.google.common.cache.LocalCache$LocalManualCache.get([LocalCache.java:4789 |http://localcache.java:4789/]) at org.apache.hive.hcatalog.common.HiveClientCache.getOrCreate([HiveClientCache.java:316 |http://hiveclientcache.java:316/]) at org.apache.hive.hcatalog.common.HiveClientCache.get([HiveClientCache.java:278 |http://hiveclientcache.java:278/]) at org.apache.hive.hcatalog.common.HCatUtil.getHiveMetastoreClient([HCatUtil.java:558 |http://hcatutil.java:558/]) ... 86 more Caused by: java.lang.NoSuchFieldError: INSTANCE at org.apache.http.conn.ssl.SSLConnectionSocketFactory.<clinit>([SSLConnectionSocketFactory.java |http://sslconnectionsocketfactory.java/]: 151) at com.amazonaws.http.apache.client.impl.ApacheConnectionManagerFactory.getPreferredSocketFactor y([ApacheConnectionManagerFactory.java:89 |http://apacheconnectionmanagerfactory.java:89/]) at com.amazonaws.http.apache.client.impl.ApacheConnectionManagerFactory.create(ApacheConnectionM [anagerFactory.java:66 |http://anagerfactory.java:66/]) at com.amazonaws.http.apache.client.impl.ApacheConnectionManagerFactory.create(ApacheConnectionM [anagerFactory.java:59 |http://anagerfactory.java:59/]) at com.amazonaws.http.apache.client.impl.ApacheHttpClientFactory.create(ApacheHttpClientFactory. java:50) at com.amazonaws.http.apache.client.impl.ApacheHttpClientFactory.create(ApacheHttpClientFactory. java:38)



--
This message was sent by Atlassian Jira
(v8.20.1#820001)