You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2022/03/09 02:23:00 UTC
[jira] [Commented] (KYLIN-5160) kylin4无法连接AWS Glue元数据存储

    [ https://issues.apache.org/jira/browse/KYLIN-5160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17503258#comment-17503258 ] 

ASF GitHub Bot commented on KYLIN-5160:
---------------------------------------

hit-lacus merged pull request #1819:
URL: https://github.com/apache/kylin/pull/1819


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@kylin.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> kylin4无法连接AWS Glue元数据存储
> -----------------------
>
>                 Key: KYLIN-5160
>                 URL: https://issues.apache.org/jira/browse/KYLIN-5160
>             Project: Kylin
>          Issue Type: New Feature
>          Components: Metadata
>            Reporter: skyfeng
>            Priority: Major
>
> 在AWS EMR5.33版本中，连接AWS Glue时，报无法连接错误，在kylin3中使用是ok的。信息如下：
> 2021-11-23 02:35:05,254 ERROR [pool-5-thread-1] metadata.Hive : Unable to instantiate a metastore client factory com.amazonaws.glue.catalog.metastore.AWSGlueDataCatalogHiveClientFactory due to: java.lang.ClassNotFoundException: Class com.amazonaws.glue.catalog.metastore .AWSGlueDataCatalogHiveClientFactory not found java.lang.ClassNotFoundException: Class com.amazonaws.glue.catalog.metastore.AWSGlueDataCatalogHiveClientFactory not found at org.apache.hadoop.conf.Configuration.getClassByName([Configuration.java:2273 |http://configuration.java:2273/]) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClientFactory([Hive.java:3015 |http://hive.java:3015/]) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient([Hive.java:3006 |http://hive.java:3006/])
>  
> 另一个日志如下：
> 2021-11-25 07:07:57,025 ERROR [http-bio-7070-exec-5] controller.TableController:200 : Unable to create M etaStoreClient for gluecatalog java.lang.IllegalStateException: Unable to create MetaStoreClient for gluecatalog at org.apache.kylin.source.hive.HiveMetaStoreClientFactory.getHiveMetaStoreClient(HiveMetaStoreC [lientFactory.java:55 |http://lientfactory.java:55/]) at org.apache.kylin.source.hive.CLIHiveClient.getMetaStoreClient([CLIHiveClient.java:164 |http://clihiveclient.java:164/]) at org.apache.kylin.source.hive.CLIHiveClient.getHiveDbNames([CLIHiveClient.java:118 |http://clihiveclient.java:118/]) at org.apache.kylin.source.hive.HiveMetadataExplorer.listDatabases([HiveMetadataExplorer.java:51 |http://hivemetadataexplorer.java:51/]) at org.apache.kylin.rest.service.TableService.getSourceDbNames([TableService.java:274 |http://tableservice.java:274/]) at org.apache.kylin.rest.controller.TableController.showHiveDatabases([TableController.java:198 |http://tablecontroller.java:198/]) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke([NativeMethodAccessorImpl.java:62 |http://nativemethodaccessorimpl.java:62/]) at sun.reflect.DelegatingMethodAccessorImpl.invoke([DelegatingMethodAccessorImpl.java:43 |http://delegatingmethodaccessorimpl.java:43/]) at java.lang.reflect.Method.invoke([Method.java:498 |http://method.java:498/]) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod .java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandl [erMethod.java:133 |http://ermethod.java:133/]) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAnd Handle([ServletInvocableHandlerMethod.java:97 |http://servletinvocablehandlermethod.java:97/]) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHand lerMethod([RequestMappingHandlerAdapter.java:854 |http://requestmappinghandleradapter.java:854/]) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInte rnal([RequestMappingHandlerAdapter.java:765 |http://requestmappinghandleradapter.java:765/]) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandle [rMethodAdapter.java:85 |http://rmethodadapter.java:85/]) at org.springframework.web.servlet.DispatcherServlet.doDispatch([DispatcherServlet.java:967 |http://dispatcherservlet.java:967/]) at org.springframework.web.servlet.DispatcherServlet.doService([DispatcherServlet.java:901 |http://dispatcherservlet.java:901/]) at org.springframework.web.servlet.FrameworkServlet.processRequest([FrameworkServlet.java:970 |http://frameworkservlet.java:970/]) at org.springframework.web.servlet.FrameworkServlet.doGet([FrameworkServlet.java:861 |http://frameworkservlet.java:861/]) at javax.servlet.http.HttpServlet.service([HttpServlet.java:621 |http://httpservlet.java:621/]) at org.springframework.web.servlet.FrameworkServlet.service([FrameworkServlet.java:846 |http://frameworkservlet.java:846/]) at javax.servlet.http.HttpServlet.service([HttpServlet.java:728 |http://httpservlet.java:728/]) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter([ApplicationFilterChain.java |http://applicationfilterchain.java/]: 303) ..... at [org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run |http://org.apache.tomcat.util.net.jioendpoint%24socketprocessor.run/]([JIoEndpoint.java:317 |http://jioendpoint.java:317/]) at java.util.concurrent.ThreadPoolExecutor.runWorker([ThreadPoolExecutor.java:1149 |http://threadpoolexecutor.java:1149/]) at [java.util.concurrent.ThreadPoolExecutor$Worker.run |http://java.util.concurrent.threadpoolexecutor%24worker.run/]([ThreadPoolExecutor.java:624 |http://threadpoolexecutor.java:624/]) at [org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run |http://org.apache.tomcat.util.threads.taskthread%24wrappingrunnable.run/]([TaskThread.java:61 |http://taskthread.java:61/]) at [java.lang.Thread.run |http://java.lang.thread.run/]([Thread.java:748 |http://thread.java:748/]) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke([NativeMethodAccessorImpl.java:62 |http://nativemethodaccessorimpl.java:62/]) at sun.reflect.DelegatingMethodAccessorImpl.invoke([DelegatingMethodAccessorImpl.java:43 |http://delegatingmethodaccessorimpl.java:43/]) at java.lang.reflect.Method.invoke([Method.java:498 |http://method.java:498/]) at org.apache.kylin.source.hive.HiveMetaStoreClientFactory.getHiveMetaStoreClient(HiveMetaStoreC [lientFactory.java:53 |http://lientfactory.java:53/]) ... 81 more Caused by: com.google.common.util.concurrent.ExecutionError: java.lang.NoSuchFieldError: INSTANCE at com.google.common.cache.LocalCache$Segment.get([LocalCache.java:2261 |http://localcache.java:2261/]) at com.google.common.cache.LocalCache.get([LocalCache.java:4000 |http://localcache.java:4000/]) at com.google.common.cache.LocalCache$LocalManualCache.get([LocalCache.java:4789 |http://localcache.java:4789/]) at org.apache.hive.hcatalog.common.HiveClientCache.getOrCreate([HiveClientCache.java:316 |http://hiveclientcache.java:316/]) at org.apache.hive.hcatalog.common.HiveClientCache.get([HiveClientCache.java:278 |http://hiveclientcache.java:278/]) at org.apache.hive.hcatalog.common.HCatUtil.getHiveMetastoreClient([HCatUtil.java:558 |http://hcatutil.java:558/]) ... 86 more Caused by: java.lang.NoSuchFieldError: INSTANCE at org.apache.http.conn.ssl.SSLConnectionSocketFactory.<clinit>([SSLConnectionSocketFactory.java |http://sslconnectionsocketfactory.java/]: 151) at com.amazonaws.http.apache.client.impl.ApacheConnectionManagerFactory.getPreferredSocketFactor y([ApacheConnectionManagerFactory.java:89 |http://apacheconnectionmanagerfactory.java:89/]) at com.amazonaws.http.apache.client.impl.ApacheConnectionManagerFactory.create(ApacheConnectionM [anagerFactory.java:66 |http://anagerfactory.java:66/]) at com.amazonaws.http.apache.client.impl.ApacheConnectionManagerFactory.create(ApacheConnectionM [anagerFactory.java:59 |http://anagerfactory.java:59/]) at com.amazonaws.http.apache.client.impl.ApacheHttpClientFactory.create(ApacheHttpClientFactory. java:50) at com.amazonaws.http.apache.client.impl.ApacheHttpClientFactory.create(ApacheHttpClientFactory. java:38)



--
This message was sent by Atlassian Jira
(v8.20.1#820001)