You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by "yeyhuan (via GitHub)" <gi...@apache.org> on 2024/09/14 07:30:43 UTC

[I] [Bug] [DataSource HIVE] Peer indicated failure: Unsupported mechanism type PLAIN [dolphinscheduler]

yeyhuan opened a new issue, #16624:
URL: https://github.com/apache/dolphinscheduler/issues/16624

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### What happened
   
   dolphinscheduler 3.1.3
   hive 3.1.3 
   auth kerberos
   
   Peer indicated failure: Unsupported mechanism type PLAIN
   
   ### What you expected to happen
   
   ```
   [ERROR] 2024-09-14 07:21:31.387 +0000 com.zaxxer.hikari.pool.HikariPool:[594] - HikariPool-6 - Exception during pool initialization.
   java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://10.235.15.35:7001/vap: Peer indicated failure: Unsupported mechanism type PLAIN
           at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:256)
           at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107)
           at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:138)
           at com.zaxxer.hikari.pool.PoolBase.newConnection(PoolBase.java:364)
           at com.zaxxer.hikari.pool.PoolBase.newPoolEntry(PoolBase.java:206)
           at com.zaxxer.hikari.pool.HikariPool.createPoolEntry(HikariPool.java:476)
           at com.zaxxer.hikari.pool.HikariPool.checkFailFast(HikariPool.java:561)
           at com.zaxxer.hikari.pool.HikariPool.<init>(HikariPool.java:115)
           at com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:112)
           at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:159)
           at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:117)
           at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:80)
           at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:376)
           at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:431)
           at org.apache.dolphinscheduler.plugin.datasource.api.client.CommonDataSourceClient.checkClient(CommonDataSourceClient.java:96)
           at org.apache.dolphinscheduler.plugin.datasource.api.client.CommonDataSourceClient.<init>(CommonDataSourceClient.java:54)
           at org.apache.dolphinscheduler.plugin.datasource.hive.HiveDataSourceClient.<init>(HiveDataSourceClient.java:65)
           at org.apache.dolphinscheduler.plugin.datasource.hive.HiveDataSourceChannel.createDataSourceClient(HiveDataSourceChannel.java:29)
           at org.apache.dolphinscheduler.plugin.datasource.api.plugin.DataSourceClientProvider.lambda$getConnection$1(DataSourceClientProvider.java:79)
           at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4868)
           at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3533)
           at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2282)
           at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2159)
           at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2049)
           at com.google.common.cache.LocalCache.get(LocalCache.java:3966)
           at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4863)
           at org.apache.dolphinscheduler.plugin.datasource.api.plugin.DataSourceClientProvider.getConnection(DataSourceClientProvider.java:73)
           at org.apache.dolphinscheduler.api.service.impl.DataSourceServiceImpl.checkConnection(DataSourceServiceImpl.java:364)
           at org.apache.dolphinscheduler.api.service.impl.DataSourceServiceImpl$$FastClassBySpringCGLIB$$a86d54aa.invoke(<generated>)
           at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
           at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386)
           at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85)
           at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704)
           at org.apache.dolphinscheduler.api.service.impl.DataSourceServiceImpl$$EnhancerBySpringCGLIB$$6901bfe7.checkConnection(<generated>)
           at org.apache.dolphinscheduler.api.controller.DataSourceController.connectDataSource(DataSourceController.java:220)
           at org.apache.dolphinscheduler.api.controller.DataSourceController$$FastClassBySpringCGLIB$$835fdd04.invoke(<generated>)
           at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
           at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793)
           at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
           at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)
           at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89)
           at org.apache.dolphinscheduler.api.aspect.AccessLogAspect.doAround(AccessLogAspect.java:102)
           at sun.reflect.GeneratedMethodAccessor186.invoke(Unknown Source)
           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
           at java.lang.reflect.Method.invoke(Method.java:498)
           at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)
           at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)
           at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)
           at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
           at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)
           at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
           at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
           at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)
           at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708)
           at org.apache.dolphinscheduler.api.controller.DataSourceController$$EnhancerBySpringCGLIB$$7820dcc.connectDataSource(<generated>)
           at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
           at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
           at java.lang.reflect.Method.invoke(Method.java:498)
           at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
           at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150)
           at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117)
           at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895)
           at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808)
           at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87)
           at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1070)
           at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:963)
           at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006)
           at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909)
           at javax.servlet.http.HttpServlet.service(HttpServlet.java:517)
           at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883)
           at javax.servlet.http.HttpServlet.service(HttpServlet.java:584)
           at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
           at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1656)
           at org.springframework.web.filter.CorsFilter.doFilterInternal(CorsFilter.java:91)
           at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
           at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
           at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
           at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)
           at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
           at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
           at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
           at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93)
           at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
           at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
           at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
           at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96)
           at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
           at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
           at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
           at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201)
           at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
           at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
           at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
           at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:552)
           at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
           at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600)
           at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
           at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)
           at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624)
           at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
           at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
           at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
           at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
           at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594)
           at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
           at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
           at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
           at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772)
           at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
           at org.eclipse.jetty.server.Server.handle(Server.java:516)
           at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
           at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
           at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
           at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
           at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
           at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
           at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
           at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
           at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
           at java.lang.Thread.run(Thread.java:750)
   Caused by: org.apache.thrift.transport.TTransportException: Peer indicated failure: Unsupported mechanism type PLAIN
           at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:199)
           at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:307)
           at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
           at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:343)
           at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:228)
           ... 120 common frames omitted
   [INFO] 2024-09-14 07:21:31.387 +0000 org.apache.dolphinscheduler.plugin.datasource.api.client.CommonDataSourceClient:[100] - Time to execute check jdbc client with sql select 1 for 1002 ms 
   [ERROR] 2024-09-14 07:21:31.387 +0000 org.apache.dolphinscheduler.api.service.impl.DataSourceServiceImpl:[375] - datasource test connection error, dbType:HIVE, connectionParam:HiveConnectionParam{user='hadoop', password='', address='jdbc:hive2://10.235.15.35:7001', database='vap', jdbcUrl='jdbc:hive2://10.235.15.35:7001/vap', driverLocation='null', driverClassName='org.apache.hive.jdbc.HiveDriver', validationQuery='select 1', other='null', principal='hadoop/10.235.15.35@EMR-1565XRM8', javaSecurityKrb5Conf='/etc/krb5.conf', loginUserKeytabUsername='hadoop/10.235.15.35@EMR-1565XRM8', loginUserKeytabPath='/data/execute_dir/dolphinscheduler/bin/ds.keytab'}, message:JDBC connect failed.
   ```
   linux shell Connection success
   ![image](https://github.com/user-attachments/assets/229971cf-f4dd-42bb-9180-df7d1e6359ab)
   
   dolphinscheduler connection failed
   ![image](https://github.com/user-attachments/assets/dc0aa7a7-446a-4ce1-a80d-2c52f6c2460d)
   
   
   ### How to reproduce
   
   not success
   
   ### Anything else
   
   _No response_
   
   ### Version
   
   3.1.x
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug] [DataSource HIVE] Peer indicated failure: Unsupported mechanism type PLAIN [dolphinscheduler]

Posted by "yeyhuan (via GitHub)" <gi...@apache.org>.
yeyhuan commented on issue #16624:
URL: https://github.com/apache/dolphinscheduler/issues/16624#issuecomment-2350893764

   I tried replacing the following dependencies with hive3.1.3, but it didn't work.
   hive-common-2.3.9.jar
   hive-jdbc-2.3.9.jar
   hive-metastore-2.3.9.jar
   hive-serde-2.3.9.jar
   hive-service-2.3.9.jar
   hive-service-rpc-2.3.9.jar
   hive-storage-api-2.4.0.jar


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug] [DataSource HIVE] Peer indicated failure: Unsupported mechanism type PLAIN [dolphinscheduler]

Posted by "SbloodyS (via GitHub)" <gi...@apache.org>.
SbloodyS closed issue #16624: [Bug] [DataSource HIVE]  Peer indicated failure: Unsupported mechanism type PLAIN
URL: https://github.com/apache/dolphinscheduler/issues/16624


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org