You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@kyuubi.apache.org by GitBox <gi...@apache.org> on 2022/06/08 15:15:41 UTC
[GitHub] [incubator-kyuubi] cxzl25 opened a new pull request, #2832: [KYUUBI #2831] Spark engine supports local mode in kerberos environment
cxzl25 opened a new pull request, #2832:
URL: https://github.com/apache/incubator-kyuubi/pull/2832
### _Why are the changes needed?_
Now in the kerberos environment, the spark engine cannot access the Hive meta store using `spark-submit --master=local --proxy-user xxx`.
```
beeline -u "jdbc:hive2://XXXX/default;principal=XXXX/_HOST@XXXX;#kyuubi.engine.share.level=CONNECTION;spark.master=local;spark.submit.deployMode=client;"
```
```
javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1743)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:483)
```
close #2831
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests) locally before make a pull request
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] pan3793 commented on pull request #2832: [KYUUBI #2831] Spark engine supports local mode in kerberos environment
Posted by GitBox <gi...@apache.org>.
pan3793 commented on PR #2832:
URL: https://github.com/apache/incubator-kyuubi/pull/2832#issuecomment-1150065585
We have Kerberos-enabled HMS in kyuubi-server test, better to add test for it.
cc @zhouyifan279
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] ulysses-you commented on pull request #2832: [KYUUBI #2831] Spark engine supports local mode in kerberos environment
Posted by GitBox <gi...@apache.org>.
ulysses-you commented on PR #2832:
URL: https://github.com/apache/incubator-kyuubi/pull/2832#issuecomment-1150578582
this remind me a stale pr in Spark... https://github.com/apache/spark/pull/32009
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] yaooqinn commented on pull request #2832: [KYUUBI #2831] Spark engine supports local mode in kerberos environment
Posted by GitBox <gi...@apache.org>.
yaooqinn commented on PR #2832:
URL: https://github.com/apache/incubator-kyuubi/pull/2832#issuecomment-1150601440
I guess we can fix this by resolving this issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] yaooqinn commented on pull request #2832: [KYUUBI #2831] Spark engine supports local mode in kerberos environment
Posted by GitBox <gi...@apache.org>.
yaooqinn commented on PR #2832:
URL: https://github.com/apache/incubator-kyuubi/pull/2832#issuecomment-1150606870
> I guess we can fix this by resolving this issue
I mean this.... https://github.com/apache/incubator-kyuubi/issues/2708
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] cxzl25 commented on pull request #2832: [KYUUBI #2831] Spark engine supports local mode in kerberos environment
Posted by GitBox <gi...@apache.org>.
cxzl25 commented on PR #2832:
URL: https://github.com/apache/incubator-kyuubi/pull/2832#issuecomment-1150071780
> We have Kerberos-enabled HMS in kyuubi-server test, better to add test for it.
OK, let me investigate how to add a test for this scenario.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] cxzl25 closed pull request #2832: [KYUUBI #2831] Spark engine supports local mode in kerberos environment
Posted by GitBox <gi...@apache.org>.
cxzl25 closed pull request #2832: [KYUUBI #2831] Spark engine supports local mode in kerberos environment
URL: https://github.com/apache/incubator-kyuubi/pull/2832
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] ulysses-you commented on pull request #2832: [KYUUBI #2831] Spark engine supports local mode in kerberos environment
Posted by GitBox <gi...@apache.org>.
ulysses-you commented on PR #2832:
URL: https://github.com/apache/incubator-kyuubi/pull/2832#issuecomment-1150624335
> I mean this.... https://github.com/apache/incubator-kyuubi/issues/2708
cc @lightning-L @turboFei
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] turboFei commented on pull request #2832: [KYUUBI #2831] Spark engine supports local mode in kerberos environment
Posted by GitBox <gi...@apache.org>.
turboFei commented on PR #2832:
URL: https://github.com/apache/incubator-kyuubi/pull/2832#issuecomment-1150638251
> I guess we can fix this by resolving this issue
Yes, seems it can be fixed by this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] cxzl25 commented on pull request #2832: [KYUUBI #2831] Spark engine supports local mode in kerberos environment
Posted by GitBox <gi...@apache.org>.
cxzl25 commented on PR #2832:
URL: https://github.com/apache/incubator-kyuubi/pull/2832#issuecomment-1150695092
> this remind me a stale pr in Spark... [apache/spark#32009](https://github.com/apache/spark/pull/32009)
Thanks for pointing it out, I made a similar PR last night and I'm marking it as a duplicate now.
> Yes, seems it can be fixed by this.
Closed in favour of https://github.com/apache/incubator-kyuubi/issues/2708
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org