You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sunayan Saikia (JIRA)" <ji...@apache.org> on 2018/10/19 06:16:00 UTC
[jira] [Comment Edited] (SPARK-13478) Fetching delegation tokens
for Hive fails when using proxy users
[ https://issues.apache.org/jira/browse/SPARK-13478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16656320#comment-16656320 ]
Sunayan Saikia edited comment on SPARK-13478 at 10/19/18 6:15 AM:
------------------------------------------------------------------
[~vanzin]: If I want to 'spark-submit' with keytab plus principal and still use a proxy user, how will I accomplish this in deploy mode 'cluster'. For, 'client' deploy mode things would probably work if I do a 'kinit' first in the shell and then execute 'spark-submit'. So, will the same method work for 'cluster' deploy mode?
was (Author: sunayansaikia):
[~vanzin]: If I want to 'spark-submit' with l keytab plus principal and still use a proxy user, how will I accomplish this in deploy mode 'cluster'. For, 'client' deploy mode things would probably work if I do a 'kinit' first in the shell and then execute 'spark-submit'. So, will the same method work for 'cluster' deploy mode?
> Fetching delegation tokens for Hive fails when using proxy users
> ----------------------------------------------------------------
>
> Key: SPARK-13478
> URL: https://issues.apache.org/jira/browse/SPARK-13478
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.6.0, 2.0.0
> Reporter: Marcelo Vanzin
> Assignee: Marcelo Vanzin
> Priority: Minor
> Fix For: 1.6.4, 2.0.0
>
>
> If you use spark-submit's proxy user support, the code that fetches delegation tokens for the Hive Metastore fails. It seems like the Hive library tries to connect to the Metastore as the proxy user, and it doesn't have a Kerberos TGT for that user, so it fails.
> I don't know whether the same issue exists in the HBase code, but I'll make a similar change so that both behave similarly.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org