You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@livy.apache.org by "Zach York (JIRA)" <ji...@apache.org> on 2019/01/23 23:00:00 UTC
[jira] [Commented] (LIVY-549) Livy submit application exist [hdfs
delegation token] error
[ https://issues.apache.org/jira/browse/LIVY-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16750512#comment-16750512 ]
Zach York commented on LIVY-549:
--------------------------------
If you're using impersonation with livy, wouldn't the job have the Livy principal and keytab? Does that not work? What error are you receiving?
Btw, this is probably a better question for the user or dev lists.
> Livy submit application exist [hdfs delegation token] error
> -----------------------------------------------------------
>
> Key: LIVY-549
> URL: https://issues.apache.org/jira/browse/LIVY-549
> Project: Livy
> Issue Type: Question
> Components: API, Batch
> Affects Versions: 0.5.0
> Reporter: gejx
> Priority: Blocker
>
> I have already used to try spark-submit way with --principal and --keytab parameters. This way was successd.
> I have a Spark job where part of the work done on the executors includes POSTing to a SPNEGO-enabled REST API endpoint, and unless I'm mistaken, when Spark is running a job as a proxy user, the doAs() chain doesn't have the necessary credentials to actually do a SPNEGO negotiation.
> How can I use Livy to achieve this function. Thank You.
> spark version:2.3.1
> https://issues.cloudera.org/browse/LIVY-44?jql=labels%20%3D%20Hue
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)