You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Abhishek Talluri (JIRA)" <ji...@apache.org> on 2018/04/04 18:53:00 UTC

[jira] [Commented] (HBASE-15570) renewable delegation tokens for long-lived spark applications

    [ https://issues.apache.org/jira/browse/HBASE-15570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16426005#comment-16426005 ] 

Abhishek Talluri commented on HBASE-15570:
------------------------------------------

Is there any update if this has been handled in spark2 .. It's confusing to see SPARK-14743 moved to resolved state and this remains unresolved. I have a client who is looking for automatic renewal of HBase delegation token and we are unsure if this has been fixed.

> renewable delegation tokens for long-lived spark applications
> -------------------------------------------------------------
>
>                 Key: HBASE-15570
>                 URL: https://issues.apache.org/jira/browse/HBASE-15570
>             Project: HBase
>          Issue Type: Improvement
>          Components: spark
>            Reporter: Sean Busbey
>            Assignee: Sean Busbey
>            Priority: Major
>
> Right now our spark integration works on secure clusters by getting delegation tokens and sending them to the executors. Unfortunately, applications that need to run for longer than the delegation token lifetime (by default 7 days) will fail.
> In particular, this is an issue for Spark Streaming applications. Since they expect to run indefinitely, we should have a means for renewing the delegation tokens.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)