You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2015/09/22 13:06:04 UTC

[jira] [Assigned] (SPARK-10755) Set the driver also update the token for long-running application

     [ https://issues.apache.org/jira/browse/SPARK-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-10755:
------------------------------------

    Assignee: Apache Spark

> Set the driver also update the token for long-running application
> -----------------------------------------------------------------
>
>                 Key: SPARK-10755
>                 URL: https://issues.apache.org/jira/browse/SPARK-10755
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 1.6.0
>            Reporter: SaintBacchus
>            Assignee: Apache Spark
>
> In the yarn-client mode, driver will write the event logs into hdfs and get the partition information from hdfs, so it's nessary to update the token from the *AMDelegationTokenRenewer*.
> In the yarn-cluster mode, driver is company with AM and token will update by AM. But it's still better to update the token for client process since the client wants to delete the staging dir with a expired token.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org