You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Saisai Shao (JIRA)" <ji...@apache.org> on 2016/08/24 07:08:21 UTC

[jira] [Updated] (SPARK-17209) Support manual credential updating in the run-time for Spark on YARN

     [ https://issues.apache.org/jira/browse/SPARK-17209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Saisai Shao updated SPARK-17209:
--------------------------------
    Description: 
Current Spark on YARN supports time based credential renewal and updating, this mainly addresses the problem of token expiration for long running Spark applications.

But still there're some use cases in which security services will be changed in the run-time of Spark application. For example, user may want to change to access another HBase cluster or Hive Metastore service in the run-time, in such use cases credentials should be updated immediately by user explicitly, so that user could reconnect to new HBase cluster or Metastore service.

So here propose to add ability in Spark to manually trigger the credential updating in the run-time.

This is a follow-up work of SPARK-14743.

  was:
Current Spark on YARN supports time based credential renewal and updating, this mainly addresses the problem of token expiration for long running Spark applications.

But still there're some use cases in which security services will be changed in the run-time of Spark application. For example, user may want to change to access another HBase cluster or Hive Metastore service in the run-time, in such use cases credentials should be updated immediately by user explicitly, so that user could reconnect to new HBase cluster or Metastore service.

So here propose to add ability in Spark to manually trigger the credential updating in the run-time.

This is a follow-up works of SPARK-14743.


> Support manual credential updating in the run-time for Spark on YARN
> --------------------------------------------------------------------
>
>                 Key: SPARK-17209
>                 URL: https://issues.apache.org/jira/browse/SPARK-17209
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core, YARN
>            Reporter: Saisai Shao
>            Priority: Minor
>
> Current Spark on YARN supports time based credential renewal and updating, this mainly addresses the problem of token expiration for long running Spark applications.
> But still there're some use cases in which security services will be changed in the run-time of Spark application. For example, user may want to change to access another HBase cluster or Hive Metastore service in the run-time, in such use cases credentials should be updated immediately by user explicitly, so that user could reconnect to new HBase cluster or Metastore service.
> So here propose to add ability in Spark to manually trigger the credential updating in the run-time.
> This is a follow-up work of SPARK-14743.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org