You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Thomas Graves (JIRA)" <ji...@apache.org> on 2016/09/09 18:44:21 UTC
[jira] [Resolved] (SPARK-17433) YarnShuffleService doesn't handle
moving credentials levelDb
[ https://issues.apache.org/jira/browse/SPARK-17433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves resolved SPARK-17433.
-----------------------------------
Resolution: Fixed
Assignee: Thomas Graves
Fix Version/s: 2.1.0
> YarnShuffleService doesn't handle moving credentials levelDb
> ------------------------------------------------------------
>
> Key: SPARK-17433
> URL: https://issues.apache.org/jira/browse/SPARK-17433
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 2.1.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Fix For: 2.1.0
>
>
> In SPARK-16711, I added a leveldb to store credentials to fix an issue with NM restart. I missed that getRecoveryPath also handles moving the DB from the old local dirs to the yarn recoverypath. This routine is hardcoded for the registeredexecutors db and needs to be updated to handle the new credentials db I added.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org