You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/05/21 04:20:08 UTC
[jira] [Updated] (SPARK-12943) spark should distribute truststore
if used in yarn-cluster mode
[ https://issues.apache.org/jira/browse/SPARK-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon updated SPARK-12943:
---------------------------------
Labels: bulk-closed (was: )
> spark should distribute truststore if used in yarn-cluster mode
> ---------------------------------------------------------------
>
> Key: SPARK-12943
> URL: https://issues.apache.org/jira/browse/SPARK-12943
> Project: Spark
> Issue Type: Improvement
> Components: YARN
> Affects Versions: 1.5.2
> Reporter: John Vines
> Priority: Major
> Labels: bulk-closed
>
> spark.ssl.trustStore is used to specify the truststore to use for SSL. It is described somewhat at http://spark.apache.org/docs/1.5.2/configuration.html#security
> What it does not specify is that, when used in yarn environments, it must be an absolute path available on all nodes.
> In an ideal world, it would recognize it's in yarn-cluster mode, put that file in the distributed cache, and then update the local conf in each driver/executor to the local path to use they're local version.
> Or at the very least, the docs could be clearer that it's incompatible with yarn-cluster mode unless you give it a path that's available on all nodes.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org