You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2015/11/07 00:18:11 UTC
[jira] [Commented] (SPARK-11140) Replace file server in driver with
RPC-based alternative
[ https://issues.apache.org/jira/browse/SPARK-11140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994673#comment-14994673 ]
Apache Spark commented on SPARK-11140:
--------------------------------------
User 'vanzin' has created a pull request for this issue:
https://github.com/apache/spark/pull/9530
> Replace file server in driver with RPC-based alternative
> --------------------------------------------------------
>
> Key: SPARK-11140
> URL: https://issues.apache.org/jira/browse/SPARK-11140
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
> Reporter: Marcelo Vanzin
>
> As part of making configuring encryption easy in Spark, it would be better to use the existing RPC channel between driver and executors to transfer files and jars added to the application.
> This would remove the need to start the HTTP server currently used for that purpose, which needs to be configured to use SSL if encryption is wanted. SSL is kinda hard to configure correctly in a multi-user, distributed environment.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org