You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2017/05/24 00:01:04 UTC

[jira] [Commented] (SPARK-20860) Make spark-submit download remote files to local in client mode

    [ https://issues.apache.org/jira/browse/SPARK-20860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022120#comment-16022120 ] 

Apache Spark commented on SPARK-20860:
--------------------------------------

User 'loneknightpy' has created a pull request for this issue:
https://github.com/apache/spark/pull/18078

> Make spark-submit download remote files to local in client mode
> ---------------------------------------------------------------
>
>                 Key: SPARK-20860
>                 URL: https://issues.apache.org/jira/browse/SPARK-20860
>             Project: Spark
>          Issue Type: New Feature
>          Components: Deploy
>    Affects Versions: 2.2.0
>            Reporter: Yu Peng
>
> Currently, spark-submit script doesn't allow remote files in client mode. It would be great to make it able to download remote files (e.g. files on S3) to local before executing the spark application. 
> cc: [~mengxr] [~joshrosen]



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org