You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Andrew Or (JIRA)" <ji...@apache.org> on 2015/12/29 23:26:49 UTC

[jira] [Created] (SPARK-12565) Document standalone mode jar distribution more clearly

Andrew Or created SPARK-12565:
---------------------------------

             Summary: Document standalone mode jar distribution more clearly
                 Key: SPARK-12565
                 URL: https://issues.apache.org/jira/browse/SPARK-12565
             Project: Spark
          Issue Type: Improvement
          Components: Documentation
    Affects Versions: 1.0.0
            Reporter: Andrew Or


There's a lot of confusion on the mailing list about how jars are distributed. The existing docs are partially responsible for this:

{quote}
If your application is launched through Spark submit, then the application jar is automatically distributed to all worker nodes.
{quote}

This makes it seem like even in cluster mode, the jars are uploaded from the client (machine running Spark submit) to the cluster, which is not true.

We should clarify the documentation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org