You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Josh Rosen (JIRA)" <ji...@apache.org> on 2014/11/21 00:30:34 UTC

[jira] [Created] (SPARK-4524) Add documentation on packaging Python dependencies / installing them on clusters

Josh Rosen created SPARK-4524:
---------------------------------

             Summary: Add documentation on packaging Python dependencies / installing them on clusters
                 Key: SPARK-4524
                 URL: https://issues.apache.org/jira/browse/SPARK-4524
             Project: Spark
          Issue Type: New Feature
          Components: Documentation
            Reporter: Josh Rosen


The documentation should have a section on ways to package Python dependencies, add them to jobs, install them on clusters, etc. with an overview of the different mechanisms and discussion of best practices.

This could incorporate some information from https://stackoverflow.com/questions/24686474/shipping-python-modules-in-pyspark-to-other-nodes/24686708#24686708



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org