You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/05/21 05:37:32 UTC
[jira] [Resolved] (SPARK-4524) Add documentation on packaging
Python dependencies / installing them on clusters
[ https://issues.apache.org/jira/browse/SPARK-4524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon resolved SPARK-4524.
---------------------------------
Resolution: Incomplete
> Add documentation on packaging Python dependencies / installing them on clusters
> --------------------------------------------------------------------------------
>
> Key: SPARK-4524
> URL: https://issues.apache.org/jira/browse/SPARK-4524
> Project: Spark
> Issue Type: New Feature
> Components: Documentation
> Reporter: Josh Rosen
> Priority: Major
> Labels: bulk-closed
>
> The documentation should have a section on ways to package Python dependencies, add them to jobs, install them on clusters, etc. with an overview of the different mechanisms and discussion of best practices.
> This could incorporate some information from https://stackoverflow.com/questions/24686474/shipping-python-modules-in-pyspark-to-other-nodes/24686708#24686708
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org