[jira] [Created] (SPARK-37134) documentation - unclear "Using PySpark Native Features"

["carl rees (Jira)" <ji...@apache.org>]

carl rees created SPARK-37134:
---------------------------------

             Summary: documentation - unclear "Using PySpark Native Features"
                 Key: SPARK-37134
                 URL: https://issues.apache.org/jira/browse/SPARK-37134
             Project: Spark
          Issue Type: Improvement
          Components: Documentation
    Affects Versions: 1.6.2
         Environment: ?
            Reporter: carl rees
             Fix For: 1.6.2


sorry, no idea on the version it affects or what Shepard is? no explanation on this form so guessed whatever!

 

This page of your documentation is UNCLEAR

paragraph "Using PySpark Native Features" QUOTE

"PySpark allows to upload Python files ({{.py}}), zipped Python packages ({{.zip}}), and Egg files ({{.egg}}) to the executors by:
 * Setting the configuration setting {{spark.submit.pyFiles}}

 * Setting {{--py-files}} option in Spark scripts

 * Directly calling [{{pyspark.SparkContext.addPyFile()}}|https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.SparkContext.addPyFile.html#pyspark.SparkContext.addPyFile] in applications

 

QUESTION: is this all of the above or each of the above steps?

 

[https://spark.apache.org/docs/latest/api/python/user_guide/python_packaging.html]

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org