[GitHub] [spark] skonto edited a comment on issue #25870: [SPARK-27936][K8S] support python deps

[GitBox <gi...@apache.org>]

skonto edited a comment on issue #25870: [SPARK-27936][K8S] support python deps
URL: https://github.com/apache/spark/pull/25870#issuecomment-542699076
 
 
   @erikerlandson I added one test which uses a zip file as we discussed previously: 
   ```
   ls tests/
   py_container_checks.py   py_container_checks.zip  pyfiles.py               worker_memory_check.py
   
   Run starting. Expected test count is: 3
   KubernetesSuite:
   - Launcher java client dependencies
   - Launcher python client dependencies using py
   - Launcher python client dependencies using a zip file
   ```
   In general there are many ways to run a python Spark job:
   https://medium.com/criteo-labs/packaging-code-with-pex-a-pyspark-example-9057f9f144f3
   but at least we cover the basic ones.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org