You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2020/09/15 05:41:57 UTC

[GitHub] [incubator-dolphinscheduler] geosmart opened a new issue #3747: [Improvement][spark task] pyspark task support select multipile files

geosmart opened a new issue #3747:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3747


   **Describe the question**
   in spark task type param config windows:
   1. when my task write by python , i can not select zip or egg
   2. when select python, the ui show  `Main jar package` ,should change to `python Files`
   
   ![image](https://user-images.githubusercontent.com/3156608/93169792-775d3000-f758-11ea-9610-426b159186f9.png)
   ![image](https://user-images.githubusercontent.com/3156608/93169840-98be1c00-f758-11ea-81f1-5d271b692c0d.png)
   
   [spark-2.3.2-submitting-applications](https://spark.apache.org/docs/2.3.2/submitting-applications.html)
   ```
   For Python, you can use the `--py-files` argument of spark-submit to add `.py`, `.zip` or `.egg` files to be distributed with your application. If you depend on multiple Python files we recommend packaging them into a .zip or .egg.
   ```
   
   **Which version of DolphinScheduler:**
    -[1.3.2-release]
   
   **Describe alternatives you've considered**
   * not use /list/jar to list pyfile,add common file select api ,and set jar/py as a param;
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org