You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2021/06/15 12:20:54 UTC

[GitHub] [dolphinscheduler] wangmingzhiJohn opened a new issue #5636: [Question] How to import third-party module conveniently in a Python task from the perspective of a normal user

wangmingzhiJohn opened a new issue #5636:
URL: https://github.com/apache/dolphinscheduler/issues/5636


   **Describe the question**
   If I am a normal user to use this product, I want to create a python task which needs to import like tensorflow or sth else. As there is  not any third-party module in the environment of worker's container, it will fail to import those modules.
   So. my question is, how can I achieve my goal in a simple way?
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #5636: [Question] How to import third-party module conveniently in a Python task from the perspective of a normal user

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #5636:
URL: https://github.com/apache/dolphinscheduler/issues/5636#issuecomment-861451608






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [dolphinscheduler] wangmingzhiJohn commented on issue #5636: [Question] How to import third-party module conveniently in a Python task from the perspective of a normal user

Posted by GitBox <gi...@apache.org>.
wangmingzhiJohn commented on issue #5636:
URL: https://github.com/apache/dolphinscheduler/issues/5636#issuecomment-861468547


   One more word, I don't think it is a wise or efficient way to use Resources to provide the needed module. And also, we cannot provide all modules in docker which will make the image too big.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [dolphinscheduler] chengshiwen closed issue #5636: [Question] How to import third-party module conveniently in a Python task from the perspective of a normal user

Posted by GitBox <gi...@apache.org>.
chengshiwen closed issue #5636:
URL: https://github.com/apache/dolphinscheduler/issues/5636


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [dolphinscheduler] chengshiwen commented on issue #5636: [Question] How to import third-party module conveniently in a Python task from the perspective of a normal user

Posted by GitBox <gi...@apache.org>.
chengshiwen commented on issue #5636:
URL: https://github.com/apache/dolphinscheduler/issues/5636#issuecomment-872716913


   Close since it has been replied


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [dolphinscheduler] chengshiwen commented on issue #5636: [Question] How to import third-party module conveniently in a Python task from the perspective of a normal user

Posted by GitBox <gi...@apache.org>.
chengshiwen commented on issue #5636:
URL: https://github.com/apache/dolphinscheduler/issues/5636#issuecomment-862101972


   @wangdazhong001 Please refer to https://dolphinscheduler.apache.org/en-us/docs/1.3.6/user_doc/docker-deployment.html, and you can choose
   - Build a new image like **How to support Python 2 pip and custom requirements.txt** or **How to support Python 3**
   - Mount and share a volume like **How to support Hadoop, Spark, Flink, Hive or DataX**


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org