You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/09/13 07:21:02 UTC
[GitHub] [dolphinscheduler] jieguangzhou opened a new issue, #11906: [Feature][PyDolphinScheduler] Support more task plugin in pydolphinscheduler
jieguangzhou opened a new issue, #11906:
URL: https://github.com/apache/dolphinscheduler/issues/11906
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar feature requirement.
### Description
DolphinScheduler has recently added a number of task plugins. We have to add more support in pydolphinscheduler.
List of types in DolphinScheduler: https://dolphinscheduler.apache.org/en-us/docs/dev/user_doc/guide/task/java.html
List of types in PydolphinScheduler: https://dolphinscheduler.apache.org/python/dev/tasks/index.html
There are task types in DolphinScheduler but not in PydolphinScheduler:
- [ ] Pigeon
- [ ] SeaTunnel
- [ ] Amazon EMR
- [ ] Apache Zepplin
- [ ] Jupyter
- [ ] Hive CLI
- [ ] Kubernetes
- [ ] MLflow
- [ ] OpenMLDB
- [ ] DVC
- [ ] Dinky
- [ ] Java
- [ ] SageMaker
- [ ] ChunJun
- [ ] Pytorch
### Use case
_No response_
### Related issues
_No response_
### Are you willing to submit a PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] jieguangzhou commented on issue #11906: [Feature][PyDolphinScheduler] Support more task plugin in pydolphinscheduler
Posted by GitBox <gi...@apache.org>.
jieguangzhou commented on issue #11906:
URL: https://github.com/apache/dolphinscheduler/issues/11906#issuecomment-1245036527
I will finish adding relevant components on my side first.
- [ ] MLflow
- [ ] DVC
- [ ] SageMaker
- [ ] Pytorch
If others are interested in contributing, they can comment on this issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] EricGao888 commented on issue #11906: [Feature][PyDolphinScheduler] Support more task plugin in pydolphinscheduler
Posted by GitBox <gi...@apache.org>.
EricGao888 commented on issue #11906:
URL: https://github.com/apache/dolphinscheduler/issues/11906#issuecomment-1245110609
> May i pick chunjun, Dinky and Java?
@DarkAssassinator @jieguangzhou Sure, thanks for the help! Could u plz create related sub-issues like this comment?https://github.com/apache/dolphinscheduler/issues/11906#issuecomment-1245011210 Thanks : )
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] EricGao888 commented on issue #11906: [Feature][PyDolphinScheduler] Support more task plugin in pydolphinscheduler
Posted by GitBox <gi...@apache.org>.
EricGao888 commented on issue #11906:
URL: https://github.com/apache/dolphinscheduler/issues/11906#issuecomment-1245011210
May I pick those plugins I contributed before? Jupyter, HiveCLI, Zeppelin 🤣 I could handle the corresponding tasks in pyds : )
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] jieguangzhou commented on issue #11906: [Feature][PyDolphinScheduler] Support more task plugin in pydolphinscheduler
Posted by GitBox <gi...@apache.org>.
jieguangzhou commented on issue #11906:
URL: https://github.com/apache/dolphinscheduler/issues/11906#issuecomment-1245018286
> May I pick those plugins I contributed before? Jupyter, HiveCLI, Zeppelin 🤣 I could handle the corresponding tasks in pyds : )
Of course.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #11906: [Feature][PyDolphinScheduler] Support more task plugin in pydolphinscheduler
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #11906:
URL: https://github.com/apache/dolphinscheduler/issues/11906#issuecomment-1245010225
Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
* In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
* If you haven't received a reply for a long time, you can [join our slack](https://s.apache.org/dolphinscheduler-slack) and send your question to channel `#troubleshooting`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] jieguangzhou commented on issue #11906: [Feature][PyDolphinScheduler] Support more task plugin in pydolphinscheduler
Posted by GitBox <gi...@apache.org>.
jieguangzhou commented on issue #11906:
URL: https://github.com/apache/dolphinscheduler/issues/11906#issuecomment-1245006680
@zhongjiajie @SbloodyS Can we add the tag of Good First Issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS commented on issue #11906: [Feature][PyDolphinScheduler] Support more task plugin in pydolphinscheduler
Posted by GitBox <gi...@apache.org>.
SbloodyS commented on issue #11906:
URL: https://github.com/apache/dolphinscheduler/issues/11906#issuecomment-1245008867
> @zhongjiajie @SbloodyS @EricGao888 Can we add the tag of Good First Issue?
Done.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] DarkAssassinator commented on issue #11906: [Feature][PyDolphinScheduler] Support more task plugin in pydolphinscheduler
Posted by GitBox <gi...@apache.org>.
DarkAssassinator commented on issue #11906:
URL: https://github.com/apache/dolphinscheduler/issues/11906#issuecomment-1245093317
May i pick chunjun, Dinky and Java?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org