[GitHub] [dolphinscheduler] xiaoshengaimm opened a new issue, #13199: [Workflow][Dag] Can dolphinscheduler support spark dag immediately?

[GitBox <gi...@apache.org>]

xiaoshengaimm opened a new issue, #13199:
URL: https://github.com/apache/dolphinscheduler/issues/13199

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar feature requirement.
   
   
   ### Description
   
   Dolphinscheduler can support spark dag on workflow console and generate python script to spark cluster.
   
   Now if we want to create spark complicated DAG we only can write python script and submit to dolphinscheduler one dag node. It's hard to spark newer.
   
   As I know AWS Glue can do it. Can Dolphinscheduler support it?
   ![image](https://user-images.githubusercontent.com/1866149/207811229-49e6f2b1-2667-443b-a582-617fff4456ee.png)
   
   
   ### Use case
   
   _No response_
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #13199: [Workflow][Dag] Can dolphinscheduler support spark dag immediately?

[GitBox <gi...@apache.org>]

github-actions[bot] commented on issue #13199:
URL: https://github.com/apache/dolphinscheduler/issues/13199#issuecomment-1352720534

   Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
   * In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
   * If you haven't received a reply for a long time, you can [join our slack](https://s.apache.org/dolphinscheduler-slack) and send your question to channel `#troubleshooting`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [dolphinscheduler] Radeity commented on issue #13199: [Workflow][Dag] Can dolphinscheduler support spark dag immediately?

[GitBox <gi...@apache.org>]

Radeity commented on issue #13199:
URL: https://github.com/apache/dolphinscheduler/issues/13199#issuecomment-1354206330

   Hi, @xiaoshengaimm, thanks for your suggestion! Some personal view, DS should focus on **scheduling** different types of tasks. Rather, AWS Glue provides a data integration service, one ETL job can be seen as a specific task in DS. Maybe Seatunnel can integrate this feature in the future. WDYT?
   
   Welcome to discuss about it ~~


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org