[GitHub] [dolphinscheduler] jieguangzhou opened a new issue, #10826: [Feature][Task Plugin] Add Amazon SageMaker pipeline task plugin

[GitBox <gi...@apache.org>]

jieguangzhou opened a new issue, #10826:
URL: https://github.com/apache/dolphinscheduler/issues/10826

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar feature requirement.
   
   
   ### Description
   
   Similar as [Amazon EMR Task Plugin](https://dolphinscheduler.apache.org/en-us/docs/latest/user_doc/guide/task/emr.html).
   
   We can integrate [SageMaker pipeline](https://docs.aws.amazon.com/sagemaker/latest/dg/pipelines-sdk.html), help data scientists to get through the data flow and Sagemaker.
   
   
   After we start the SageMaker pipeline task, it will create a [StartPipelineExecution](https://docs.aws.amazon.com/sagemaker/latest/APIReference/API_StartPipelineExecution.html) request and submit to AWS. 
   Then, the pipeline execution status is continuously monitored until the exit is normal or the pipeline execution fails.
   
   ### Use case
   
   Users can add SageMaker pipeline to connect machine learning workflow to data processing flows on the DS
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #10826: [Feature][Task Plugin] Add Amazon SageMaker pipeline task plugin

[GitBox <gi...@apache.org>]

github-actions[bot] commented on issue #10826:
URL: https://github.com/apache/dolphinscheduler/issues/10826#issuecomment-1177001742

   Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
   * In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
   * If you haven't received a reply for a long time, you can [join our slack](https://s.apache.org/dolphinscheduler-slack) and send your question to channel `#troubleshooting`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [dolphinscheduler] SbloodyS closed issue #10826: [Feature][Task Plugin] Add Amazon SageMaker pipeline task plugin

[GitBox <gi...@apache.org>]

SbloodyS closed issue #10826: [Feature][Task Plugin] Add Amazon SageMaker pipeline task plugin
URL: https://github.com/apache/dolphinscheduler/issues/10826


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org