You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@amoro.apache.org by "turboFei (via GitHub)" <gi...@apache.org> on 2025/10/25 06:13:59 UTC

[I] [Feature]: Support to submit spark application via Kyuubi [amoro]

turboFei opened a new issue, #3843:
URL: https://github.com/apache/amoro/issues/3843

   ### Description
   
   For spark optimizer container, now it submit spark app with spark-submit command only.
   
   It is better that we can support to submit spark app via kyuubi, which is light weight and convenient.
   
   
   ### Use case/motivation
   
   With submitting spark app via Kyuubi.
   1. it does not to need to setup spark/hadoop env on amoro node.
   2. It is more lightweight and stateless for amoro optimizer container.
   3. kyuubi support batch recovery and HA, which is more stable.
   
   ### Describe the solution
   
   Call restful api to submit spark app, https://kyuubi.readthedocs.io/en/master/client/rest/rest_api.html#batch-resource
   
   
   ### Subtasks
   
   _No response_
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Feature]: Support to submit spark application via Kyuubi [amoro]

Posted by "turboFei (via GitHub)" <gi...@apache.org>.
turboFei closed issue #3843: [Feature]: Support to submit spark application via Kyuubi
URL: https://github.com/apache/amoro/issues/3843


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org