You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@shardingsphere.apache.org by GitBox <gi...@apache.org> on 2020/08/18 07:51:39 UTC

[GitHub] [shardingsphere-elasticjob] kaihekaihe opened a new issue #1383: will elasticjob submit jobs running on k8s or yarn?

kaihekaihe opened a new issue #1383:
URL: https://github.com/apache/shardingsphere-elasticjob/issues/1383


   ## Feature Request
   
   **For English only**, other languages will not accept.
   
   Please pay attention on issues you submitted, because we maybe need more details. 
   If no response anymore and we cannot make decision by current information, we will **close it**.
   
   Please answer these questions before submitting your issue. Thanks!
   
   ### Is your feature request related to a problem?
   
   ### Describe the feature you would like.
   
   1、we know elasticjob cloud submit jobs running on mesos.in recent years, k8s is more widely used in many companies for resource management than mesos,so will elasticjob submit jobs running on k8s in the future?
   
   2、yarn does better in big data jobs such as map reduce and support more complicated dag work flow,so will elasticjob submit jobs running on yarn in the future?
   
   3、other plans on mitigating relying on zookeeper as zookeeper limit the performance when running large quality of jobs


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere-elasticjob] terrymanu commented on issue #1383: will elasticjob submit jobs running on k8s or yarn?

Posted by GitBox <gi...@apache.org>.
terrymanu commented on issue #1383:
URL: https://github.com/apache/shardingsphere-elasticjob/issues/1383#issuecomment-675568864


   We are consider about running on k8s, no plan for yarn now.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere-elasticjob] terrymanu commented on issue #1383: will elasticjob submit jobs running on k8s or yarn?

Posted by GitBox <gi...@apache.org>.
terrymanu commented on issue #1383:
URL: https://github.com/apache/shardingsphere-elasticjob/issues/1383#issuecomment-675574125


   The most important thing is not support K8S, but extract schedule module from mesos and can run independent.
   Then we can consider about how to use the independent schedule module and resource assign module work together.
   
   This is a big change, so I'd like do schedule and executor split in version 3.1.x, the version 3.0.x should focus on RESTful API and DAG.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere-elasticjob] Technoboy- commented on issue #1383: will elasticjob submit jobs running on k8s or yarn?

Posted by GitBox <gi...@apache.org>.
Technoboy- commented on issue #1383:
URL: https://github.com/apache/shardingsphere-elasticjob/issues/1383#issuecomment-675332505


   For the 1 and 2, I think they are the same features about centralized-scheduling and executing. They are big features, and welcome to join the community to discuss for more details. If you're interested, please add my id : 465553115.
   
   RegCenter is now designed by SPI, you can support to implement others.
   > other plans on mitigating relying on zookeeper as zookeeper limit the performance when running large quality of jobs


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org