You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@yunikorn.apache.org by "Craig Condit (Jira)" <ji...@apache.org> on 2021/12/08 19:47:00 UTC
[jira] [Created] (YUNIKORN-971) Implement YuniKorn as a Kubernetes Scheduler Plugin
Craig Condit created YUNIKORN-971:
-------------------------------------
Summary: Implement YuniKorn as a Kubernetes Scheduler Plugin
Key: YUNIKORN-971
URL: https://issues.apache.org/jira/browse/YUNIKORN-971
Project: Apache YuniKorn
Issue Type: New Feature
Components: shim - kubernetes
Reporter: Craig Condit
Assignee: Craig Condit
Attachments: YuniKorn as K8S Scheduler Plugin.pdf
As of Kubernetes 1.19, there is a new [scheduling framework|https://kubernetes.io/docs/concepts/scheduling-eviction/scheduling-framework/] available to scheduler implementations. This exposes all the functionality of the default Kubernetes scheduler, but allows plugins to be added which augment and extend the default scheduler functionality.
We should explore implementing YuniKorn using this new framework. See attached design document for rationale and approach.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@yunikorn.apache.org
For additional commands, e-mail: dev-help@yunikorn.apache.org
Announcement: New K8s scheduler plugin mode for YuniKorn (experimental)
Posted by Craig Condit <ap...@craigcondit.com>.
On Dec 8, 2021, at 1:47 PM, Craig Condit (Jira) <ji...@apache.org> wrote:
>
> Craig Condit created YUNIKORN-971:
> -------------------------------------
>
> Summary: Implement YuniKorn as a Kubernetes Scheduler Plugin
> Key: YUNIKORN-971
> URL: https://issues.apache.org/jira/browse/YUNIKORN-971
> Project: Apache YuniKorn
> Issue Type: New Feature
> Components: shim - kubernetes
> Attachments: YuniKorn as K8S Scheduler Plugin.pdf
All,
Since this is a fairly large feature, I wanted to make sure we had proper visibility on the dev mailing list for this one.
The intention here is to provide an alternative execution model for YuniKorn on Kubernetes which utilizes the K8S Scheduling Framework (see https://kubernetes.io/docs/concepts/scheduling-eviction/scheduling-framework/ <https://kubernetes.io/docs/concepts/scheduling-eviction/scheduling-framework/>). This will allow us to better match features and behavior with the upstream scheduler as well as allow us to bypass YuniKorn-specific scheduling functionality in certain cases (i.e. pods not marked with an applicationId).
This feature should be considered experimental for now, and it does not affect the default build of YuniKorn.
Please do try it out and let us know how it works for you. The hope is that we can provide it as a tech preview for the YuniKorn 1.0 release early in 2022.
JIRA Issue: https://issues.apache.org/jira/browse/YUNIKORN-971 <https://issues.apache.org/jira/browse/YUNIKORN-971>
Initial PR: https://github.com/apache/incubator-yunikorn-k8shim/pull/336 <https://github.com/apache/incubator-yunikorn-k8shim/pull/336>
Thanks,
Craig