You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@yunikorn.apache.org by "Junyoung Park (Jira)" <ji...@apache.org> on 2023/04/26 14:49:00 UTC

[jira] [Created] (YUNIKORN-1708) Filtered owner references for placeholder pods.

Junyoung Park created YUNIKORN-1708:
---------------------------------------

             Summary: Filtered owner references for placeholder pods.
                 Key: YUNIKORN-1708
                 URL: https://issues.apache.org/jira/browse/YUNIKORN-1708
             Project: Apache YuniKorn
          Issue Type: Improvement
          Components: core - scheduler
            Reporter: Junyoung Park


In AWS EMR on EKS service, the driver real pod's ownerReference is configmap.
And placeholder's ownerReference is also the driver configmap.
When user cancels emr-containers job, the job-submitter is terminated,
but the placeholder still remains in pending state.
https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/emr-eks.html

Environment
* EKS 1.22
* EMR 6.9 release (Spark 3.3.0)
* Yunikorn 1.2
* gang scheduling enabled

placeholders event log
{code:shell}
Events:
  Type     Reason              Age                   From       Message
  ----     ------              ----                  ----       -------
  Normal   Scheduling          19m                   yunikorn   namespace/tg-driver-spark-000000031ttjn13iom3-0 is queued and waiting for allocation
  Normal   PodUnschedulable    19m                   yunikorn   Task namespace/tg-driver-spark-000000031ttjn13iom3-0 is pending for the requested resources become available
  Warning  FailedProvisioning  19m                   karpenter  Failed to provision new node
{code}




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@yunikorn.apache.org
For additional commands, e-mail: issues-help@yunikorn.apache.org