You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@yunikorn.apache.org by "Junyoung Park (Jira)" <ji...@apache.org> on 2023/04/26 14:49:00 UTC
[jira] [Created] (YUNIKORN-1708) Filtered owner references for placeholder pods.
Junyoung Park created YUNIKORN-1708:
---------------------------------------
Summary: Filtered owner references for placeholder pods.
Key: YUNIKORN-1708
URL: https://issues.apache.org/jira/browse/YUNIKORN-1708
Project: Apache YuniKorn
Issue Type: Improvement
Components: core - scheduler
Reporter: Junyoung Park
In AWS EMR on EKS service, the driver real pod's ownerReference is configmap.
And placeholder's ownerReference is also the driver configmap.
When user cancels emr-containers job, the job-submitter is terminated,
but the placeholder still remains in pending state.
https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/emr-eks.html
Environment
* EKS 1.22
* EMR 6.9 release (Spark 3.3.0)
* Yunikorn 1.2
* gang scheduling enabled
placeholders event log
{code:shell}
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduling 19m yunikorn namespace/tg-driver-spark-000000031ttjn13iom3-0 is queued and waiting for allocation
Normal PodUnschedulable 19m yunikorn Task namespace/tg-driver-spark-000000031ttjn13iom3-0 is pending for the requested resources become available
Warning FailedProvisioning 19m karpenter Failed to provision new node
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@yunikorn.apache.org
For additional commands, e-mail: issues-help@yunikorn.apache.org