You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@yunikorn.apache.org by "Craig Condit (Jira)" <ji...@apache.org> on 2023/09/08 17:34:00 UTC

[jira] [Commented] (YUNIKORN-1961) User Info annotation incorrect for executor pods

    [ https://issues.apache.org/jira/browse/YUNIKORN-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17763195#comment-17763195 ] 

Craig Condit commented on YUNIKORN-1961:
----------------------------------------

Verified this locally... Not sure how we missed this one. Normally, this should work fine as the first user associated with an app is what's used. However, if YUNIKORN-1851 is implemented, this will break as the executors will not be allowed to use the same applicationID.

> User Info annotation incorrect for executor pods
> ------------------------------------------------
>
>                 Key: YUNIKORN-1961
>                 URL: https://issues.apache.org/jira/browse/YUNIKORN-1961
>             Project: Apache YuniKorn
>          Issue Type: Bug
>          Components: shim - kubernetes
>            Reporter: Mit Desai
>            Assignee: TingYao Huang
>            Priority: Major
>
> UserInfo annotation is getting populated correctly for driver pods. But for the executor pods, _spark_ service account information is populated. Ideally, this should be same as the driver pod where we have the information of the user who originally submitted the job.
> Here is the example of pod describe when running a worcount job with 2 executors:
> {noformat}
> Name:             md-wc-94ec368a6d3b30cd-driver
> Namespace:        mdesai
> Priority:         0
> Service Account:  spark
> Node:             *** node1 ***
> Start Time:       Wed, 06 Sep 2023 18:21:59 -0700
> Labels:           spark-app-selector=spark-c9315eb5d3bf4552b30c77090a328249
>                   spark-role=driver
> Annotations:      otherAnnotations: omited
>                   yunikorn.apache.org/allow-preemption: true
>                   yunikorn.apache.org/user.info:
>                     {"user":"mdesai@visa.com","groups":["group1","group2","...
> Status:           Running {noformat}
>  
> {noformat}
> Name:             javawordcount-ca2f0f8a6d3b64e6-exec-1
> Namespace:        mdesai
> Priority:         0
> Service Account:  spark
> Node:             *** node2 ***
> Start Time:       Wed, 06 Sep 2023 18:22:06 -0700
> Labels:           spark-app-selector=spark-c9315eb5d3bf4552b30c77090a328249
>                   spark-exec-id=1
>                   spark-exec-resourceprofile-id=0
>                   spark-role=executor
> Annotations:      otherAnnotations: omited
>                   yunikorn.apache.org/allow-preemption: true
>                   yunikorn.apache.org/user.info:
>                     {"user":"system:serviceaccount:mdesai:spark","groups":["system:serviceaccounts","system:serviceaccounts:mdesai","system:authenticated"]} {noformat}
>  
> {noformat}
> Name:             javawordcount-ca2f0f8a6d3b64e6-exec-2
> Namespace:        mdesai
> Priority:         0
> Service Account:  spark
> Node:             *** node3 ***
> Start Time:       Wed, 06 Sep 2023 18:22:07 -0700
> Labels:           spark-app-selector=spark-c9315eb5d3bf4552b30c77090a328249
>                   spark-exec-id=2
>                   spark-exec-resourceprofile-id=0
>                   spark-role=executor
> Annotations:      otherAnnotations: omited
>                   yunikorn.apache.org/allow-preemption: true
>                   yunikorn.apache.org/user.info:
>                     {"user":"system:serviceaccount:mdesai:spark","groups":["system:serviceaccounts","system:serviceaccounts:mdesai","system:authenticated"]}
> {noformat}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@yunikorn.apache.org
For additional commands, e-mail: issues-help@yunikorn.apache.org