You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@yunikorn.apache.org by "Craig Condit (Jira)" <ji...@apache.org> on 2023/09/08 17:34:00 UTC
[jira] [Commented] (YUNIKORN-1961) User Info annotation incorrect for executor pods
[ https://issues.apache.org/jira/browse/YUNIKORN-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17763195#comment-17763195 ]
Craig Condit commented on YUNIKORN-1961:
----------------------------------------
Verified this locally... Not sure how we missed this one. Normally, this should work fine as the first user associated with an app is what's used. However, if YUNIKORN-1851 is implemented, this will break as the executors will not be allowed to use the same applicationID.
> User Info annotation incorrect for executor pods
> ------------------------------------------------
>
> Key: YUNIKORN-1961
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1961
> Project: Apache YuniKorn
> Issue Type: Bug
> Components: shim - kubernetes
> Reporter: Mit Desai
> Assignee: TingYao Huang
> Priority: Major
>
> UserInfo annotation is getting populated correctly for driver pods. But for the executor pods, _spark_ service account information is populated. Ideally, this should be same as the driver pod where we have the information of the user who originally submitted the job.
> Here is the example of pod describe when running a worcount job with 2 executors:
> {noformat}
> Name: md-wc-94ec368a6d3b30cd-driver
> Namespace: mdesai
> Priority: 0
> Service Account: spark
> Node: *** node1 ***
> Start Time: Wed, 06 Sep 2023 18:21:59 -0700
> Labels: spark-app-selector=spark-c9315eb5d3bf4552b30c77090a328249
> spark-role=driver
> Annotations: otherAnnotations: omited
> yunikorn.apache.org/allow-preemption: true
> yunikorn.apache.org/user.info:
> {"user":"mdesai@visa.com","groups":["group1","group2","...
> Status: Running {noformat}
>
> {noformat}
> Name: javawordcount-ca2f0f8a6d3b64e6-exec-1
> Namespace: mdesai
> Priority: 0
> Service Account: spark
> Node: *** node2 ***
> Start Time: Wed, 06 Sep 2023 18:22:06 -0700
> Labels: spark-app-selector=spark-c9315eb5d3bf4552b30c77090a328249
> spark-exec-id=1
> spark-exec-resourceprofile-id=0
> spark-role=executor
> Annotations: otherAnnotations: omited
> yunikorn.apache.org/allow-preemption: true
> yunikorn.apache.org/user.info:
> {"user":"system:serviceaccount:mdesai:spark","groups":["system:serviceaccounts","system:serviceaccounts:mdesai","system:authenticated"]} {noformat}
>
> {noformat}
> Name: javawordcount-ca2f0f8a6d3b64e6-exec-2
> Namespace: mdesai
> Priority: 0
> Service Account: spark
> Node: *** node3 ***
> Start Time: Wed, 06 Sep 2023 18:22:07 -0700
> Labels: spark-app-selector=spark-c9315eb5d3bf4552b30c77090a328249
> spark-exec-id=2
> spark-exec-resourceprofile-id=0
> spark-role=executor
> Annotations: otherAnnotations: omited
> yunikorn.apache.org/allow-preemption: true
> yunikorn.apache.org/user.info:
> {"user":"system:serviceaccount:mdesai:spark","groups":["system:serviceaccounts","system:serviceaccounts:mdesai","system:authenticated"]}
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@yunikorn.apache.org
For additional commands, e-mail: issues-help@yunikorn.apache.org