You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Sunil Govindan (JIRA)" <ji...@apache.org> on 2018/12/10 09:00:00 UTC
[jira] [Commented] (YARN-9037) [CSI] Ignore volume resource in
resource calculators based on tags
[ https://issues.apache.org/jira/browse/YARN-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16714449#comment-16714449 ]
Sunil Govindan commented on YARN-9037:
--------------------------------------
Ideally we let all creation of resources to have any types of resources added in the cluster. Hence getResourceTypesArray usage is fine.
We just focus on the ops method where we ensure that resource types with tags named "system:csi-volume" is not considered to be a resource to be considered as countable.
Added one test case to verify the change is fine in simpler level.
> [CSI] Ignore volume resource in resource calculators based on tags
> ------------------------------------------------------------------
>
> Key: YARN-9037
> URL: https://issues.apache.org/jira/browse/YARN-9037
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Weiwei Yang
> Assignee: Sunil Govindan
> Priority: Major
> Labels: CSI
> Attachments: YARN-9037-002.patch, YARN-9037.001.patch, YARN-9037.003.patch
>
>
> The pre-provisioned volume is specified as a resource, but such resource is different comparing to what is managed now in YARN, e.g memory, vcores. They are constrained by 3rd party storage systems, so it looks more like an unmanaged resource. In such case, we need to ignore the resource calculation over them in the resource calculators. This can be done based on the resource tags.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org