[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

["Zac Zhou (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732006#comment-16732006 ] 

Zac Zhou commented on YARN-9161:
--------------------------------

I checked the failed test case TestRunJobCliParsing and found that it's related to memory resource API.

In the test case：
{code:java}
// W/o unit for memory means bits, and 20 bits will be rounded to 0
res = CliUtils.createResourceFromString("memory=20,vcores=3",
ResourceUtils.getResourcesTypeInfo());
Assert.assertEquals(Resources.createResource(0, 3), res);
{code}
memory=20 should return 0 as it doesn't have a unit.

But YARN-5881 and YARN-7242 supports the API "memory=20" assuming MB is used by default. 

[~leftnoteasy], could you help to give some advice about how to use the memory resource API.

Thanks a lot ~

> Absolute resources of capacity scheduler doesn't support GPU and FPGA
> ---------------------------------------------------------------------
>
>                 Key: YARN-9161
>                 URL: https://issues.apache.org/jira/browse/YARN-9161
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Zac Zhou
>            Assignee: Zac Zhou
>            Priority: Major
>         Attachments: YARN-9161.001.patch
>
>
> As the enum CapacitySchedulerConfiguration.AbsoluteResourceType only has two elements: memory and vcores, which would filter out absolute resources configuration of gpu and fpga in AbstractCSQueue.updateConfigurableResourceRequirement. 
> This issue would cause gpu and fpga can't be allocated correctly



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org