You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Szilard Nemeth (JIRA)" <ji...@apache.org> on 2018/06/05 14:21:00 UTC
[jira] [Comment Edited] (YARN-7451) Resources Types should be
visible in the Cluster Apps API "resourceRequests" section
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16501854#comment-16501854 ]
Szilard Nemeth edited comment on YARN-7451 at 6/5/18 2:20 PM:
--------------------------------------------------------------
Hi [~templedf]!
Tested with latest upstream, resourceRequests shows custom resources and the scheduler endpoint also exposes custom resources for queues.
Looks like this has been fixed with https://issues.apache.org/jira/browse/YARN-7817
Do you think it's worth to keep unit tests and open another Jira task to add them as 7817 haven't added any tests and close this as a duplicate?
Thanks in advance!
was (Author: snemeth):
Hi [~templedf]!
Tested with latest upstream, resourceRequests shows custom resources and the scheduler endpoint also exposes custom resources for queues.
Looks like this has been fixed with https://issues.apache.org/jira/browse/YARN-7817
Do you think it's worth to keep unit tests and open another Jira task to add them as 7817 haven't add any tests?
Thanks in advance!
> Resources Types should be visible in the Cluster Apps API "resourceRequests" section
> ------------------------------------------------------------------------------------
>
> Key: YARN-7451
> URL: https://issues.apache.org/jira/browse/YARN-7451
> Project: Hadoop YARN
> Issue Type: Bug
> Components: resourcemanager, restapi
> Affects Versions: 3.0.0
> Reporter: Grant Sohn
> Assignee: Szilard Nemeth
> Priority: Major
> Attachments: YARN-7451.001.patch, YARN-7451.002.patch, YARN-7451.003.patch, YARN-7451.004.patch, YARN-7451.005.patch, YARN-7451.006.patch, YARN-7451.007.patch, YARN-7451.008.patch, YARN-7451.009.patch, YARN-7451.010.patch, YARN-7451.011.patch, YARN-7451.012.patch, YARN-7451__Expose_custom_resource_types_on_RM_scheduler_API_as_flattened_map01_02.patch
>
>
> When running jobs that request resource types the RM Cluster Apps API should include this in the "resourceRequests" object.
> Additionally, when calling the RM scheduler API it returns:
> {noformat}
> "childQueues": {
> "queue": [
> {
> "allocatedContainers": 101,
> "amMaxResources": {
> "memory": 320390,
> "vCores": 192
> },
> "amUsedResources": {
> "memory": 1024,
> "vCores": 1
> },
> "clusterResources": {
> "memory": 640779,
> "vCores": 384
> },
> "demandResources": {
> "memory": 103424,
> "vCores": 101
> },
> "fairResources": {
> "memory": 640779,
> "vCores": 384
> },
> "maxApps": 2147483647,
> "maxResources": {
> "memory": 640779,
> "vCores": 384
> },
> "minResources": {
> "memory": 0,
> "vCores": 0
> },
> "numActiveApps": 1,
> "numPendingApps": 0,
> "preemptable": true,
> "queueName": "root.users.systest",
> "reservedContainers": 0,
> "reservedResources": {
> "memory": 0,
> "vCores": 0
> },
> "schedulingPolicy": "fair",
> "steadyFairResources": {
> "memory": 320390,
> "vCores": 192
> },
> "type": "fairSchedulerLeafQueueInfo",
> "usedResources": {
> "memory": 103424,
> "vCores": 101
> }
> }
> ]
> {noformat}
> However, the web UI shows resource types usage.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org