You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Weiwei Yang (JIRA)" <ji...@apache.org> on 2018/07/19 02:19:00 UTC
[jira] [Commented] (YARN-8550) YARN root queue exceeds 100%
[ https://issues.apache.org/jira/browse/YARN-8550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16548685#comment-16548685 ]
Weiwei Yang commented on YARN-8550:
-----------------------------------
I have observed a similar issue in YARN-8546. That was caused by two allocations both take room from a reserved container causing queue usage exceeds 100%. But that was when async scheduling enabled ("yarn.scheduler.capacity.schedule-asynchronously.enabled=true"), not in v2.7.3. Not sure if they are the same issue.
> YARN root queue exceeds 100%
> ----------------------------
>
> Key: YARN-8550
> URL: https://issues.apache.org/jira/browse/YARN-8550
> Project: Hadoop YARN
> Issue Type: Bug
> Components: yarn
> Affects Versions: 2.7.3
> Reporter: Prabhu Joseph
> Priority: Major
> Attachments: Screen Shot 2018-07-13 at 1.42.41 PM.png
>
>
> YARN root queue usage is more than 100% which is misleading. (attached screenshot) This happens when there is a container reserved and so used + reserved exceeds Total. Cluster is configured with CPU Scheduling.
> {code}
> 2018-07-17 13:27:59,569 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(475)) - assignedContainer queue=root usedCapacity=0.9713542 absoluteUsedCapacity=0.9713542 used=<memory:763904, vCores:83> cluster=<memory:786432, vCores:384>
> 2018-07-17 13:27:59,627 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(422)) - container_e56_1531419441577_2045_01_000003 Container Transitioned from NEW to RESERVED
> 2018-07-17 13:27:59,627 INFO allocator.AbstractContainerAllocator (AbstractContainerAllocator.java:getCSAssignmentFromAllocateResult(77)) - Reserved container application=application_1531419441577_2045 resource=<memory:53248, vCores:2>
> queue=org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator@2a1563f4 cluster=<memory:786432, vCores:384>
> 2018-07-17 13:27:59,627 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(475)) - assignedContainer queue=root usedCapacity=1.0390625 absoluteUsedCapacity=1.0390625 used=<memory:817152, vCores:85> cluster=<memory:786432, vCores:384>
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org