You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Zoltan Siegl (JIRA)" <ji...@apache.org> on 2018/10/02 00:28:00 UTC

[jira] [Commented] (YARN-8590) Fair scheduler promotion does not update container execution type and token

    [ https://issues.apache.org/jira/browse/YARN-8590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16634800#comment-16634800 ] 

Zoltan Siegl commented on YARN-8590:
------------------------------------

As for the tests you could extract some copy-paste functionality by creating something like:
{code:java}
  private List<Container> createAppAttemptAndGetAllocatedContainers(
      RMNode node, int memory, int totalMemory, String queueName,
      String userName, ExecutionType expectedExecutionType, int expectedContainerSize) {
    ApplicationAttemptId appAttempt =
        createSchedulingRequest(memory, queueName, userName, 1, false);
    scheduler.handle(new NodeUpdateSchedulerEvent(node));
    assertEquals(totalMemory, scheduler.getQueueManager().getQueue(queueName).
        getGuaranteedResourceUsage().getMemorySize());
    List<Container> allocatedContainers =
        scheduler.getSchedulerApp(appAttempt).pullNewlyAllocatedContainers();
    assertTrue(allocatedContainers.size() == expectedContainerSize);
    assertEquals("unexpected container execution type",
        expectedExecutionType,
        allocatedContainers.get(0).getExecutionType());
    return allocatedContainers;
  }
{code}

Otherwise LGTM +1 (Non binding)

> Fair scheduler promotion does not update container execution type and token
> ---------------------------------------------------------------------------
>
>                 Key: YARN-8590
>                 URL: https://issues.apache.org/jira/browse/YARN-8590
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: fairscheduler
>    Affects Versions: YARN-1011
>            Reporter: Haibo Chen
>            Assignee: Haibo Chen
>            Priority: Major
>         Attachments: YARN-8590-YARN-1011.00.patch, YARN-8590-YARN-1011.01.patch, YARN-8590-YARN-1011.02.patch
>
>
> Fair Scheduler promotion of opportunistic containers does not update container execution type and token. This leads to incorrect resource accounting when the promoted containers are released.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org