[jira] [Updated] (YARN-5613) Fair Scheduler can assign containers from blacklisted nodes

["Daniel Templeton (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/YARN-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Templeton updated YARN-5613:
-----------------------------------
    Attachment: YARN-5613.001.patch

The issue shows up when running {{TestAMRMClient.testAMRMClientWithBlacklist()}} using fair scheduler as the default.  The error is:

{noformat}
expected:<0> but was:<1>
Stacktrace

java.lang.AssertionError: expected:<0> but was:<1>
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.failNotEquals(Assert.java:743)
	at org.junit.Assert.assertEquals(Assert.java:118)
	at org.junit.Assert.assertEquals(Assert.java:555)
	at org.junit.Assert.assertEquals(Assert.java:542)
	at org.apache.hadoop.yarn.client.api.impl.TestAMRMClient.testAllocationWithBlacklist(TestAMRMClient.java:537)
Standard Output
{noformat}

This patch appears to resolve the issue, but I'm still testing.

> Fair Scheduler can assign containers from blacklisted nodes
> -----------------------------------------------------------
>
>                 Key: YARN-5613
>                 URL: https://issues.apache.org/jira/browse/YARN-5613
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: fairscheduler
>    Affects Versions: 2.8.0
>            Reporter: Daniel Templeton
>            Assignee: Daniel Templeton
>         Attachments: YARN-5613.001.patch
>
>
> The {{FairScheduler.allocate()}} makes its resource request before it updates the blacklist.  If the scheduler processes the resource request before the allocating thread updates the blacklist, the scheduler can assign containers that are on nodes in the blacklist.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org