You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@reef.apache.org by "John Yang (JIRA)" <ji...@apache.org> on 2014/10/31 06:29:34 UTC

[jira] [Created] (REEF-25) Do not enforce asterisk rack-preference for requests from .NET

John Yang created REEF-25:
-----------------------------

             Summary: Do not enforce asterisk rack-preference for requests from .NET
                 Key: REEF-25
                 URL: https://issues.apache.org/jira/browse/REEF-25
             Project: REEF
          Issue Type: Bug
          Components: REEF Bridge
            Reporter: John Yang
            Assignee: John Yang


Currently we enforce asterisk rack-preference for requests from .NET. But this causes the following problem.

When a rack-preference is specified, AMRMClient sends to RM not only the resourceName=rack requests but also the equivalent requests with resourceName=ResourceRequest.ANY(which is *) together. Therefore when the rack(resourceName) is *, we end up asking for 2 times the number of containers we intended to ask. 

We should not specify the rack-preference at all when contacting RM until we support locality-strict requests for YARN.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)