You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-dev@hadoop.apache.org by "Chen He (JIRA)" <ji...@apache.org> on 2014/07/08 18:00:05 UTC

[jira] [Created] (YARN-2263) CSQueueUtils.computeMaxActiveApplicationsPerUser may cause deadlock for nested MapReduce jobs

Chen He created YARN-2263:
-----------------------------

             Summary: CSQueueUtils.computeMaxActiveApplicationsPerUser may cause deadlock for nested MapReduce jobs
                 Key: YARN-2263
                 URL: https://issues.apache.org/jira/browse/YARN-2263
             Project: Hadoop YARN
          Issue Type: Bug
    Affects Versions: 2.4.1, 0.23.10
            Reporter: Chen He


computeMaxActiveApplicationsPerUser() has a lower bound "1". For a nested MapReduce job which files new mapreduce jobs in its mapper/reducer, it will cause job stuck.

public static int computeMaxActiveApplicationsPerUser(
      int maxActiveApplications, int userLimit, float userLimitFactor) {
    return Math.max(
        (int)Math.ceil(
            maxActiveApplications * (userLimit / 100.0f) * userLimitFactor),
        1);
  }





--
This message was sent by Atlassian JIRA
(v6.2#6252)