You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Kuhu Shukla (JIRA)" <ji...@apache.org> on 2015/09/09 23:50:46 UTC

[jira] [Created] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

Kuhu Shukla created MAPREDUCE-6473:
--------------------------------------

             Summary: Job submission can take a long time during Cluster initialization
                 Key: MAPREDUCE-6473
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6473
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
            Reporter: Kuhu Shukla
            Assignee: Kuhu Shukla


During initialization in Cluster.java, the framework provider classes are loaded inside a sync block which can considerably increase job submission time when the number of submissions are high. The motive is to reduce time spent in this sync block safely to improve performance.
{noformat}
synchronized (frameworkLoader) {
      for (ClientProtocolProvider provider : frameworkLoader) {
        LOG.debug("Trying ClientProtocolProvider : "
            + provider.getClass().getName());
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)