You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-dev@hadoop.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2011/08/18 19:06:27 UTC

[jira] [Created] (MAPREDUCE-2855) ResourceBundle lookup during counter name resolution takes a lot of time

ResourceBundle lookup during counter name resolution takes a lot of time
------------------------------------------------------------------------

                 Key: MAPREDUCE-2855
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2855
             Project: Hadoop Map/Reduce
          Issue Type: Bug
    Affects Versions: 0.23.0
            Reporter: Todd Lipcon
            Assignee: Todd Lipcon


Loading a job status page in trunk takes a lot of time, and it seems like most of the time is spent resolving counter names. Looking through the JDK source, ResourceBundle.getBundle(String) ends up calling getClassContext() which is not very efficient. I think if we pass our own classloader manually it will be faster. In Counters.incrAllCounters, we may also be able to avoid setting the counter name if one is already set.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira