You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Zheng Shao (JIRA)" <ji...@apache.org> on 2010/01/13 03:47:54 UTC

[jira] Created: (HADOOP-6490) Path.normalize should use StringUtils.replace in favor of String.replace

Path.normalize should use StringUtils.replace in favor of String.replace
------------------------------------------------------------------------

                 Key: HADOOP-6490
                 URL: https://issues.apache.org/jira/browse/HADOOP-6490
             Project: Hadoop Common
          Issue Type: Bug
    Affects Versions: 0.20.1
            Reporter: Zheng Shao


in our environment, we are seeing that the JobClient is going out of memory because Path.normalizePath(String) is called several tens of thousands of times, and each time it calls "String.replace" twice.

java.lang.String.replace compiles a regex to do the job which is very costly.
We should use org.apache.commons.lang.StringUtils.replace which is much faster and consumes almost no extra memory.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.