You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Per Bergland (JIRA)" <ji...@apache.org> on 2013/10/22 21:52:46 UTC

[jira] [Created] (YARN-1340) MiniYARNCluster generates wrong style directories in YarnConfiguration.NM_LOCAL_DIR, causes tests to fail if path contains space

Per Bergland created YARN-1340:
----------------------------------

             Summary: MiniYARNCluster generates wrong style directories in YarnConfiguration.NM_LOCAL_DIR, causes tests to fail if path contains space
                 Key: YARN-1340
                 URL: https://issues.apache.org/jira/browse/YARN-1340
             Project: Hadoop YARN
          Issue Type: Bug
    Affects Versions: 2.0.6-alpha
         Environment: Mac OS X 10.8.5, CentOS 6.3
            Reporter: Per Bergland


We found that our tests based on the ClusterMapReduceTestCase class failed when the jenkins job contained spaces and were able to reproduce the error by just renaming the project directory to create a space character.
The failure happens when validatePaths method in LocalDirsHandlerService tries to interpret the paths as URLs "new URL(dir)" and this fails.

https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.6-alpha/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/LocalDirsHandlerService.java

The code in the MiniYARNCluster.prepareDirs method needs to be modified to create properly escaped file://-based URLs instead of raw file paths OR the receiving end in LocalDirsHandlerService needs to stop interpreting the directories as urls. Since MiniYARNCluster is a test class I suspect that the former needs to be done.



--
This message was sent by Atlassian JIRA
(v6.1#6144)