You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Sanjay Dahiya (JIRA)" <ji...@apache.org> on 2006/09/13 14:19:22 UTC

[jira] Created: (HADOOP-528) Some hadoop distcp task fails with dfs.client.buffer.dir not found error while the property exists.

Some hadoop distcp task fails with dfs.client.buffer.dir not found error while the property exists.
---------------------------------------------------------------------------------------------------

                 Key: HADOOP-528
                 URL: http://issues.apache.org/jira/browse/HADOOP-528
             Project: Hadoop
          Issue Type: Bug
          Components: mapred
    Affects Versions: 0.6.0
            Reporter: Sanjay Dahiya
             Fix For: 0.7.0


On some nodes hadoop distcp fails with folowing error. The property dfs.client.buffer.dir is defined in hadoop-site.xml and the corresponding directory is also created on the node by framework. Same configuration works on all other nodes. 

It could be a timing issue where someone is trying to read the dir before its created on local disk, I am not sure of the cause. 

java.io.IOException: No valid local directories in property: dfs.client.buffer.dir at org.apache.hadoop.conf.Configuration.getFile(Configuration.java:405) at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.newBackupFile(DFSClient.java:780) at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.(DFSClient.java:770) at org.apache.hadoop.dfs.DFSClient.create(DFSClient.java:276) at org.apache.hadoop.dfs.DistributedFileSystem.createRaw(DistributedFileSystem.java:104) at org.apache.hadoop.fs.FSDataOutputStream$Summer.(FSDataOutputStream.java:56) at org.apache.hadoop.fs.FSDataOutputStream$Summer.(FSDataOutputStream.java:45) at org.apache.hadoop.fs.FSDataOutputStream.(FSDataOutputStream.java:146) at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:270) at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:177) at org.apache.hadoop.util.CopyFiles$DFSCopyFilesMapper.copy(CopyFiles.java:186) at org.apache.hadoop.util.CopyFiles$DFSCopyFilesMapper.map(CopyFiles.java:391) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:46) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:210) at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1066)

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Resolved: (HADOOP-528) Some hadoop distcp task fails with dfs.client.buffer.dir not found error while the property exists.

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley resolved HADOOP-528.
----------------------------------

    Resolution: Cannot Reproduce
      Assignee:     (was: Owen O'Malley)

I haven't seen this recently and I suspect it was the race condition in creating the directories that we used to have with mkdirs calling exists and then mkdir.

> Some hadoop distcp task fails with dfs.client.buffer.dir not found error while the property exists.
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-528
>                 URL: https://issues.apache.org/jira/browse/HADOOP-528
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.6.0
>            Reporter: Sanjay Dahiya
>
> On some nodes hadoop distcp fails with folowing error. The property dfs.client.buffer.dir is defined in hadoop-site.xml and the corresponding directory is also created on the node by framework. Same configuration works on all other nodes. 
> It could be a timing issue where someone is trying to read the dir before its created on local disk, I am not sure of the cause. 
> java.io.IOException: No valid local directories in property: dfs.client.buffer.dir at org.apache.hadoop.conf.Configuration.getFile(Configuration.java:405) at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.newBackupFile(DFSClient.java:780) at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.(DFSClient.java:770) at org.apache.hadoop.dfs.DFSClient.create(DFSClient.java:276) at org.apache.hadoop.dfs.DistributedFileSystem.createRaw(DistributedFileSystem.java:104) at org.apache.hadoop.fs.FSDataOutputStream$Summer.(FSDataOutputStream.java:56) at org.apache.hadoop.fs.FSDataOutputStream$Summer.(FSDataOutputStream.java:45) at org.apache.hadoop.fs.FSDataOutputStream.(FSDataOutputStream.java:146) at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:270) at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:177) at org.apache.hadoop.util.CopyFiles$DFSCopyFilesMapper.copy(CopyFiles.java:186) at org.apache.hadoop.util.CopyFiles$DFSCopyFilesMapper.map(CopyFiles.java:391) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:46) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:210) at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1066)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HADOOP-528) Some hadoop distcp task fails with dfs.client.buffer.dir not found error while the property exists.

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/HADOOP-528?page=all ]

Doug Cutting updated HADOOP-528:
--------------------------------

    Fix Version/s: 0.8.0
                       (was: 0.7.0)

> Some hadoop distcp task fails with dfs.client.buffer.dir not found error while the property exists.
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-528
>                 URL: http://issues.apache.org/jira/browse/HADOOP-528
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.6.0
>            Reporter: Sanjay Dahiya
>             Fix For: 0.8.0
>
>
> On some nodes hadoop distcp fails with folowing error. The property dfs.client.buffer.dir is defined in hadoop-site.xml and the corresponding directory is also created on the node by framework. Same configuration works on all other nodes. 
> It could be a timing issue where someone is trying to read the dir before its created on local disk, I am not sure of the cause. 
> java.io.IOException: No valid local directories in property: dfs.client.buffer.dir at org.apache.hadoop.conf.Configuration.getFile(Configuration.java:405) at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.newBackupFile(DFSClient.java:780) at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.(DFSClient.java:770) at org.apache.hadoop.dfs.DFSClient.create(DFSClient.java:276) at org.apache.hadoop.dfs.DistributedFileSystem.createRaw(DistributedFileSystem.java:104) at org.apache.hadoop.fs.FSDataOutputStream$Summer.(FSDataOutputStream.java:56) at org.apache.hadoop.fs.FSDataOutputStream$Summer.(FSDataOutputStream.java:45) at org.apache.hadoop.fs.FSDataOutputStream.(FSDataOutputStream.java:146) at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:270) at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:177) at org.apache.hadoop.util.CopyFiles$DFSCopyFilesMapper.copy(CopyFiles.java:186) at org.apache.hadoop.util.CopyFiles$DFSCopyFilesMapper.map(CopyFiles.java:391) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:46) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:210) at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1066)

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira