Troubles using MiniDFSCluster: ERROR All directories in dfs.data.dir are invalid

[Paolo Castagna <ca...@googlemail.com>]

Hi,
I am using MiniDFSCluster and MiniMRCluster to test locally a few MapReduce
jobs which runs with multiple reducers.

Here is how I start the MiniMRCluster and MiniDFSCluster:

    	Configuration configuration = new Configuration() ;
        System.setProperty("hadoop.log.dir", "build/test/logs") ;
        dfsCluster = new MiniDFSCluster(configuration, numNodes, true, null) ;
        mrCluster = new MiniMRCluster(numNodes,
dfsCluster.getFileSystem().getUri().toString(), 1) ;

When I run locally evertyhing is fine.
My umask is set to 0022.

If I run on my continuous integration server (i.e. Jenkins), I see these errors:

WARN  Invalid directory in dfs.data.dir: Incorrect permission for
build/test/data/dfs/data/data1, expected: rwxr-xr-x, while actual:
rwxrwxr-x
WARN  Invalid directory in dfs.data.dir: Incorrect permission for
build/test/data/dfs/data/data2, expected: rwxr-xr-x, while actual:
rwxrwxr-x
ERROR All directories in dfs.data.dir are invalid.

I made different attempts to work around this problem:

 1/  configuration.setBoolean("dfs.permissions", false);
 2/  configuration.set("dfs.datanode.data.dir.perm", "755");
 3/  configuration.set("dfs.mask", "022");

None of these seems to work.

Any help?

Paolo