MiniYARNCluster logs

[Prashant Kommireddi <pr...@gmail.com>]

Hey guys,

We are using the MiniYARNCluster and trying to see where the NN, RM, job
logs can be found. We see the job logs are present on HDFS but not on any
local dirs. Also, none of the master node logs (NN, RM) are available.

Digging in a bit further (just looked at this 1 file), I see there is local
dirs being created but never written to. The only place we find job logs is
at the remote log dir.

    public synchronized void start() {
      try {
        // create nm-local-dirs and configure them for the nodemanager
        String localDirsString = prepareDirs("local", numLocalDirs);
        getConfig().set(YarnConfiguration.NM_LOCAL_DIRS, localDirsString);
        // create nm-log-dirs and configure them for the nodemanager
        String logDirsString = prepareDirs("log", numLogDirs);
        getConfig().set(YarnConfiguration.NM_LOG_DIRS, logDirsString);

        File remoteLogDir =
            new File(testWorkDir, MiniYARNCluster.this.getName()
                + "-remoteLogDir-nm-" + index);
        remoteLogDir.mkdir();
        getConfig().set(YarnConfiguration.NM_REMOTE_APP_LOG_DIR,
            	remoteLogDir.getAbsolutePath());


Any configs that need to be tweaked to generate logs locally for
MiniYarnCluster? Any pointers would be helpful.

Thanks,
Prashant