[jira] [Created] (SPARK-14957) can't connect to Yarn Shuffle service due to it adopt the non-exists dir to store executors metas

["SuYan (JIRA)" <ji...@apache.org>]

SuYan created SPARK-14957:
-----------------------------

             Summary: can't connect to Yarn Shuffle service due to it adopt the non-exists dir to store executors metas
                 Key: SPARK-14957
                 URL: https://issues.apache.org/jira/browse/SPARK-14957
             Project: Spark
          Issue Type: Bug
          Components: YARN
            Reporter: SuYan
             Fix For: 1.6.2


{code}
 private File findRegisteredExecutorFile(String[] localDirs) {
    for (String dir: localDirs) {
      File f = new File(new Path(dir).toUri().getPath(), "registeredExecutors.ldb");
      if (f.exists()) {
        return f;
      }
    }
    return new File(new Path(localDirs[0]).toUri().getPath(), "registeredExecutors.ldb");
  }
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org