You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/04/30 18:27:00 UTC

[jira] [Created] (SPARK-24124) Spark history server should create spark.history.store.path and set permissions properly

Thomas Graves created SPARK-24124:
-------------------------------------

             Summary: Spark history server should create spark.history.store.path and set permissions properly
                 Key: SPARK-24124
                 URL: https://issues.apache.org/jira/browse/SPARK-24124
             Project: Spark
          Issue Type: Story
          Components: Spark Core
    Affects Versions: 2.3.0
            Reporter: Thomas Graves


Current with the new spark history server you can set spark.history.store.path to a location to store the levelDB files.  Currently the directory has to be made before it can use that path.

We should just have the history server create it and set the file permissions on the leveldb files to be restrictive -> new FsPermission((short) 0700)

the shuffle service already does this, this would be much more convenient to use and prevent people from making mistakes with the permissions on the directory and files.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org