[jira] [Created] (SPARK-27523) Resolve scheme-less event log directory relative to default filesystem

["Mikayla Konst (JIRA)" <ji...@apache.org>]

Mikayla Konst created SPARK-27523:
-------------------------------------

             Summary: Resolve scheme-less event log directory relative to default filesystem
                 Key: SPARK-27523
                 URL: https://issues.apache.org/jira/browse/SPARK-27523
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 3.0.0
            Reporter: Mikayla Konst


Currently, if I specify a default filesystem:

fs.defaultFS=hdfs://host

And a scheme-less event log directory:

spark.eventLog.dir=/some/dir

Then the event log directory is always resolved with respect to the local filesystem.

I propose that it should be resolved with respect to the default filesystem.

Targeting Spark 3.0.0 since this is technically a breaking change.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org