You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Swaminathan Balachandran (Jira)" <ji...@apache.org> on 2022/10/24 16:21:00 UTC

[jira] [Created] (SPARK-40901) Unable to store Spark Driver logs with Absolute Hadoop based URI FS Path

Swaminathan Balachandran created SPARK-40901:
------------------------------------------------

             Summary: Unable to store Spark Driver logs with Absolute Hadoop based URI FS Path
                 Key: SPARK-40901
                 URL: https://issues.apache.org/jira/browse/SPARK-40901
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 3.2.2, 3.3.0
            Reporter: Swaminathan Balachandran


Spark Config: spark.eventLog.dir doesn't support absolute URI hadoop based path. It currently only supports URI path and writes only to fs.defaultFS and does not write logs to any other configured filesystem.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org