You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Noritaka Sekiyama (JIRA)" <ji...@apache.org> on 2019/06/17 02:27:00 UTC

[jira] [Created] (SPARK-28069) Switch log directory from Spark UI without restarting history server

Noritaka Sekiyama created SPARK-28069:
-----------------------------------------

             Summary: Switch log directory from Spark UI without restarting history server
                 Key: SPARK-28069
                 URL: https://issues.apache.org/jira/browse/SPARK-28069
             Project: Spark
          Issue Type: Improvement
          Components: Web UI
    Affects Versions: 2.4.3
            Reporter: Noritaka Sekiyama


History server polls the directory specified in spark.history.fs.logDirectory, and displays the event logs based on the data included in the directory.

In the Cloud, event logs might be written into different directories from different clusters.
Currently it is not so easy to launch history server for multiple clusters because there is no ways to switch log directory after starting the history server.
If users can switch log directory from Spark UI without restarting history server, it would be beneficial for users who wants to use Cloud storage for event log directory.




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org