[jira] [Created] (SPARK-25695) Spark history server event log store problem

["Si Chen (JIRA)" <ji...@apache.org>]

Si Chen created SPARK-25695:
-------------------------------

             Summary: Spark history server event log store problem
                 Key: SPARK-25695
                 URL: https://issues.apache.org/jira/browse/SPARK-25695
             Project: Spark
          Issue Type: Bug
          Components: Web UI
    Affects Versions: 2.0.0
            Reporter: Si Chen


Envirment:spark 2.0.0 hadoop 2.7.3

spark-default.conf
|| spark.eventLog.dir {color:#d04437}file:/home/hdfs/event{color}
spark.eventLog.enabled true
spark.executor.extraLibraryPath /usr/hdp/current/hadoop-client/lib/native:/usr/hdp/current/hadoop-client/lib/native/Linux-amd64-64
spark.history.fs.logDirectory {color:#d04437}file:/home/hdfs/event{color}
spark.history.kerberos.keytab none
spark.history.kerberos.principal none
spark.history.provider org.apache.spark.deploy.history.FsHistoryProvider
spark.history.ui.port 18081
spark.yarn.historyServer.address slave6.htdata.com:18081
spark.yarn.queue default||

 I want to save eventLog to local disk.
When I submit spark job use client deploy mode, event log can write to local disk.
But when I use cluster mode,The following problems arise.I am sure all servers have this path.
!image-2018-10-10-13-51-45-452.png!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org