You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/10/11 15:38:00 UTC
[jira] [Commented] (SPARK-25711) Allow history server to show usage
[ https://issues.apache.org/jira/browse/SPARK-25711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646631#comment-16646631 ]
Apache Spark commented on SPARK-25711:
--------------------------------------
User 'gengliangwang' has created a pull request for this issue:
https://github.com/apache/spark/pull/22699
> Allow history server to show usage
> ----------------------------------
>
> Key: SPARK-25711
> URL: https://issues.apache.org/jira/browse/SPARK-25711
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.4.0
> Reporter: Gengliang Wang
> Priority: Major
>
> Currently, if we try run
> ```
> ./start-history-server.sh -h
> ```
> We will get such error
> ```
> java.io.FileNotFoundException: File -h does not exist
> ```
> This is not user friendly.
> After fix, we can get following output:
> ```
> Usage: ./sbin/start-history-server.sh [options]
> Options:
> DIR Deprecated; set spark.history.fs.logDirectory directly
> --dir DIR (-d DIR) Deprecated; set spark.history.fs.logDirectory directly
> --properties-file FILE Path to a custom Spark properties file.
> Default is conf/spark-defaults.conf.
> Configuration options can be set by setting the corresponding JVM system property.
> History Server options are always available; additional options depend on the provider.
> History Server options:
> spark.history.ui.port Port where server will listen for connections
> (default 18080)
> spark.history.acls.enable Whether to enable view acls for all applications
> (default false)
> spark.history.provider Name of history provider class (defaults to
> file system-based provider)
> spark.history.retainedApplications Max number of application UIs to keep loaded in memory
> (default 50)
> FsHistoryProvider options:
> spark.history.fs.logDirectory Directory where app logs are stored
> (default: file:/tmp/spark-events)
> spark.history.fs.updateInterval How often to reload log data from storage
> (in seconds, default: 10)
> ```
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org