[jira] [Commented] (SPARK-39232) Spark History Main Page App List Filtering

["Apache Spark (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-39232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539302#comment-17539302 ] 

Apache Spark commented on SPARK-39232:
--------------------------------------

User 'hai-tao-1' has created a pull request for this issue:
https://github.com/apache/spark/pull/36606

> Spark History Main Page App List Filtering
> ------------------------------------------
>
>                 Key: SPARK-39232
>                 URL: https://issues.apache.org/jira/browse/SPARK-39232
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.4.0
>            Reporter: Hai Tao
>            Priority: Major
>
> Currently Spark History Server suffers when there are large number of jobs under the eventLog.dir. Loading the SHS main page may be very slow(showing `Loading History Summary ...`).
> The issue is because the current SHS returns all jobs in the appList KV Store to the client browser without any filtering. This resulted massive data transfer and slowness for SHS in a large environment. For most users, many of the returned jobs are not in their interests.
> Therefore, it could reduce the waiting time if we could add some filtering(such as user or queue) in the SHS main page.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org