You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Hai Tao (Jira)" <ji...@apache.org> on 2022/05/19 04:48:00 UTC

[jira] [Created] (SPARK-39232) Spark History Main Page App List Filtering

Hai Tao created SPARK-39232:
-------------------------------

             Summary: Spark History Main Page App List Filtering
                 Key: SPARK-39232
                 URL: https://issues.apache.org/jira/browse/SPARK-39232
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 3.4.0
            Reporter: Hai Tao


Currently Spark History Server suffers when there are large number of jobs under the eventLog.dir. Loading the SHS main page may be very slow(showing `Loading History Summary ...`).

The issue is because the current SHS returns all jobs in the appList KV Store to the client browser without any filtering. This resulted massive data transfer and slowness for SHS in a large environment. For most users, many of the returned jobs are not in their interests.

Therefore, it could reduce the waiting time if we could add some filtering(such as user or queue) in the SHS main page.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org