You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2020/02/21 01:09:45 UTC

[spark] branch branch-2.4 updated: [SPARK-30907][DOCS] Revise the doc of spark.ui.retainedTasks

This is an automated email from the ASF dual-hosted git repository.

gurwls223 pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-2.4 by this push:
     new 1b793ed  [SPARK-30907][DOCS] Revise the doc of spark.ui.retainedTasks
1b793ed is described below

commit 1b793ed372b70446f7998e561bbf7eb9845827a9
Author: Gengliang Wang <ge...@databricks.com>
AuthorDate: Fri Feb 21 10:06:45 2020 +0900

    [SPARK-30907][DOCS] Revise the doc of spark.ui.retainedTasks
    
    ### What changes were proposed in this pull request?
    
    Revise the documentation of `spark.ui.retainedTasks` to make it clear that the configuration is for one stage.
    
    ### Why are the changes needed?
    
    There are configurations for the limitation of UI data.
    `spark.ui.retainedJobs`, `spark.ui.retainedStages` and `spark.worker.ui.retainedExecutors` are the total max number for one application, while the configuration `spark.ui.retainedTasks` is the max number for one stage.
    ### Does this PR introduce any user-facing change?
    
    No
    
    ### How was this patch tested?
    
    None, just doc.
    
    Closes #27660 from gengliangwang/reviseRetainTask.
    
    Authored-by: Gengliang Wang <ge...@databricks.com>
    Signed-off-by: HyukjinKwon <gu...@apache.org>
    (cherry picked from commit 2a695e6d159fe49efe7601383fec4f3f172c5a97)
    Signed-off-by: HyukjinKwon <gu...@apache.org>
---
 docs/configuration.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/docs/configuration.md b/docs/configuration.md
index b736d0c..1582082 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -860,7 +860,7 @@ Apart from these, the following properties are also available, and may be useful
   <td><code>spark.ui.retainedTasks</code></td>
   <td>100000</td>
   <td>
-    How many tasks the Spark UI and status APIs remember before garbage collecting.
+    How many tasks in one stage the Spark UI and status APIs remember before garbage collecting.
     This is a target maximum, and fewer elements may be retained in some circumstances.
   </td>
 </tr>


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org