You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2020/04/01 19:05:13 UTC

[spark] branch branch-3.0 updated: [SPARK-31073][DOC][FOLLOWUP] Add description for Shuffle Write Time metric in StagePage to web-ui.md

This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-3.0 by this push:
     new 5a7395d  [SPARK-31073][DOC][FOLLOWUP] Add description for Shuffle Write Time metric in StagePage to web-ui.md
5a7395d is described below

commit 5a7395d296b57c8e06bbf100b4ebdaa1100c3a91
Author: Kousuke Saruta <sa...@oss.nttdata.com>
AuthorDate: Wed Apr 1 12:03:41 2020 -0700

    [SPARK-31073][DOC][FOLLOWUP] Add description for Shuffle Write Time metric in StagePage to web-ui.md
    
    ### What changes were proposed in this pull request?
    
    This PR adds description for `Shuffle Write Time` to `web-ui.md`.
    
    ### Why are the changes needed?
    
    #27837 added `Shuffle Write Time` metric to task metrics summary but it's not documented yet.
    
    ### Does this PR introduce any user-facing change?
    
    Yes.
    We can see the description for `Shuffle Write Time` in the new `web-ui.html`.
    <img width="956" alt="shuffle-write-time-description" src="https://user-images.githubusercontent.com/4736016/78175342-a9722280-7495-11ea-9cc6-62c6f3619aa3.png">
    
    ### How was this patch tested?
    
    Built docs by `SKIP_API=1 jekyll build` in `doc` directory and then confirmed `web-ui.html`.
    
    Closes #28093 from sarutak/SPARK-31073-doc.
    
    Authored-by: Kousuke Saruta <sa...@oss.nttdata.com>
    Signed-off-by: Dongjoon Hyun <do...@apache.org>
    (cherry picked from commit b9b1b549af4dd57767fc0c23f5fe7695ca9fa9d5)
    Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
 docs/web-ui.md | 1 +
 1 file changed, 1 insertion(+)

diff --git a/docs/web-ui.md b/docs/web-ui.md
index e28a689..c53af80 100644
--- a/docs/web-ui.md
+++ b/docs/web-ui.md
@@ -143,6 +143,7 @@ Summary metrics for all task are represented in a table and in a timeline.
 * **Shuffle Read Size / Records**. Total shuffle bytes read, includes both data read locally and data read from remote executors.
 * **Shuffle Read Blocked Time** is the time that tasks spent blocked waiting for shuffle data to be read from remote machines.
 * **Shuffle Remote Reads** is the total shuffle bytes read from remote executors.
+* **Shuffle Write Time** is the time that tasks spent writing shuffle data.
 * **Shuffle spill (memory)** is the size of the deserialized form of the shuffled data in memory.
 * **Shuffle spill (disk)** is the size of the serialized form of the data on disk.
 


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org