You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by sr...@apache.org on 2016/12/12 13:33:25 UTC
spark git commit: [DOCS][MINOR] Clarify Where AccumulatorV2s are
Displayed
Repository: spark
Updated Branches:
refs/heads/master 83a42897a -> 70ffff21f
[DOCS][MINOR] Clarify Where AccumulatorV2s are Displayed
## What changes were proposed in this pull request?
This PR clarifies where accumulators will be displayed.
## How was this patch tested?
No testing.
Please review http://spark.apache.org/contributing.html before opening a pull request.
Author: Bill Chambers <bi...@databricks.com>
Author: anabranch <wa...@gmail.com>
Author: Bill Chambers <wc...@ischool.berkeley.edu>
Closes #16180 from anabranch/improve-acc-docs.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/70ffff21
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/70ffff21
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/70ffff21
Branch: refs/heads/master
Commit: 70ffff21f769b149bee787fe5901d9844a4d97b8
Parents: 83a4289
Author: Bill Chambers <bi...@databricks.com>
Authored: Mon Dec 12 13:33:17 2016 +0000
Committer: Sean Owen <so...@cloudera.com>
Committed: Mon Dec 12 13:33:17 2016 +0000
----------------------------------------------------------------------
docs/programming-guide.md | 7 ++++---
1 file changed, 4 insertions(+), 3 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/70ffff21/docs/programming-guide.md
----------------------------------------------------------------------
diff --git a/docs/programming-guide.md b/docs/programming-guide.md
index 4267b8c..353730c 100644
--- a/docs/programming-guide.md
+++ b/docs/programming-guide.md
@@ -1345,14 +1345,15 @@ therefore be efficiently supported in parallel. They can be used to implement co
MapReduce) or sums. Spark natively supports accumulators of numeric types, and programmers
can add support for new types.
-If accumulators are created with a name, they will be
-displayed in Spark's UI. This can be useful for understanding the progress of
-running stages (NOTE: this is not yet supported in Python).
+As a user, you can create named or unnamed accumulators. As seen in the image below, a named accumulator (in this instance `counter`) will display in the web UI for the stage that modifies that accumulator. Spark displays the value for each accumulator modified by a task in the "Tasks" table.
<p style="text-align: center;">
<img src="img/spark-webui-accumulators.png" title="Accumulators in the Spark UI" alt="Accumulators in the Spark UI" />
</p>
+Tracking accumulators in the UI can be useful for understanding the progress of
+running stages (NOTE: this is not yet supported in Python).
+
<div class="codetabs">
<div data-lang="scala" markdown="1">
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org