You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by sr...@apache.org on 2017/09/06 07:23:01 UTC
spark git commit: [SPARK-21924][DOCS] Update structured streaming
programming guide doc
Repository: spark
Updated Branches:
refs/heads/master 445f1790a -> 4ee7dfe41
[SPARK-21924][DOCS] Update structured streaming programming guide doc
## What changes were proposed in this pull request?
Update the line "For example, the data (12:09, cat) is out of order and late, and it falls in windows 12:05 - 12:15 and 12:10 - 12:20." as follow "For example, the data (12:09, cat) is out of order and late, and it falls in windows 12:00 - 12:10 and 12:05 - 12:15." under the programming structured streaming programming guide.
Author: Riccardo Corbella <r....@reply.it>
Closes #19137 from riccardocorbella/bugfix.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4ee7dfe4
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/4ee7dfe4
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/4ee7dfe4
Branch: refs/heads/master
Commit: 4ee7dfe41b27abbd4c32074ecc8f268f6193c3f4
Parents: 445f179
Author: Riccardo Corbella <r....@reply.it>
Authored: Wed Sep 6 08:22:57 2017 +0100
Committer: Sean Owen <so...@cloudera.com>
Committed: Wed Sep 6 08:22:57 2017 +0100
----------------------------------------------------------------------
docs/structured-streaming-programming-guide.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/4ee7dfe4/docs/structured-streaming-programming-guide.md
----------------------------------------------------------------------
diff --git a/docs/structured-streaming-programming-guide.md b/docs/structured-streaming-programming-guide.md
index 13a6a82..93bef8d 100644
--- a/docs/structured-streaming-programming-guide.md
+++ b/docs/structured-streaming-programming-guide.md
@@ -977,7 +977,7 @@ at the beginning of every trigger is the red line For example, when the engine
`(12:14, dog)`, it sets the watermark for the next trigger as `12:04`.
This watermark lets the engine maintain intermediate state for additional 10 minutes to allow late
data to be counted. For example, the data `(12:09, cat)` is out of order and late, and it falls in
-windows `12:05 - 12:15` and `12:10 - 12:20`. Since, it is still ahead of the watermark `12:04` in
+windows `12:00 - 12:10` and `12:05 - 12:15`. Since, it is still ahead of the watermark `12:04` in
the trigger, the engine still maintains the intermediate counts as state and correctly updates the
counts of the related windows. However, when the watermark is updated to `12:11`, the intermediate
state for window `(12:00 - 12:10)` is cleared, and all subsequent data (e.g. `(12:04, donkey)`)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org