You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2018/07/02 14:39:10 UTC
spark git commit: [SPARK-24507][DOCUMENTATION] Update streaming guide
Repository: spark
Updated Branches:
refs/heads/master 8008f9cb8 -> f599cde69
[SPARK-24507][DOCUMENTATION] Update streaming guide
## What changes were proposed in this pull request?
Updated streaming guide for direct stream and link to integration guide.
## How was this patch tested?
jekyll build
Author: Rekha Joshi <re...@gmail.com>
Closes #21683 from rekhajoshm/SPARK-24507.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f599cde6
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/f599cde6
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/f599cde6
Branch: refs/heads/master
Commit: f599cde69506a5aedeeec449cba9a8b5ab128282
Parents: 8008f9c
Author: Rekha Joshi <re...@gmail.com>
Authored: Mon Jul 2 22:39:00 2018 +0800
Committer: hyukjinkwon <gu...@apache.org>
Committed: Mon Jul 2 22:39:00 2018 +0800
----------------------------------------------------------------------
docs/streaming-programming-guide.md | 2 ++
1 file changed, 2 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/f599cde6/docs/streaming-programming-guide.md
----------------------------------------------------------------------
diff --git a/docs/streaming-programming-guide.md b/docs/streaming-programming-guide.md
index c309592..118b053 100644
--- a/docs/streaming-programming-guide.md
+++ b/docs/streaming-programming-guide.md
@@ -2176,6 +2176,8 @@ the input data stream (using `inputStream.repartition(<number of partitions>)`).
This distributes the received batches of data across the specified number of machines in the cluster
before further processing.
+For direct stream, please refer to [Spark Streaming + Kafka Integration Guide](streaming-kafka-integration.html)
+
### Level of Parallelism in Data Processing
{:.no_toc}
Cluster resources can be under-utilized if the number of parallel tasks used in any stage of the
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org