You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by sr...@apache.org on 2017/07/21 07:43:42 UTC
spark git commit: [MINOR][SS][DOCS] Minor doc change for kafka
integration
Repository: spark
Updated Branches:
refs/heads/master 3ac609308 -> c57dfaef3
[MINOR][SS][DOCS] Minor doc change for kafka integration
## What changes were proposed in this pull request?
Minor change to kafka integration document for structured streaming.
## How was this patch tested?
N/A, doc change only.
Author: Liang-Chi Hsieh <vi...@gmail.com>
Closes #18550 from viirya/minor-ss-kafka-doc.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c57dfaef
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/c57dfaef
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/c57dfaef
Branch: refs/heads/master
Commit: c57dfaef30dcf04d7c7911da1ac77679492d04c5
Parents: 3ac6093
Author: Liang-Chi Hsieh <vi...@gmail.com>
Authored: Fri Jul 21 08:43:38 2017 +0100
Committer: Sean Owen <so...@cloudera.com>
Committed: Fri Jul 21 08:43:38 2017 +0100
----------------------------------------------------------------------
docs/structured-streaming-kafka-integration.md | 6 ++++++
1 file changed, 6 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/c57dfaef/docs/structured-streaming-kafka-integration.md
----------------------------------------------------------------------
diff --git a/docs/structured-streaming-kafka-integration.md b/docs/structured-streaming-kafka-integration.md
index 217c1a9..bab0be8 100644
--- a/docs/structured-streaming-kafka-integration.md
+++ b/docs/structured-streaming-kafka-integration.md
@@ -15,6 +15,8 @@ For Scala/Java applications using SBT/Maven project definitions, link your appli
For Python applications, you need to add this above library and its dependencies when deploying your
application. See the [Deploying](#deploying) subsection below.
+For experimenting on `spark-shell`, you need to add this above library and its dependencies too when invoking `spark-shell`. Also see the [Deploying](#deploying) subsection below.
+
## Reading Data from Kafka
### Creating a Kafka Source for Streaming Queries
@@ -607,5 +609,9 @@ and its dependencies can be directly added to `spark-submit` using `--packages`,
./bin/spark-submit --packages org.apache.spark:spark-sql-kafka-0-10_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION_SHORT}} ...
+For experimenting on `spark-shell`, you can also use `--packages` to add `spark-sql-kafka-0-10_{{site.SCALA_BINARY_VERSION}}` and its dependencies directly,
+
+ ./bin/spark-shell --packages org.apache.spark:spark-sql-kafka-0-10_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION_SHORT}} ...
+
See [Application Submission Guide](submitting-applications.html) for more details about submitting
applications with external dependencies.
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org