You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2019/02/18 09:22:28 UTC
[spark] branch master updated: [SPARK-26889][SS][DOCS] Fix
timestamp type in Structured Streaming + Kafka Integration Guide
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 59eb34b [SPARK-26889][SS][DOCS] Fix timestamp type in Structured Streaming + Kafka Integration Guide
59eb34b is described below
commit 59eb34b82c023ac56dcd08a4ceccdf612bfa7f29
Author: Gabor Somogyi <ga...@gmail.com>
AuthorDate: Mon Feb 18 17:22:06 2019 +0800
[SPARK-26889][SS][DOCS] Fix timestamp type in Structured Streaming + Kafka Integration Guide
## What changes were proposed in this pull request?
```
$ spark-shell --packages org.apache.spark:spark-sql-kafka-0-10_2.11:3.0.0-SNAPSHOT
...
scala> val df = spark.read.format("kafka").option("kafka.bootstrap.servers", "foo").option("subscribe", "bar").load().printSchema()
root
|-- key: binary (nullable = true)
|-- value: binary (nullable = true)
|-- topic: string (nullable = true)
|-- partition: integer (nullable = true)
|-- offset: long (nullable = true)
|-- timestamp: timestamp (nullable = true)
|-- timestampType: integer (nullable = true)
df: Unit = ()
```
In the doc timestamp type is `long` and in this PR I've changed it to `timestamp`.
## How was this patch tested?
cd docs/
SKIP_API=1 jekyll build
Manual webpage check.
Closes #23796 from gaborgsomogyi/SPARK-26889.
Authored-by: Gabor Somogyi <ga...@gmail.com>
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
---
docs/structured-streaming-kafka-integration.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/structured-streaming-kafka-integration.md b/docs/structured-streaming-kafka-integration.md
index c19aa5c..425110a 100644
--- a/docs/structured-streaming-kafka-integration.md
+++ b/docs/structured-streaming-kafka-integration.md
@@ -265,7 +265,7 @@ Each row in the source has the following schema:
</tr>
<tr>
<td>timestamp</td>
- <td>long</td>
+ <td>timestamp</td>
</tr>
<tr>
<td>timestampType</td>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org