You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/02/18 09:23:01 UTC
[jira] [Resolved] (SPARK-26889) Fix timestamp type in Structured
Streaming + Kafka Integration Guide
[ https://issues.apache.org/jira/browse/SPARK-26889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon resolved SPARK-26889.
----------------------------------
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 23796
[https://github.com/apache/spark/pull/23796]
> Fix timestamp type in Structured Streaming + Kafka Integration Guide
> --------------------------------------------------------------------
>
> Key: SPARK-26889
> URL: https://issues.apache.org/jira/browse/SPARK-26889
> Project: Spark
> Issue Type: Bug
> Components: Documentation, Structured Streaming
> Affects Versions: 3.0.0
> Reporter: Gabor Somogyi
> Assignee: Gabor Somogyi
> Priority: Trivial
> Fix For: 3.0.0
>
>
> {code:java}
> $ spark-shell --packages org.apache.spark:spark-sql-kafka-0-10_2.11:3.0.0-SNAPSHOT
> ...
> scala> val df = spark.read.format("kafka").option("kafka.bootstrap.servers", "foo").option("subscribe", "bar").load().printSchema()
> root
> |-- key: binary (nullable = true)
> |-- value: binary (nullable = true)
> |-- topic: string (nullable = true)
> |-- partition: integer (nullable = true)
> |-- offset: long (nullable = true)
> |-- timestamp: timestamp (nullable = true)
> |-- timestampType: integer (nullable = true)
> df: Unit = ()
> {code}
> In the doc timestamp type is long.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org