You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Calvin (Jira)" <ji...@apache.org> on 2020/10/26 16:50:00 UTC
[jira] [Commented] (SPARK-23539) Add support for Kafka headers in
Structured Streaming
[ https://issues.apache.org/jira/browse/SPARK-23539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17220813#comment-17220813 ]
Calvin commented on SPARK-23539:
--------------------------------
[~dongjin]/[~kabhwan] Apologies for reviving this long-closed ticket, but I was wondering if there are any plans to backport this feature to any of the Spark 2.x.x versions or if this feature will only be available from 3.0.0 onward?
> Add support for Kafka headers in Structured Streaming
> -----------------------------------------------------
>
> Key: SPARK-23539
> URL: https://issues.apache.org/jira/browse/SPARK-23539
> Project: Spark
> Issue Type: New Feature
> Components: Structured Streaming
> Affects Versions: 2.3.0
> Reporter: Tathagata Das
> Assignee: Dongjin Lee
> Priority: Major
> Fix For: 3.0.0
>
>
> Kafka headers were added in 0.11. We should expose them through our kafka data source in both batch and streaming queries.
> This is currently blocked on version of Kafka in Spark from 0.10.1 to 1.0+ SPARK-18057
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org