You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "zhangxinyu (JIRA)" <ji...@apache.org> on 2016/11/02 09:10:58 UTC
[jira] [Comment Edited] (SPARK-17935) Add KafkaForeachWriter in
external kafka-0.8.0 for structured streaming module
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628295#comment-15628295 ]
zhangxinyu edited comment on SPARK-17935 at 11/2/16 9:10 AM:
-------------------------------------------------------------
Thank you for your suggestions.
Kafka sink will support some producer configurations, such as key.serializer and value.serializer which make sure that users can output common type data. However, most of producer configurations will be default value, becasue users can config them by ".option()" if they really need. Besides, I will check some importent configurations, such as bootstrap.servers.
was (Author: zhangxinyu):
Thank you for your suggestions.
Kafka sink will support some producer configurations, such as key.serializer and value.serializer which make sure that users can output common type data. However, most of producer configurations will be default value, becasue users can config them by ".option()" if they really need. Besides, I will check some import configurations, such as bootstrap.servers.
> Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module
> ------------------------------------------------------------------------------
>
> Key: SPARK-17935
> URL: https://issues.apache.org/jira/browse/SPARK-17935
> Project: Spark
> Issue Type: Improvement
> Components: Structured Streaming
> Affects Versions: 2.0.0
> Reporter: zhangxinyu
>
> Now spark already supports kafkaInputStream. It would be useful that we add `KafkaForeachWriter` to output results to kafka in structured streaming module.
> `KafkaForeachWriter.scala` is put in external kafka-0.8.0.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org