You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Aljoscha Krettek (JIRA)" <ji...@apache.org> on 2019/06/28 07:33:00 UTC
[jira] [Closed] (FLINK-11693) Add KafkaSerializationSchema that
directly uses ProducerRecord
[ https://issues.apache.org/jira/browse/FLINK-11693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aljoscha Krettek closed FLINK-11693.
------------------------------------
Resolution: Implemented
Fix Version/s: 1.9.0
Release Note: The modern `FlinkKafkaProducer` supports a new `KafkaSerializationSchema` that will replace `KeyedSerializationSchema` in the long run. This new schema allows directly generating Kafka `ProducerRecords` for sending to Kafka, therefore enabling the user to use all available Kafka features (in the context of Kafka records).
Added on master in
d43e6b82ea16f49aee5006de8d63212af7fea8fc
d9c71e323d7765d03ecc0359692ec33d79abf426
> Add KafkaSerializationSchema that directly uses ProducerRecord
> --------------------------------------------------------------
>
> Key: FLINK-11693
> URL: https://issues.apache.org/jira/browse/FLINK-11693
> Project: Flink
> Issue Type: New Feature
> Components: Connectors / Kafka
> Environment: Kafka 0.11.0.0
> Flink 1.4.0
> flink-connector-kafka-0.11_2.11
> Reporter: Mohammad Abareghi
> Assignee: Aljoscha Krettek
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.9.0
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> This allows using all fields that Kafka offers on {{ProducerRecord}}, for example, timestamps and headers.
> h2. Old Text
> Kafka has introduced notion of Header for messages in version 0.11.0.0 https://issues.apache.org/jira/browse/KAFKA-4208.
> But flink-connector-kafka-0.11_2.11 which supports kafka 0.11.0.0 ignores headers when consuming kafka messages.
> It would be useful in some scenarios, such as distributed log tracing, to support message headers to FlinkKafkaConsumer011 and FlinkKafkaProducer011.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)