You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Aljoscha Krettek (JIRA)" <ji...@apache.org> on 2019/02/22 14:07:00 UTC
[jira] [Updated] (FLINK-11693) Add KafkaSerializationSchema that
directly uses ProducerRecord
[ https://issues.apache.org/jira/browse/FLINK-11693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aljoscha Krettek updated FLINK-11693:
-------------------------------------
Description:
This allows using all fields that Kafka offers on {{ProducerRecord}}, for example, timestamps and headers.
h2. Old Text
Kafka has introduced notion of Header for messages in version 0.11.0.0 https://issues.apache.org/jira/browse/KAFKA-4208.
But flink-connector-kafka-0.11_2.11 which supports kafka 0.11.0.0 ignores headers when consuming kafka messages.
It would be useful in some scenarios, such as distributed log tracing, to support message headers to FlinkKafkaConsumer011 and FlinkKafkaProducer011.
was:
This allows using all fields that Kafka offers on {{ConsumerRecord}}, for example, timestamps and headers.
h2. Old Text
Kafka has introduced notion of Header for messages in version 0.11.0.0 https://issues.apache.org/jira/browse/KAFKA-4208.
But flink-connector-kafka-0.11_2.11 which supports kafka 0.11.0.0 ignores headers when consuming kafka messages.
It would be useful in some scenarios, such as distributed log tracing, to support message headers to FlinkKafkaConsumer011 and FlinkKafkaProducer011.
> Add KafkaSerializationSchema that directly uses ProducerRecord
> --------------------------------------------------------------
>
> Key: FLINK-11693
> URL: https://issues.apache.org/jira/browse/FLINK-11693
> Project: Flink
> Issue Type: New Feature
> Components: Kafka Connector
> Environment: Kafka 0.11.0.0
> Flink 1.4.0
> flink-connector-kafka-0.11_2.11
> Reporter: Mohammad Abareghi
> Assignee: Aegeaner
> Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> This allows using all fields that Kafka offers on {{ProducerRecord}}, for example, timestamps and headers.
> h2. Old Text
> Kafka has introduced notion of Header for messages in version 0.11.0.0 https://issues.apache.org/jira/browse/KAFKA-4208.
> But flink-connector-kafka-0.11_2.11 which supports kafka 0.11.0.0 ignores headers when consuming kafka messages.
> It would be useful in some scenarios, such as distributed log tracing, to support message headers to FlinkKafkaConsumer011 and FlinkKafkaProducer011.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)