You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Elias Levy (JIRA)" <ji...@apache.org> on 2016/06/08 21:02:20 UTC

[jira] [Created] (FLINK-4035) Bump Kafka producer in Kafka sink to Kafka 0.10.0.0

Elias Levy created FLINK-4035:
---------------------------------

             Summary: Bump Kafka producer in Kafka sink to Kafka 0.10.0.0
                 Key: FLINK-4035
                 URL: https://issues.apache.org/jira/browse/FLINK-4035
             Project: Flink
          Issue Type: Bug
          Components: Kafka Connector
    Affects Versions: 1.0.3
            Reporter: Elias Levy
            Priority: Minor


Kafka 0.10.0.0 introduced protocol changes related to the producer.  Published messages now include timestamps and compressed messages now include relative offsets.  As it is now, brokers must decompress publisher compressed messages, assign offset to them, and recompress them, which is wasteful and makes it less likely that compression will be used at all.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)