[jira] [Created] (SAMZA-586) LoggedStore can send compressed messages to log-compacted Kafka topic

["Chris Riccomini (JIRA)" <ji...@apache.org>]

Chris Riccomini created SAMZA-586:
-------------------------------------

             Summary: LoggedStore can send compressed messages to log-compacted Kafka topic
                 Key: SAMZA-586
                 URL: https://issues.apache.org/jira/browse/SAMZA-586
             Project: Samza
          Issue Type: Bug
          Components: kafka
    Affects Versions: 0.9.0
            Reporter: Chris Riccomini
             Fix For: 0.9.0


I think we might have an issue with changelogs that use Kafka as its backing store. The Kafka topics are log-compacted. If the system is configured to use compression (systems.<sysname>.producer.compression.type=gzip), I believe that the LoggedStore will send compressed messages to the log-compacted topic. The LoggedStore shares the normal producer based on system name. Due to KAFKA-1374, this will cause the log compaction thread to die, or at the very least, not compress the topic.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)