You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Manikumar Reddy (JIRA)" <ji...@apache.org> on 2016/07/15 09:58:20 UTC

[jira] [Updated] (KAFKA-2213) Log cleaner should write compacted messages using configured compression type

     [ https://issues.apache.org/jira/browse/KAFKA-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Manikumar Reddy updated KAFKA-2213:
-----------------------------------
    Resolution: Duplicate
        Status: Resolved  (was: Patch Available)

This duplicate of KAFKA-3252

> Log cleaner should write compacted messages using configured compression type
> -----------------------------------------------------------------------------
>
>                 Key: KAFKA-2213
>                 URL: https://issues.apache.org/jira/browse/KAFKA-2213
>             Project: Kafka
>          Issue Type: Bug
>            Reporter: Joel Koshy
>            Assignee: Manikumar Reddy
>         Attachments: KAFKA-2213.patch, KAFKA-2213_2015-05-30_00:23:01.patch, KAFKA-2213_2015-06-17_16:05:53.patch, KAFKA-2213_2015-07-10_20:18:06.patch, KAFKA-2213_2015-08-20_17:04:28.patch
>
>
> In KAFKA-1374 the log cleaner was improved to handle compressed messages. There were a couple of follow-ups from that:
> * We write compacted messages using the original compression type in the compressed message-set. We should instead append all retained messages with the configured broker compression type of the topic.
> * While compressing messages we should ideally do some batching before compression.
> * Investigate the use of the client compressor. (See the discussion in the RBs for KAFKA-1374)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)