[jira] [Created] (KAFKA-1586) support sticky partitioning in the new producer

["Jun Rao (JIRA)" <ji...@apache.org>]

Jun Rao created KAFKA-1586:
------------------------------

             Summary: support sticky partitioning in the new producer
                 Key: KAFKA-1586
                 URL: https://issues.apache.org/jira/browse/KAFKA-1586
             Project: Kafka
          Issue Type: Bug
          Components: core
    Affects Versions: 0.8.2
            Reporter: Jun Rao


If a message doesn't specify a key or a partition, the new producer selects a partition for each message in a round-robin way. As a result, in a window of linger.ms, messages are spread around in all partitions of a topic. Compared with another strategy that assigns all messages to a single partition in the same time window, this strategy may not compress the message set as well since the batch is smaller. Another potential problem with this strategy is that the compression ratio could be sensitive to the change of # partitions in a topic. If # partitions are increased in a topic, the produced data may not be compressed as well as before. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)