[jira] [Created] (KAFKA-5465) FetchResponse v0 does not return any messages when max_bytes smaller than v2 message set

["Dana Powers (JIRA)" <ji...@apache.org>]

Dana Powers created KAFKA-5465:
----------------------------------

             Summary: FetchResponse v0 does not return any messages when max_bytes smaller than v2 message set 
                 Key: KAFKA-5465
                 URL: https://issues.apache.org/jira/browse/KAFKA-5465
             Project: Kafka
          Issue Type: Bug
    Affects Versions: 0.11.0.0
            Reporter: Dana Powers
            Priority: Minor


In prior releases, when consuming uncompressed messages FetchResponse v0 will returns a message if it is smaller than the max_bytes sent in the FetchRequest. In 0.11.0.0 RC0, when messages are stored as v2 internally, the response will be empty unless the full message set is smaller than max_bytes. In some configurations, this may cause some old consumers to get stuck on large messages where previously they were able to make progress one message at a time.

For example, when I produce 10 5KB messages using ProduceRequest v0 and then attempt FetchRequest v0 with partition max bytes = 6KB (larger than a single message but smaller than all 10 messages together), I get an empty message set from 0.11.0.0. Previous brokers would have returned a single message.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)