You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Jun Rao (Updated) (JIRA)" <ji...@apache.org> on 2012/03/01 20:40:19 UTC
[jira] [Updated] (KAFKA-240) implement new producer and consumer
request format
[ https://issues.apache.org/jira/browse/KAFKA-240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jun Rao updated KAFKA-240:
--------------------------
Attachment: kafka-240_unittestfix_delta.patch
Joe,
There are 2 reasons why the unit test fails.
1. Some default values for ProducerRequest are not set consistently.
2. The bigger issue is that in scala, Array equal is only testing equal on reference, not the actual value. This is different from how other Seq classes like List behave. To fix that, I have to explicit define equal in ProdueRequest and TopicData.
Attached is a patch of only 4 scala files that I modified. Apply your v4 patch, revert those 4 files and apply my patch. The unit test passes now.
A few other things:
9. When deserilizing bytes to ProducerRequest, we need to set version id.
10. In KafkaApi, we should send no ack on ProducerRequest since the producer is not reading the response yet. Add a comment that this will be fixed in kafka-49.
Once the above 2 issues are addressed, you can just commit without further review. Finally, would you mind committing after kafka-239? That patch changed quite a few unit tests and may take a bit more time to refactor.
> implement new producer and consumer request format
> --------------------------------------------------
>
> Key: KAFKA-240
> URL: https://issues.apache.org/jira/browse/KAFKA-240
> Project: Kafka
> Issue Type: Sub-task
> Components: core
> Affects Versions: 0.8
> Reporter: Jun Rao
> Labels: fetch, replication, wireprotocol
> Fix For: 0.8
>
> Attachments: KAFKA-240-FetchRequest-v1.patch, KAFKA-240-FetchRequest-v2.patch, KAFKA-240-FetchRequest-validation-v1.patch, KAFKA-240.ProducerRequest.v2.patch, KAFKA-240.ProducerRequest.v3.patch, KAFKA-240.ProducerRequest.v4.patch, KAFKA-240.v3.patch, kafka-240_unittestfix_delta.patch
>
>
> We want to change the producer/consumer request/response format according to the discussion in the following wiki:
> https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposal
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira