You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "John Fung (JIRA)" <ji...@apache.org> on 2012/10/25 00:36:12 UTC
[jira] [Commented] (KAFKA-583) SimpleConsumerShell may receive less
data inconsistently
[ https://issues.apache.org/jira/browse/KAFKA-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13483673#comment-13483673 ]
John Fung commented on KAFKA-583:
---------------------------------
This happens inconsistently by executing testcase_0108.
Test description:
1. Start Zk and 3-brokers cluster for 3 replicas.
2. Start producer until it finishes producing data.
3. Keep zk and brokers running.
4. Start SimpleConsumerShell to consume data as follows:
bin/kafka-run-class.sh kafka.tools.SimpleConsumerShell --broker-list localhost:9091,localhost:9092,localhost:9093 --topic test_1 --partition 0 --replica 1 --no-wait-at-logend > replica_data_r1_p0.log
bin/kafka-run-class.sh kafka.tools.SimpleConsumerShell --broker-list localhost:9091,localhost:9092,localhost:9093 --topic test_1 --partition 0 --replica 1 --no-wait-at-logend > replica_data_r1_p0.log
. . .
5. Look for the MessageID in each replica:
grep MessageID replica_data_r1_p0.log | sed 's/.*MessageID://' | sed 's/:.*//' | sort -u | wc -l
grep MessageID replica_data_r1_p1.log | sed 's/.*MessageID://' | sed 's/:.*//' | sort -u | wc -l
. . .
(a shell script is attached for the above shell commands)
6. The following is the output:
./run-simple-consumer.sh
735
735
630
735
735
200
735
735
630
7. The above numbers are showing that there are only 200 messages consumed in replica 2, partition 2 (3rd partition)
> SimpleConsumerShell may receive less data inconsistently
> --------------------------------------------------------
>
> Key: KAFKA-583
> URL: https://issues.apache.org/jira/browse/KAFKA-583
> Project: Kafka
> Issue Type: Bug
> Reporter: John Fung
> Attachments: broker_log_segment_files.tar.gz
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira