You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Geoffrey Anderson (JIRA)" <ji...@apache.org> on 2015/08/08 00:40:45 UTC
[jira] [Updated] (KAFKA-2408) (new) system tests:
ConsoleConsumerService occasionally fails to register consumed message
[ https://issues.apache.org/jira/browse/KAFKA-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Geoffrey Anderson updated KAFKA-2408:
-------------------------------------
Reviewer: Ewen Cheslack-Postava
Description:
There have been a few spurious failures in ReplicationTest.test_hard_bounce, where it was reported that a few of the acked messages were not consumed.
Checking the logs, however, it is clear that they were consumed, but ConsoleConsumerService failed to parse.
Lines causing parsing failure looks something like:
779725[2015-08-03 07:25:47,757] ERROR [ConsumerFetcherThread-console-consumer-78957_ip-172-31-5-20-1438586715191-249db71c-0-1], Error for partition [test_topic,0] to broker 1:class kafka.common.NotLeaderForPartitionException (kafka.consumer.ConsumerFetcherThread)
(i.e. the consumed message, and a log message appear on the same line)
ConsoleConsumerService simply tries to strip each line of whitespace and parse as an integer, which will clearly fail in this case.
Solution should either redirect stderr elsewhere or update parsing to handle this.
was:
There have been a few spurious failures in ReplicationTest.test_hard_bounce, where it was reported that a few of the acked messages were not consumed.
Checking the logs, however, it is clear that they were consumed, but ConsoleConsumerService failed to parse.
Lines causing parsing failure looks something like:
779725[2015-08-03 07:25:47,757] ERROR [ConsumerFetcherThread-console-consumer-78957_ip-172-31-5-20-1438586715191-249db71c-0-1], Error for partition [test_topic,0] to broker 1:class kafka.common.NotLeaderForPartitionException (kafka.consumer.ConsumerFetcherThread)
(i.e. the consumed message, and a log message appear on the same line)
ConsoleConsumerService simply tries to strip each line of whitespace and parse as an integer, which will clearly fail in this case.
Solution should either redirect stderr elsewhere or update parsing to handle this.
> (new) system tests: ConsoleConsumerService occasionally fails to register consumed message
> ------------------------------------------------------------------------------------------
>
> Key: KAFKA-2408
> URL: https://issues.apache.org/jira/browse/KAFKA-2408
> Project: Kafka
> Issue Type: Bug
> Reporter: Geoffrey Anderson
> Assignee: Geoffrey Anderson
> Fix For: 0.8.3
>
>
> There have been a few spurious failures in ReplicationTest.test_hard_bounce, where it was reported that a few of the acked messages were not consumed.
> Checking the logs, however, it is clear that they were consumed, but ConsoleConsumerService failed to parse.
> Lines causing parsing failure looks something like:
> 779725[2015-08-03 07:25:47,757] ERROR [ConsumerFetcherThread-console-consumer-78957_ip-172-31-5-20-1438586715191-249db71c-0-1], Error for partition [test_topic,0] to broker 1:class kafka.common.NotLeaderForPartitionException (kafka.consumer.ConsumerFetcherThread)
> (i.e. the consumed message, and a log message appear on the same line)
> ConsoleConsumerService simply tries to strip each line of whitespace and parse as an integer, which will clearly fail in this case.
> Solution should either redirect stderr elsewhere or update parsing to handle this.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)