[jira] [Commented] (KAFKA-3129) Console producer issue when request-required-acks=0

["Pankaj (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16045812#comment-16045812 ] 

Pankaj commented on KAFKA-3129:
-------------------------------

[~cotedm], [~ijuma], [~vahid] I am also facing the same issue where my kafka console producer fails to write data. Please find below steps to recreate.

1-Make a text file with 800 record. each line have record like "Message 1"  and the line 2 "Message 2" ........ "Message 800"
2- # start zookeeper server
.\bin\windows\zookeeper-server-start.bat .\config\zookeeper.properties

3-# start broker
.\bin\windows\kafka-server-start.bat .\config\server.properties 

4-# create topic “test”
.\bin\windows\kafka-topics.bat --create --topic test --zookeeper localhost:2181 --partitions 1 --replication-factor 1

5-#start consumer
.\bin\windows\kafka-console-consumer.bat --topic test --zookeeper localhost:2181

6-sent file to producer
.\bin\windows\\kafka-console-producer.bat --broker-list localhost:9092 --topic test < my_file.txt

I have executed all above steps with below configuration.(Windows 7, kafka_2.11-0.10.0.1)
1- Default kafka configuration- NOK(Sometimes it consumes 366 messages, sometimes 700 messages.)
2- Updating kafka producer.properties for acks="1" or acks="all". both did not worked. still  NOK(Sometimes it consumes 366 messages, sometimes 700 messages.).

Please suggest if this issue has been fixed. I'm facing critical problem on production

> Console producer issue when request-required-acks=0
> ---------------------------------------------------
>
>                 Key: KAFKA-3129
>                 URL: https://issues.apache.org/jira/browse/KAFKA-3129
>             Project: Kafka
>          Issue Type: Bug
>          Components: producer 
>    Affects Versions: 0.9.0.0, 0.10.0.0
>            Reporter: Vahid Hashemian
>            Assignee: Dustin Cote
>         Attachments: kafka-3129.mov, server.log.abnormal.txt, server.log.normal.txt
>
>
> I have been running a simple test case in which I have a text file {{messages.txt}} with 1,000,000 lines (lines contain numbers from 1 to 1,000,000 in ascending order). I run the console consumer like this:
> {{$ bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic test}}
> Topic {{test}} is on 1 partition with a replication factor of 1.
> Then I run the console producer like this:
> {{$ bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test < messages.txt}}
> Then the console starts receiving the messages. And about half the times it goes all the way to 1,000,000. But, in other cases, it stops short, usually at 999,735.
> I tried running another console consumer on another machine and both consumers behave the same way. I can't see anything related to this in the logs.
> I also ran the same experiment with a similar file of 10,000 lines, and am getting a similar behavior. When the consumer does not receive all the 10,000 messages it usually stops at 9,864.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)