You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Sathyakumar Seshachalam <Sa...@Trimble.com> on 2015/10/28 09:55:36 UTC
Kafka console producer stuck
Am trying to get started on Kafka and following instructions on http://kafka.apache.org/documentation.html#quickstart.
Am setting up on a single broker. I got as far as creating topics and listing them, but when I try kafka-console-producer.sh to add messages, I ended up in below error.
[2015-10-28 14:14:46,140] WARN Property topic is not valid (kafka.utils.VerifiableProperties).
My google searches generally hinted that I should set the right value for “advertised.host.name”, But setting that has no effect.
Any help overcoming this will be appreciated.
Am running version kafka_2.11-0.8.2.1.tgz on OS X.
Regards,
Sathya
Re: Kafka console producer stuck
Posted by Sathyakumar Seshachalam <Sa...@Trimble.com>.
Thanks.
Worked like a charm.
On 10/28/15, 9:59 PM, "Grant Henke" <gh...@cloudera.com> wrote:
>The docs don't necessarily make it clear, but if you don't pipe data into
>the console-producer, it waits for your typed input (stdin). This is shown
>in the docs with the lines just below "*bin/kafka-console-producer.sh
>--broker-list localhost:9092 --topic test*" that show:
>
>This is a message
>> This is another message
>
>
>Otherwise, a quick command I like to use when playing around with the
>console-producer is:
>
>*vmstat -w -n -t 1 | kafka-console-producer --broker-list
>my-broker-host:9092 --topic my-topic*
>
>vmstat <http://linux.die.net/man/8/vmstat> and other similar linux
>utilities (iostat <http://linux.die.net/man/1/iostat>) are a great way to
>get quick and real data for experimentation.
>
>Thanks,
>Grant
>
>On Wed, Oct 28, 2015 at 10:49 AM, Sathyakumar Seshachalam <
>Sathyakumar_Seshachalam@trimble.com> wrote:
>
>> Hi Grant,
>>
>> But then my console producer is not sending any message to the broker.
>>It
>> just prints that warning and keeps waiting.
>>
>> I have verified that console producer is "not" sending messages by
>> actually running console consumer. And a Java client that sends messages
>> works and the console consumer is able to read them fine. It is just
>>the
>> console producer that doesn't seem to work (or at least as per the quick
>> start link)
>>
>>
>>
>> Sent from my iPhone
>>
>> > On 28-Oct-2015, at 7:34 PM, Grant Henke <gh...@cloudera.com> wrote:
>> >
>> > Hi Sathya,
>> >
>> > This was a bug that is now fixed in trunk and will be included in the
>> next
>> > release. See KAFKA-1711 <
>> https://issues.apache.org/jira/browse/KAFKA-1711> for
>> > more details.
>> >
>> > You can safely ignore the warning and it should not impact the usage
>>of
>> the
>> > console producer.
>> >
>> > Thank you,
>> > Grant
>> >
>> > On Wed, Oct 28, 2015 at 5:49 AM, Sathyakumar Seshachalam <
>> > Sathyakumar_Seshachalam@trimble.com> wrote:
>> >
>> >> Hi, Its the same as in the Quick Start tutorial
>> >>
>> >> bin/kafka-console-producer.sh --broker-list localhost:9092 --topic
>>test
>> >>
>> >>
>> >>> On 10/28/15, 4:06 PM, "Prabhjot Bharaj" <pr...@gmail.com>
>>wrote:
>> >>>
>> >>> Hi,
>> >>>
>> >>> It seems (from VerifiableProperties.scala -
>> >>
>>
>>https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/util
>>s
>> >>> /VerifiableProperties.scala#L224)
>> >>> that you are providing some property which kafka does not recognise
>> >>> Please share the full command that you are trying to use
>> >>>
>> >>> Regards,
>> >>> Prabhjot
>> >>>
>> >>> On Wed, Oct 28, 2015 at 2:25 PM, Sathyakumar Seshachalam <
>> >>> Sathyakumar_Seshachalam@trimble.com> wrote:
>> >>>
>> >>>> Am trying to get started on Kafka and following instructions on
>> >>>> http://kafka.apache.org/documentation.html#quickstart.
>> >>>> Am setting up on a single broker. I got as far as creating topics
>>and
>> >>>> listing them, but when I try kafka-console-producer.sh to add
>> >>>> messages, I
>> >>>> ended up in below error.
>> >>>>
>> >>>> [2015-10-28 14:14:46,140] WARN Property topic is not valid
>> >>>> (kafka.utils.VerifiableProperties).
>> >>>>
>> >>>> My google searches generally hinted that I should set the right
>>value
>> >>>> for ³
>> >>>> advertised.host.name², But setting that has no effect.
>> >>>> Any help overcoming this will be appreciated.
>> >>>>
>> >>>> Am running version kafka_2.11-0.8.2.1.tgz on OS X.
>> >>>>
>> >>>> Regards,
>> >>>> Sathya
>> >>>
>> >>>
>> >>> --
>> >>> ---------------------------------------------------------
>> >>> "There are only 10 types of people in the world: Those who
>>understand
>> >>> binary, and those who don't"
>> >
>> >
>> > --
>> > Grant Henke
>> > Software Engineer | Cloudera
>> > grant@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke
>>
>
>
>
>--
>Grant Henke
>Software Engineer | Cloudera
>grant@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke
Re: Kafka console producer stuck
Posted by Grant Henke <gh...@cloudera.com>.
The docs don't necessarily make it clear, but if you don't pipe data into
the console-producer, it waits for your typed input (stdin). This is shown
in the docs with the lines just below "*bin/kafka-console-producer.sh
--broker-list localhost:9092 --topic test*" that show:
This is a message
> This is another message
Otherwise, a quick command I like to use when playing around with the
console-producer is:
*vmstat -w -n -t 1 | kafka-console-producer --broker-list
my-broker-host:9092 --topic my-topic*
vmstat <http://linux.die.net/man/8/vmstat> and other similar linux
utilities (iostat <http://linux.die.net/man/1/iostat>) are a great way to
get quick and real data for experimentation.
Thanks,
Grant
On Wed, Oct 28, 2015 at 10:49 AM, Sathyakumar Seshachalam <
Sathyakumar_Seshachalam@trimble.com> wrote:
> Hi Grant,
>
> But then my console producer is not sending any message to the broker. It
> just prints that warning and keeps waiting.
>
> I have verified that console producer is "not" sending messages by
> actually running console consumer. And a Java client that sends messages
> works and the console consumer is able to read them fine. It is just the
> console producer that doesn't seem to work (or at least as per the quick
> start link)
>
>
>
> Sent from my iPhone
>
> > On 28-Oct-2015, at 7:34 PM, Grant Henke <gh...@cloudera.com> wrote:
> >
> > Hi Sathya,
> >
> > This was a bug that is now fixed in trunk and will be included in the
> next
> > release. See KAFKA-1711 <
> https://issues.apache.org/jira/browse/KAFKA-1711> for
> > more details.
> >
> > You can safely ignore the warning and it should not impact the usage of
> the
> > console producer.
> >
> > Thank you,
> > Grant
> >
> > On Wed, Oct 28, 2015 at 5:49 AM, Sathyakumar Seshachalam <
> > Sathyakumar_Seshachalam@trimble.com> wrote:
> >
> >> Hi, Its the same as in the Quick Start tutorial
> >>
> >> bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
> >>
> >>
> >>> On 10/28/15, 4:06 PM, "Prabhjot Bharaj" <pr...@gmail.com> wrote:
> >>>
> >>> Hi,
> >>>
> >>> It seems (from VerifiableProperties.scala -
> >>
> https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/utils
> >>> /VerifiableProperties.scala#L224)
> >>> that you are providing some property which kafka does not recognise
> >>> Please share the full command that you are trying to use
> >>>
> >>> Regards,
> >>> Prabhjot
> >>>
> >>> On Wed, Oct 28, 2015 at 2:25 PM, Sathyakumar Seshachalam <
> >>> Sathyakumar_Seshachalam@trimble.com> wrote:
> >>>
> >>>> Am trying to get started on Kafka and following instructions on
> >>>> http://kafka.apache.org/documentation.html#quickstart.
> >>>> Am setting up on a single broker. I got as far as creating topics and
> >>>> listing them, but when I try kafka-console-producer.sh to add
> >>>> messages, I
> >>>> ended up in below error.
> >>>>
> >>>> [2015-10-28 14:14:46,140] WARN Property topic is not valid
> >>>> (kafka.utils.VerifiableProperties).
> >>>>
> >>>> My google searches generally hinted that I should set the right value
> >>>> for ³
> >>>> advertised.host.name², But setting that has no effect.
> >>>> Any help overcoming this will be appreciated.
> >>>>
> >>>> Am running version kafka_2.11-0.8.2.1.tgz on OS X.
> >>>>
> >>>> Regards,
> >>>> Sathya
> >>>
> >>>
> >>> --
> >>> ---------------------------------------------------------
> >>> "There are only 10 types of people in the world: Those who understand
> >>> binary, and those who don't"
> >
> >
> > --
> > Grant Henke
> > Software Engineer | Cloudera
> > grant@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke
>
--
Grant Henke
Software Engineer | Cloudera
grant@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke
Re: Kafka console producer stuck
Posted by Sathyakumar Seshachalam <Sa...@Trimble.com>.
Hi Grant,
But then my console producer is not sending any message to the broker. It just prints that warning and keeps waiting.
I have verified that console producer is "not" sending messages by actually running console consumer. And a Java client that sends messages works and the console consumer is able to read them fine. It is just the console producer that doesn't seem to work (or at least as per the quick start link)
Sent from my iPhone
> On 28-Oct-2015, at 7:34 PM, Grant Henke <gh...@cloudera.com> wrote:
>
> Hi Sathya,
>
> This was a bug that is now fixed in trunk and will be included in the next
> release. See KAFKA-1711 <https://issues.apache.org/jira/browse/KAFKA-1711> for
> more details.
>
> You can safely ignore the warning and it should not impact the usage of the
> console producer.
>
> Thank you,
> Grant
>
> On Wed, Oct 28, 2015 at 5:49 AM, Sathyakumar Seshachalam <
> Sathyakumar_Seshachalam@trimble.com> wrote:
>
>> Hi, Its the same as in the Quick Start tutorial
>>
>> bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
>>
>>
>>> On 10/28/15, 4:06 PM, "Prabhjot Bharaj" <pr...@gmail.com> wrote:
>>>
>>> Hi,
>>>
>>> It seems (from VerifiableProperties.scala -
>> https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/utils
>>> /VerifiableProperties.scala#L224)
>>> that you are providing some property which kafka does not recognise
>>> Please share the full command that you are trying to use
>>>
>>> Regards,
>>> Prabhjot
>>>
>>> On Wed, Oct 28, 2015 at 2:25 PM, Sathyakumar Seshachalam <
>>> Sathyakumar_Seshachalam@trimble.com> wrote:
>>>
>>>> Am trying to get started on Kafka and following instructions on
>>>> http://kafka.apache.org/documentation.html#quickstart.
>>>> Am setting up on a single broker. I got as far as creating topics and
>>>> listing them, but when I try kafka-console-producer.sh to add
>>>> messages, I
>>>> ended up in below error.
>>>>
>>>> [2015-10-28 14:14:46,140] WARN Property topic is not valid
>>>> (kafka.utils.VerifiableProperties).
>>>>
>>>> My google searches generally hinted that I should set the right value
>>>> for ³
>>>> advertised.host.name², But setting that has no effect.
>>>> Any help overcoming this will be appreciated.
>>>>
>>>> Am running version kafka_2.11-0.8.2.1.tgz on OS X.
>>>>
>>>> Regards,
>>>> Sathya
>>>
>>>
>>> --
>>> ---------------------------------------------------------
>>> "There are only 10 types of people in the world: Those who understand
>>> binary, and those who don't"
>
>
> --
> Grant Henke
> Software Engineer | Cloudera
> grant@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke
Re: Kafka console producer stuck
Posted by Grant Henke <gh...@cloudera.com>.
Hi Sathya,
This was a bug that is now fixed in trunk and will be included in the next
release. See KAFKA-1711 <https://issues.apache.org/jira/browse/KAFKA-1711> for
more details.
You can safely ignore the warning and it should not impact the usage of the
console producer.
Thank you,
Grant
On Wed, Oct 28, 2015 at 5:49 AM, Sathyakumar Seshachalam <
Sathyakumar_Seshachalam@trimble.com> wrote:
> Hi, Its the same as in the Quick Start tutorial
>
> bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
>
>
> On 10/28/15, 4:06 PM, "Prabhjot Bharaj" <pr...@gmail.com> wrote:
>
> >Hi,
> >
> >It seems (from VerifiableProperties.scala -
> >
> https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/utils
> >/VerifiableProperties.scala#L224)
> >that you are providing some property which kafka does not recognise
> >Please share the full command that you are trying to use
> >
> >Regards,
> >Prabhjot
> >
> >On Wed, Oct 28, 2015 at 2:25 PM, Sathyakumar Seshachalam <
> >Sathyakumar_Seshachalam@trimble.com> wrote:
> >
> >> Am trying to get started on Kafka and following instructions on
> >> http://kafka.apache.org/documentation.html#quickstart.
> >> Am setting up on a single broker. I got as far as creating topics and
> >> listing them, but when I try kafka-console-producer.sh to add
> >>messages, I
> >> ended up in below error.
> >>
> >> [2015-10-28 14:14:46,140] WARN Property topic is not valid
> >> (kafka.utils.VerifiableProperties).
> >>
> >> My google searches generally hinted that I should set the right value
> >>for ³
> >> advertised.host.name², But setting that has no effect.
> >> Any help overcoming this will be appreciated.
> >>
> >> Am running version kafka_2.11-0.8.2.1.tgz on OS X.
> >>
> >> Regards,
> >> Sathya
> >>
> >>
> >
> >
> >--
> >---------------------------------------------------------
> >"There are only 10 types of people in the world: Those who understand
> >binary, and those who don't"
>
>
--
Grant Henke
Software Engineer | Cloudera
grant@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke
Re: Kafka console producer stuck
Posted by Sathyakumar Seshachalam <Sa...@Trimble.com>.
Hi, Its the same as in the Quick Start tutorial
bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
On 10/28/15, 4:06 PM, "Prabhjot Bharaj" <pr...@gmail.com> wrote:
>Hi,
>
>It seems (from VerifiableProperties.scala -
>https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/utils
>/VerifiableProperties.scala#L224)
>that you are providing some property which kafka does not recognise
>Please share the full command that you are trying to use
>
>Regards,
>Prabhjot
>
>On Wed, Oct 28, 2015 at 2:25 PM, Sathyakumar Seshachalam <
>Sathyakumar_Seshachalam@trimble.com> wrote:
>
>> Am trying to get started on Kafka and following instructions on
>> http://kafka.apache.org/documentation.html#quickstart.
>> Am setting up on a single broker. I got as far as creating topics and
>> listing them, but when I try kafka-console-producer.sh to add
>>messages, I
>> ended up in below error.
>>
>> [2015-10-28 14:14:46,140] WARN Property topic is not valid
>> (kafka.utils.VerifiableProperties).
>>
>> My google searches generally hinted that I should set the right value
>>for ³
>> advertised.host.name², But setting that has no effect.
>> Any help overcoming this will be appreciated.
>>
>> Am running version kafka_2.11-0.8.2.1.tgz on OS X.
>>
>> Regards,
>> Sathya
>>
>>
>
>
>--
>---------------------------------------------------------
>"There are only 10 types of people in the world: Those who understand
>binary, and those who don't"
Re: Kafka console producer stuck
Posted by Prabhjot Bharaj <pr...@gmail.com>.
Hi,
It seems (from VerifiableProperties.scala -
https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/utils/VerifiableProperties.scala#L224)
that you are providing some property which kafka does not recognise
Please share the full command that you are trying to use
Regards,
Prabhjot
On Wed, Oct 28, 2015 at 2:25 PM, Sathyakumar Seshachalam <
Sathyakumar_Seshachalam@trimble.com> wrote:
> Am trying to get started on Kafka and following instructions on
> http://kafka.apache.org/documentation.html#quickstart.
> Am setting up on a single broker. I got as far as creating topics and
> listing them, but when I try kafka-console-producer.sh to add messages, I
> ended up in below error.
>
> [2015-10-28 14:14:46,140] WARN Property topic is not valid
> (kafka.utils.VerifiableProperties).
>
> My google searches generally hinted that I should set the right value for “
> advertised.host.name”, But setting that has no effect.
> Any help overcoming this will be appreciated.
>
> Am running version kafka_2.11-0.8.2.1.tgz on OS X.
>
> Regards,
> Sathya
>
>
--
---------------------------------------------------------
"There are only 10 types of people in the world: Those who understand
binary, and those who don't"