You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Yuheng Du <yu...@gmail.com> on 2015/07/24 16:09:31 UTC
properducertest on multiple nodes
Hi,
I am trying to run 20 performance test on 10 nodes using pbsdsh.
The messages will send to a 6 brokers cluster. It seems to work for a
while. When I delete the test queue and rerun the test, the broker does not
seem to process incoming messages:
[yuhengd@node1739 kafka_2.10-0.8.2.1]$ bin/kafka-run-class.sh
org.apache.kafka.clients.tools.ProducerPerformance speedx1 50000000 100 -1
acks=1 bootstrap.servers=130.127.133.72:9092 buffer.memory=67108864
batch.size=8196
1 records sent, 0.0 records/sec (0.00 MB/sec), 60000.0 ms avg latency,
60000.0 max latency.
org.apache.kafka.common.errors.TimeoutException: Failed to update metadata
after 79 ms.
Can anyone suggest what the problem is? Or what configuration should I
change? Thanks!
Re: properducertest on multiple nodes
Posted by Yuheng Du <yu...@gmail.com>.
I deleted the queue and recreated it before I run the test. Things are
working after restart the broker cluster, thanks!
On Fri, Jul 24, 2015 at 12:06 PM, Gwen Shapira <gs...@cloudera.com>
wrote:
> Does topic "speedx1" exist?
>
> On Fri, Jul 24, 2015 at 7:09 AM, Yuheng Du <yu...@gmail.com>
> wrote:
> > Hi,
> >
> > I am trying to run 20 performance test on 10 nodes using pbsdsh.
> >
> > The messages will send to a 6 brokers cluster. It seems to work for a
> > while. When I delete the test queue and rerun the test, the broker does
> not
> > seem to process incoming messages:
> >
> > [yuhengd@node1739 kafka_2.10-0.8.2.1]$ bin/kafka-run-class.sh
> > org.apache.kafka.clients.tools.ProducerPerformance speedx1 50000000 100
> -1
> > acks=1 bootstrap.servers=130.127.133.72:9092 buffer.memory=67108864
> > batch.size=8196
> >
> > 1 records sent, 0.0 records/sec (0.00 MB/sec), 60000.0 ms avg latency,
> > 60000.0 max latency.
> >
> > org.apache.kafka.common.errors.TimeoutException: Failed to update
> metadata
> > after 79 ms.
> >
> >
> > Can anyone suggest what the problem is? Or what configuration should I
> > change? Thanks!
>
Re: properducertest on multiple nodes
Posted by Gwen Shapira <gs...@cloudera.com>.
Does topic "speedx1" exist?
On Fri, Jul 24, 2015 at 7:09 AM, Yuheng Du <yu...@gmail.com> wrote:
> Hi,
>
> I am trying to run 20 performance test on 10 nodes using pbsdsh.
>
> The messages will send to a 6 brokers cluster. It seems to work for a
> while. When I delete the test queue and rerun the test, the broker does not
> seem to process incoming messages:
>
> [yuhengd@node1739 kafka_2.10-0.8.2.1]$ bin/kafka-run-class.sh
> org.apache.kafka.clients.tools.ProducerPerformance speedx1 50000000 100 -1
> acks=1 bootstrap.servers=130.127.133.72:9092 buffer.memory=67108864
> batch.size=8196
>
> 1 records sent, 0.0 records/sec (0.00 MB/sec), 60000.0 ms avg latency,
> 60000.0 max latency.
>
> org.apache.kafka.common.errors.TimeoutException: Failed to update metadata
> after 79 ms.
>
>
> Can anyone suggest what the problem is? Or what configuration should I
> change? Thanks!