You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by 陈超 <ch...@midrive.com.cn> on 2016/12/07 07:55:27 UTC
kafka cluster network bandwidth is too high
Hi kafka developer,
I have a kafka cluster with 3 node. And it have 3 topic now. We
have not many data into the kafka topic now. But the node sync data to each
other node bandwidth is up to 4 Mb/s. I don��t know why so high. This is the
picture below:
Iftop info:
˵��:
C:\Users\lenovo\AppData\Roaming\Tencent\Users\247135449\QQ\WinTemp\RichOle\P
ZZ[Q[7A8_0F%{WM6ZC[K{O.png
Ps �Cmp kafkapid �Co THREAD,tid,time
˵��:
C:\Users\lenovo\AppData\Roaming\Tencent\Users\247135449\QQ\WinTemp\RichOle\5
(X37VYS5XVO7@@MF6SMX6T.png
Jstack info:
˵��:
C:\Users\lenovo\AppData\Roaming\Tencent\Users\247135449\QQ\WinTemp\RichOle\S
EXO2G62J[L9}GDSO7)BS}B.png
Can you help me find the problem?
Thank you very much!
Re: kafka cluster network bandwidth is too high
Posted by Stephen Powis <sp...@salesforce.com>.
Yea, we have a 7 node cluster with ~200 topics and see sustained 100Mbps
going between the nodes. Very bandwidth hungry :p
On Thu, Dec 8, 2016 at 1:51 AM, Matthias J. Sax <ma...@confluent.io>
wrote:
> You cannot sent images over the mailing list. They get automatically
> removed.
>
> On 12/6/16 11:55 PM, 陈超 wrote:
> > Hi kafka developer,
> >
> >
> >
> > I have a kafka cluster with 3 node. And it have 3 topic now. We
> > have not many data into the kafka topic now. But the node sync data to
> > each other node bandwidth is up to 4 Mb/s. I don’t know why so high.
> > This is the picture below:
> >
> >
> >
> > Iftop info:
> >
> > 说明:
> > C:\Users\lenovo\AppData\Roaming\Tencent\Users\
> 247135449\QQ\WinTemp\RichOle\PZZ[Q[7A8_0F%{WM6ZC[K{O.png
> >
> >
> >
> > Ps –mp kafkapid –o THREAD,tid,time
> >
> > 说明:
> > C:\Users\lenovo\AppData\Roaming\Tencent\Users\
> 247135449\QQ\WinTemp\RichOle\5(X37VYS5XVO7@@MF6SMX6T.png
> >
> >
> >
> > Jstack info:
> >
> > 说明:
> > C:\Users\lenovo\AppData\Roaming\Tencent\Users\
> 247135449\QQ\WinTemp\RichOle\SEXO2G62J[L9}GDSO7)BS}B.png
> >
> >
> >
> > Can you help me find the problem?
> >
> > Thank you very much!
> >
>
>
Re: kafka cluster network bandwidth is too high
Posted by "Matthias J. Sax" <ma...@confluent.io>.
You cannot sent images over the mailing list. They get automatically
removed.
On 12/6/16 11:55 PM, 陈超 wrote:
> Hi kafka developer,
>
>
>
> I have a kafka cluster with 3 node. And it have 3 topic now. We
> have not many data into the kafka topic now. But the node sync data to
> each other node bandwidth is up to 4 Mb/s. I don’t know why so high.
> This is the picture below:
>
>
>
> Iftop info:
>
> 说明:
> C:\Users\lenovo\AppData\Roaming\Tencent\Users\247135449\QQ\WinTemp\RichOle\PZZ[Q[7A8_0F%{WM6ZC[K{O.png
>
>
>
> Ps –mp kafkapid –o THREAD,tid,time
>
> 说明:
> C:\Users\lenovo\AppData\Roaming\Tencent\Users\247135449\QQ\WinTemp\RichOle\5(X37VYS5XVO7@@MF6SMX6T.png
>
>
>
> Jstack info:
>
> 说明:
> C:\Users\lenovo\AppData\Roaming\Tencent\Users\247135449\QQ\WinTemp\RichOle\SEXO2G62J[L9}GDSO7)BS}B.png
>
>
>
> Can you help me find the problem?
>
> Thank you very much!
>