You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@zookeeper.apache.org by Xuehan Xu <xx...@gmail.com> on 2011/09/14 08:34:36 UTC
Zookeeper Memory Leak?
Dear Sirs:
I'm learning how to use zookeeper. I've downloaded both the 3.2.0 and
3.3.3 versions. There are three zookeeper servers running on my PC with the
following configuration for each them, among which the dataDir and
clientPort are configured differently:
tickTime=2000
initLimit=10
syncLimit=5
dataDir=/export/mahadev/zookeeper/server1/data
clientPort=2181
server.1=10.65.134.219:2888:3888
server.2=10.65.134.219:2889:3889
server.3=10.65.134.219:2890:3890
I also wrote a client to report the PC performance information like memory
usage, network performance and idle cpu time to the zookeeper servers. The
report cycle is 2 seconds.
But both versions of zookeeper throws the OutOfMemoryError exception when
kept running for about 50 minutes. Is this due to a memory leak error inside
the zookeeper itself or some miss configuration of myself?
Thanks for your help:-)
Re: Zookeeper Memory Leak?
Posted by Ted Dunning <te...@gmail.com>.
OK.
And how much memory do you have on the machine? How much memory did you
allocate to each of the Zookeeper servers you are running? What else is on
the machine? What language are you calling Zookeeper from (I assume Java
from your comment about a POJO)?
Is there any way that you can run the three Zookeeper servers on separate
machines? That would let you use the default configuration and would
simplify debugging your configuration issue.
Finally, are you sure of the size of the data that you are writing to
Zookeeper? That is a long shot, but it wouldn't hurt to print out the size
of the byte array that you are writing to make sure it isn't growing by some
odd circumstance.
On Wed, Sep 14, 2011 at 3:06 PM, Xuehan Xu <xx...@gmail.com> wrote:
> I constructed under the "zookeeper" node an EPHEMERAL node representing my
> PC, and store the usage information of cpu, memory and hard disk in the
> form
> of a POJO as the data of the node which is refreshed every two seconds
>
> On 14 September 2011 20:25, Ted Dunning <te...@gmail.com> wrote:
>
> > What kind of data are you storing on the Zookeeper servers?
> >
> > On Wed, Sep 14, 2011 at 6:34 AM, Xuehan Xu <xx...@gmail.com>
> wrote:
> >
> > > Dear Sirs:
> > > I'm learning how to use zookeeper. I've downloaded both the 3.2.0
> > and
> > > 3.3.3 versions. There are three zookeeper servers running on my PC with
> > the
> > > following configuration for each them, among which the dataDir and
> > > clientPort are configured differently:
> > >
> > > tickTime=2000
> > > initLimit=10
> > > syncLimit=5
> > > dataDir=/export/mahadev/zookeeper/server1/data
> > > clientPort=2181
> > > server.1=10.65.134.219:2888:3888
> > > server.2=10.65.134.219:2889:3889
> > > server.3=10.65.134.219:2890:3890
> > >
> > > I also wrote a client to report the PC performance information like
> > memory
> > > usage, network performance and idle cpu time to the zookeeper servers.
> > The
> > > report cycle is 2 seconds.
> > >
> > > But both versions of zookeeper throws the OutOfMemoryError exception
> when
> > > kept running for about 50 minutes. Is this due to a memory leak error
> > > inside
> > > the zookeeper itself or some miss configuration of myself?
> > >
> > > Thanks for your help:-)
> > >
> >
>
Re: Zookeeper Memory Leak?
Posted by dennis zhuang <ki...@gmail.com>.
Did you replace the statistics data or append it?
It seems zookeeper keep data in memory,if you kept appending data to
zookeeper,it may out of memory.
2011/9/15 Xuehan Xu <xx...@gmail.com>
> Yes, under the /zookeeper
>
> On 14 September 2011 23:13, kishore g <g....@gmail.com> wrote:
>
> > *I constructed under the "zookeeper" node*
> > Do you mean you created under /zookeeper.
> >
> > On Wed, Sep 14, 2011 at 8:06 AM, Xuehan Xu <xx...@gmail.com>
> wrote:
> >
> > > I constructed under the "zookeeper" node an EPHEMERAL node
> representing
> > my
> > > PC, and store the usage information of cpu, memory and hard disk in the
> > > form
> > > of a POJO as the data of the node which is refreshed every two seconds
> > >
> > > On 14 September 2011 20:25, Ted Dunning <te...@gmail.com> wrote:
> > >
> > > > What kind of data are you storing on the Zookeeper servers?
> > > >
> > > > On Wed, Sep 14, 2011 at 6:34 AM, Xuehan Xu <xx...@gmail.com>
> > > wrote:
> > > >
> > > > > Dear Sirs:
> > > > > I'm learning how to use zookeeper. I've downloaded both the
> > 3.2.0
> > > > and
> > > > > 3.3.3 versions. There are three zookeeper servers running on my PC
> > with
> > > > the
> > > > > following configuration for each them, among which the dataDir and
> > > > > clientPort are configured differently:
> > > > >
> > > > > tickTime=2000
> > > > > initLimit=10
> > > > > syncLimit=5
> > > > > dataDir=/export/mahadev/zookeeper/server1/data
> > > > > clientPort=2181
> > > > > server.1=10.65.134.219:2888:3888
> > > > > server.2=10.65.134.219:2889:3889
> > > > > server.3=10.65.134.219:2890:3890
> > > > >
> > > > > I also wrote a client to report the PC performance information like
> > > > memory
> > > > > usage, network performance and idle cpu time to the zookeeper
> > servers.
> > > > The
> > > > > report cycle is 2 seconds.
> > > > >
> > > > > But both versions of zookeeper throws the OutOfMemoryError
> exception
> > > when
> > > > > kept running for about 50 minutes. Is this due to a memory leak
> error
> > > > > inside
> > > > > the zookeeper itself or some miss configuration of myself?
> > > > >
> > > > > Thanks for your help:-)
> > > > >
> > > >
> > >
> >
>
--
庄晓丹
Email: killme2008@gmail.com
伯岩(花名) boyan@taobao.com
Site: http://fnil.net
淘宝（中国）软件有限公司 / 产品技术部 / Java中间件
Re: Zookeeper Memory Leak?
Posted by Xuehan Xu <xx...@gmail.com>.
Yes, under the /zookeeper
On 14 September 2011 23:13, kishore g <g....@gmail.com> wrote:
> *I constructed under the "zookeeper" node*
> Do you mean you created under /zookeeper.
>
> On Wed, Sep 14, 2011 at 8:06 AM, Xuehan Xu <xx...@gmail.com> wrote:
>
> > I constructed under the "zookeeper" node an EPHEMERAL node representing
> my
> > PC, and store the usage information of cpu, memory and hard disk in the
> > form
> > of a POJO as the data of the node which is refreshed every two seconds
> >
> > On 14 September 2011 20:25, Ted Dunning <te...@gmail.com> wrote:
> >
> > > What kind of data are you storing on the Zookeeper servers?
> > >
> > > On Wed, Sep 14, 2011 at 6:34 AM, Xuehan Xu <xx...@gmail.com>
> > wrote:
> > >
> > > > Dear Sirs:
> > > > I'm learning how to use zookeeper. I've downloaded both the
> 3.2.0
> > > and
> > > > 3.3.3 versions. There are three zookeeper servers running on my PC
> with
> > > the
> > > > following configuration for each them, among which the dataDir and
> > > > clientPort are configured differently:
> > > >
> > > > tickTime=2000
> > > > initLimit=10
> > > > syncLimit=5
> > > > dataDir=/export/mahadev/zookeeper/server1/data
> > > > clientPort=2181
> > > > server.1=10.65.134.219:2888:3888
> > > > server.2=10.65.134.219:2889:3889
> > > > server.3=10.65.134.219:2890:3890
> > > >
> > > > I also wrote a client to report the PC performance information like
> > > memory
> > > > usage, network performance and idle cpu time to the zookeeper
> servers.
> > > The
> > > > report cycle is 2 seconds.
> > > >
> > > > But both versions of zookeeper throws the OutOfMemoryError exception
> > when
> > > > kept running for about 50 minutes. Is this due to a memory leak error
> > > > inside
> > > > the zookeeper itself or some miss configuration of myself?
> > > >
> > > > Thanks for your help:-)
> > > >
> > >
> >
>
Re: Zookeeper Memory Leak?
Posted by kishore g <g....@gmail.com>.
*I constructed under the "zookeeper" node*
Do you mean you created under /zookeeper.
On Wed, Sep 14, 2011 at 8:06 AM, Xuehan Xu <xx...@gmail.com> wrote:
> I constructed under the "zookeeper" node an EPHEMERAL node representing my
> PC, and store the usage information of cpu, memory and hard disk in the
> form
> of a POJO as the data of the node which is refreshed every two seconds
>
> On 14 September 2011 20:25, Ted Dunning <te...@gmail.com> wrote:
>
> > What kind of data are you storing on the Zookeeper servers?
> >
> > On Wed, Sep 14, 2011 at 6:34 AM, Xuehan Xu <xx...@gmail.com>
> wrote:
> >
> > > Dear Sirs:
> > > I'm learning how to use zookeeper. I've downloaded both the 3.2.0
> > and
> > > 3.3.3 versions. There are three zookeeper servers running on my PC with
> > the
> > > following configuration for each them, among which the dataDir and
> > > clientPort are configured differently:
> > >
> > > tickTime=2000
> > > initLimit=10
> > > syncLimit=5
> > > dataDir=/export/mahadev/zookeeper/server1/data
> > > clientPort=2181
> > > server.1=10.65.134.219:2888:3888
> > > server.2=10.65.134.219:2889:3889
> > > server.3=10.65.134.219:2890:3890
> > >
> > > I also wrote a client to report the PC performance information like
> > memory
> > > usage, network performance and idle cpu time to the zookeeper servers.
> > The
> > > report cycle is 2 seconds.
> > >
> > > But both versions of zookeeper throws the OutOfMemoryError exception
> when
> > > kept running for about 50 minutes. Is this due to a memory leak error
> > > inside
> > > the zookeeper itself or some miss configuration of myself?
> > >
> > > Thanks for your help:-)
> > >
> >
>
Re: Zookeeper Memory Leak?
Posted by Xuehan Xu <xx...@gmail.com>.
I constructed under the "zookeeper" node an EPHEMERAL node representing my
PC, and store the usage information of cpu, memory and hard disk in the form
of a POJO as the data of the node which is refreshed every two seconds
On 14 September 2011 20:25, Ted Dunning <te...@gmail.com> wrote:
> What kind of data are you storing on the Zookeeper servers?
>
> On Wed, Sep 14, 2011 at 6:34 AM, Xuehan Xu <xx...@gmail.com> wrote:
>
> > Dear Sirs:
> > I'm learning how to use zookeeper. I've downloaded both the 3.2.0
> and
> > 3.3.3 versions. There are three zookeeper servers running on my PC with
> the
> > following configuration for each them, among which the dataDir and
> > clientPort are configured differently:
> >
> > tickTime=2000
> > initLimit=10
> > syncLimit=5
> > dataDir=/export/mahadev/zookeeper/server1/data
> > clientPort=2181
> > server.1=10.65.134.219:2888:3888
> > server.2=10.65.134.219:2889:3889
> > server.3=10.65.134.219:2890:3890
> >
> > I also wrote a client to report the PC performance information like
> memory
> > usage, network performance and idle cpu time to the zookeeper servers.
> The
> > report cycle is 2 seconds.
> >
> > But both versions of zookeeper throws the OutOfMemoryError exception when
> > kept running for about 50 minutes. Is this due to a memory leak error
> > inside
> > the zookeeper itself or some miss configuration of myself?
> >
> > Thanks for your help:-)
> >
>
Re: Zookeeper Memory Leak?
Posted by Ted Dunning <te...@gmail.com>.
What kind of data are you storing on the Zookeeper servers?
On Wed, Sep 14, 2011 at 6:34 AM, Xuehan Xu <xx...@gmail.com> wrote:
> Dear Sirs:
> I'm learning how to use zookeeper. I've downloaded both the 3.2.0 and
> 3.3.3 versions. There are three zookeeper servers running on my PC with the
> following configuration for each them, among which the dataDir and
> clientPort are configured differently:
>
> tickTime=2000
> initLimit=10
> syncLimit=5
> dataDir=/export/mahadev/zookeeper/server1/data
> clientPort=2181
> server.1=10.65.134.219:2888:3888
> server.2=10.65.134.219:2889:3889
> server.3=10.65.134.219:2890:3890
>
> I also wrote a client to report the PC performance information like memory
> usage, network performance and idle cpu time to the zookeeper servers. The
> report cycle is 2 seconds.
>
> But both versions of zookeeper throws the OutOfMemoryError exception when
> kept running for about 50 minutes. Is this due to a memory leak error
> inside
> the zookeeper itself or some miss configuration of myself?
>
> Thanks for your help:-)
>