You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Meng QingPing <mq...@gmail.com> on 2014/05/05 03:57:13 UTC
Is there a bug in hiveserver2 metastore caused hold huge objects
I run hiveserver2 with metastore in mysql. The hiveserver2 OOM and the heap
dump show huge objects hold by "org.datanucleus.api.jdo.
JDOPersistenceManagerFactory" as attached. It seems not release
org.datanucleus.api.jdo.JDOPersistenceManager. Hive version is 0.13.
Thanks,
Jack
Re: Is there a bug in hiveserver2 metastore caused hold huge objects
Posted by Bryan Jeffrey <br...@gmail.com>.
Any further word on this? We're seeing a major memory leak too.
On May 21, 2014 10:03 PM, "Meng QingPing" <mq...@gmail.com> wrote:
> Vaibhav, thanks for reply.
> It's a remote metastore, stored in mysql.
>
>
> 2014-05-22 5:31 GMT+08:00 Vaibhav Gumashta <vg...@hortonworks.com>:
>
> > Meng, are you running a remote metastore or an embedded one (which would
> be
> > true if you added this config while starting HS2: -hiveconf
> > hive.metastore.uris=" ")?
> >
> > Thanks,
> > --Vaibhav
> >
> >
> > On Wed, May 21, 2014 at 2:28 PM, Vaibhav Gumashta <
> > vgumashta@hortonworks.com
> > > wrote:
> >
> > > Thanks a lot for the dump Meng!
> > >
> > >
> > > On Wed, May 21, 2014 at 1:41 AM, Meng QingPing <mqingping@gmail.com
> > >wrote:
> > >
> > >> I post the heap bin file on http://jack-meng.qiniudn.com/heap.bin
> > >>
> > >> Thanks.
> > >>
> > >>
> > >> 2014-05-21 15:41 GMT+08:00 Meng QingPing <mq...@gmail.com>:
> > >>
> > >> > There are 18908 PM-s. I post it on
> > >> > http://jack-meng.qiniudn.com/hive-heap2.png
> > >> >
> > >> > Thanks.
> > >> >
> > >> >
> > >> > 2014-05-20 0:41 GMT+08:00 Sergey Shelukhin <sergey@hortonworks.com
> >:
> > >> >
> > >> > What is the count of PM-s that you are seeing when it crashes? From
> > that
> > >> >> screenshot I don't see what the problem is or I'm not reading it
> > right.
> > >> >>
> > >> >>
> > >> >> On Mon, May 19, 2014 at 1:17 AM, Meng QingPing <
> mqingping@gmail.com>
> > >> >> wrote:
> > >> >>
> > >> >> > Thanks.
> > >> >> >
> > >> >> > I post it on http://jack-meng.qiniudn.com/hive-heap.png
> > >> >> >
> > >> >> >
> > >> >> >
> > >> >> >
> > >> >> > 2014-05-06 23:14 GMT+08:00 Sergey Shelukhin <
> > sergey@hortonworks.com
> > >> >:
> > >> >> >
> > >> >> > > I don't think the dev list supports attachment. Can you post to
> > >> some
> > >> >> > image
> > >> >> > > sharing service?
> > >> >> > >
> > >> >> > >
> > >> >> > > On Tue, May 6, 2014 at 3:20 AM, Meng QingPing <
> > mqingping@gmail.com
> > >> >
> > >> >> > wrote:
> > >> >> > >
> > >> >> > > >
> > >> >> > > > Weird, the picture attached in sent mail.
> > >> >> > > >
> > >> >> > > > Anyway send again.
> > >> >> > > >
> > >> >> > > >
> > >> >> > > > 2014-05-05 12:17 GMT+08:00 Chandra Reddy <
> chandu.cr@gmail.com
> > >:
> > >> >> > > >
> > >> >> > > > seems you have missed attachment.
> > >> >> > > >> -Chandra
> > >> >> > > >>
> > >> >> > > >>
> > >> >> > > >> On Sun, May 4, 2014 at 6:57 PM, Meng QingPing <
> > >> mqingping@gmail.com
> > >> >> >
> > >> >> > > >> wrote:
> > >> >> > > >>
> > >> >> > > >> > I run hiveserver2 with metastore in mysql. The hiveserver2
> > OOM
> > >> >> and
> > >> >> > the
> > >> >> > > >> > heap dump show huge objects hold by
> > "org.datanucleus.api.jdo.
> > >> >> > > >> > JDOPersistenceManagerFactory" as attached. It seems not
> > >> release
> > >> >> > > >> > org.datanucleus.api.jdo.JDOPersistenceManager. Hive
> version
> > is
> > >> >> 0.13.
> > >> >> > > >> >
> > >> >> > > >> > Thanks,
> > >> >> > > >> > Jack
> > >> >> > > >> >
> > >> >> > > >>
> > >> >> > > >>
> > >> >> > > >>
> > >> >> > > >> --
> > >> >> > > >> Thanks,
> > >> >> > > >> -Chandra.
> > >> >> > > >>
> > >> >> > > >
> > >> >> > > >
> > >> >> > > >
> > >> >> > > > --
> > >> >> > > > Thanks,
> > >> >> > > > Qingping
> > >> >> > > >
> > >> >> > >
> > >> >> > > --
> > >> >> > > CONFIDENTIALITY NOTICE
> > >> >> > > NOTICE: This message is intended for the use of the individual
> or
> > >> >> entity
> > >> >> > to
> > >> >> > > which it is addressed and may contain information that is
> > >> >> confidential,
> > >> >> > > privileged and exempt from disclosure under applicable law. If
> > the
> > >> >> reader
> > >> >> > > of this message is not the intended recipient, you are hereby
> > >> notified
> > >> >> > that
> > >> >> > > any printing, copying, dissemination, distribution, disclosure
> or
> > >> >> > > forwarding of this communication is strictly prohibited. If you
> > >> have
> > >> >> > > received this communication in error, please contact the sender
> > >> >> > immediately
> > >> >> > > and delete it from your system. Thank You.
> > >> >> > >
> > >> >> >
> > >> >> >
> > >> >> >
> > >> >> > --
> > >> >> > Thanks,
> > >> >> > Qingping
> > >> >> >
> > >> >>
> > >> >> --
> > >> >> CONFIDENTIALITY NOTICE
> > >> >> NOTICE: This message is intended for the use of the individual or
> > >> entity
> > >> >> to
> > >> >> which it is addressed and may contain information that is
> > confidential,
> > >> >> privileged and exempt from disclosure under applicable law. If the
> > >> reader
> > >> >> of this message is not the intended recipient, you are hereby
> > notified
> > >> >> that
> > >> >> any printing, copying, dissemination, distribution, disclosure or
> > >> >> forwarding of this communication is strictly prohibited. If you
> have
> > >> >> received this communication in error, please contact the sender
> > >> >> immediately
> > >> >> and delete it from your system. Thank You.
> > >> >>
> > >> >
> > >> >
> > >> >
> > >> > --
> > >> > Thanks,
> > >> > Qingping
> > >> >
> > >>
> > >>
> > >>
> > >> --
> > >> Thanks,
> > >> Qingping
> > >>
> > >
> > >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
>
>
>
> --
> Thanks,
> Qingping
>
Re: Is there a bug in hiveserver2 metastore caused hold huge objects
Posted by Meng QingPing <mq...@gmail.com>.
Vaibhav, thanks for reply.
It's a remote metastore, stored in mysql.
2014-05-22 5:31 GMT+08:00 Vaibhav Gumashta <vg...@hortonworks.com>:
> Meng, are you running a remote metastore or an embedded one (which would be
> true if you added this config while starting HS2: -hiveconf
> hive.metastore.uris=" ")?
>
> Thanks,
> --Vaibhav
>
>
> On Wed, May 21, 2014 at 2:28 PM, Vaibhav Gumashta <
> vgumashta@hortonworks.com
> > wrote:
>
> > Thanks a lot for the dump Meng!
> >
> >
> > On Wed, May 21, 2014 at 1:41 AM, Meng QingPing <mqingping@gmail.com
> >wrote:
> >
> >> I post the heap bin file on http://jack-meng.qiniudn.com/heap.bin
> >>
> >> Thanks.
> >>
> >>
> >> 2014-05-21 15:41 GMT+08:00 Meng QingPing <mq...@gmail.com>:
> >>
> >> > There are 18908 PM-s. I post it on
> >> > http://jack-meng.qiniudn.com/hive-heap2.png
> >> >
> >> > Thanks.
> >> >
> >> >
> >> > 2014-05-20 0:41 GMT+08:00 Sergey Shelukhin <se...@hortonworks.com>:
> >> >
> >> > What is the count of PM-s that you are seeing when it crashes? From
> that
> >> >> screenshot I don't see what the problem is or I'm not reading it
> right.
> >> >>
> >> >>
> >> >> On Mon, May 19, 2014 at 1:17 AM, Meng QingPing <mq...@gmail.com>
> >> >> wrote:
> >> >>
> >> >> > Thanks.
> >> >> >
> >> >> > I post it on http://jack-meng.qiniudn.com/hive-heap.png
> >> >> >
> >> >> >
> >> >> >
> >> >> >
> >> >> > 2014-05-06 23:14 GMT+08:00 Sergey Shelukhin <
> sergey@hortonworks.com
> >> >:
> >> >> >
> >> >> > > I don't think the dev list supports attachment. Can you post to
> >> some
> >> >> > image
> >> >> > > sharing service?
> >> >> > >
> >> >> > >
> >> >> > > On Tue, May 6, 2014 at 3:20 AM, Meng QingPing <
> mqingping@gmail.com
> >> >
> >> >> > wrote:
> >> >> > >
> >> >> > > >
> >> >> > > > Weird, the picture attached in sent mail.
> >> >> > > >
> >> >> > > > Anyway send again.
> >> >> > > >
> >> >> > > >
> >> >> > > > 2014-05-05 12:17 GMT+08:00 Chandra Reddy <chandu.cr@gmail.com
> >:
> >> >> > > >
> >> >> > > > seems you have missed attachment.
> >> >> > > >> -Chandra
> >> >> > > >>
> >> >> > > >>
> >> >> > > >> On Sun, May 4, 2014 at 6:57 PM, Meng QingPing <
> >> mqingping@gmail.com
> >> >> >
> >> >> > > >> wrote:
> >> >> > > >>
> >> >> > > >> > I run hiveserver2 with metastore in mysql. The hiveserver2
> OOM
> >> >> and
> >> >> > the
> >> >> > > >> > heap dump show huge objects hold by
> "org.datanucleus.api.jdo.
> >> >> > > >> > JDOPersistenceManagerFactory" as attached. It seems not
> >> release
> >> >> > > >> > org.datanucleus.api.jdo.JDOPersistenceManager. Hive version
> is
> >> >> 0.13.
> >> >> > > >> >
> >> >> > > >> > Thanks,
> >> >> > > >> > Jack
> >> >> > > >> >
> >> >> > > >>
> >> >> > > >>
> >> >> > > >>
> >> >> > > >> --
> >> >> > > >> Thanks,
> >> >> > > >> -Chandra.
> >> >> > > >>
> >> >> > > >
> >> >> > > >
> >> >> > > >
> >> >> > > > --
> >> >> > > > Thanks,
> >> >> > > > Qingping
> >> >> > > >
> >> >> > >
> >> >> > > --
> >> >> > > CONFIDENTIALITY NOTICE
> >> >> > > NOTICE: This message is intended for the use of the individual or
> >> >> entity
> >> >> > to
> >> >> > > which it is addressed and may contain information that is
> >> >> confidential,
> >> >> > > privileged and exempt from disclosure under applicable law. If
> the
> >> >> reader
> >> >> > > of this message is not the intended recipient, you are hereby
> >> notified
> >> >> > that
> >> >> > > any printing, copying, dissemination, distribution, disclosure or
> >> >> > > forwarding of this communication is strictly prohibited. If you
> >> have
> >> >> > > received this communication in error, please contact the sender
> >> >> > immediately
> >> >> > > and delete it from your system. Thank You.
> >> >> > >
> >> >> >
> >> >> >
> >> >> >
> >> >> > --
> >> >> > Thanks,
> >> >> > Qingping
> >> >> >
> >> >>
> >> >> --
> >> >> CONFIDENTIALITY NOTICE
> >> >> NOTICE: This message is intended for the use of the individual or
> >> entity
> >> >> to
> >> >> which it is addressed and may contain information that is
> confidential,
> >> >> privileged and exempt from disclosure under applicable law. If the
> >> reader
> >> >> of this message is not the intended recipient, you are hereby
> notified
> >> >> that
> >> >> any printing, copying, dissemination, distribution, disclosure or
> >> >> forwarding of this communication is strictly prohibited. If you have
> >> >> received this communication in error, please contact the sender
> >> >> immediately
> >> >> and delete it from your system. Thank You.
> >> >>
> >> >
> >> >
> >> >
> >> > --
> >> > Thanks,
> >> > Qingping
> >> >
> >>
> >>
> >>
> >> --
> >> Thanks,
> >> Qingping
> >>
> >
> >
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
--
Thanks,
Qingping
Re: Is there a bug in hiveserver2 metastore caused hold huge objects
Posted by Vaibhav Gumashta <vg...@hortonworks.com>.
Meng, are you running a remote metastore or an embedded one (which would be
true if you added this config while starting HS2: -hiveconf
hive.metastore.uris=" ")?
Thanks,
--Vaibhav
On Wed, May 21, 2014 at 2:28 PM, Vaibhav Gumashta <vgumashta@hortonworks.com
> wrote:
> Thanks a lot for the dump Meng!
>
>
> On Wed, May 21, 2014 at 1:41 AM, Meng QingPing <mq...@gmail.com>wrote:
>
>> I post the heap bin file on http://jack-meng.qiniudn.com/heap.bin
>>
>> Thanks.
>>
>>
>> 2014-05-21 15:41 GMT+08:00 Meng QingPing <mq...@gmail.com>:
>>
>> > There are 18908 PM-s. I post it on
>> > http://jack-meng.qiniudn.com/hive-heap2.png
>> >
>> > Thanks.
>> >
>> >
>> > 2014-05-20 0:41 GMT+08:00 Sergey Shelukhin <se...@hortonworks.com>:
>> >
>> > What is the count of PM-s that you are seeing when it crashes? From that
>> >> screenshot I don't see what the problem is or I'm not reading it right.
>> >>
>> >>
>> >> On Mon, May 19, 2014 at 1:17 AM, Meng QingPing <mq...@gmail.com>
>> >> wrote:
>> >>
>> >> > Thanks.
>> >> >
>> >> > I post it on http://jack-meng.qiniudn.com/hive-heap.png
>> >> >
>> >> >
>> >> >
>> >> >
>> >> > 2014-05-06 23:14 GMT+08:00 Sergey Shelukhin <sergey@hortonworks.com
>> >:
>> >> >
>> >> > > I don't think the dev list supports attachment. Can you post to
>> some
>> >> > image
>> >> > > sharing service?
>> >> > >
>> >> > >
>> >> > > On Tue, May 6, 2014 at 3:20 AM, Meng QingPing <mqingping@gmail.com
>> >
>> >> > wrote:
>> >> > >
>> >> > > >
>> >> > > > Weird, the picture attached in sent mail.
>> >> > > >
>> >> > > > Anyway send again.
>> >> > > >
>> >> > > >
>> >> > > > 2014-05-05 12:17 GMT+08:00 Chandra Reddy <ch...@gmail.com>:
>> >> > > >
>> >> > > > seems you have missed attachment.
>> >> > > >> -Chandra
>> >> > > >>
>> >> > > >>
>> >> > > >> On Sun, May 4, 2014 at 6:57 PM, Meng QingPing <
>> mqingping@gmail.com
>> >> >
>> >> > > >> wrote:
>> >> > > >>
>> >> > > >> > I run hiveserver2 with metastore in mysql. The hiveserver2 OOM
>> >> and
>> >> > the
>> >> > > >> > heap dump show huge objects hold by "org.datanucleus.api.jdo.
>> >> > > >> > JDOPersistenceManagerFactory" as attached. It seems not
>> release
>> >> > > >> > org.datanucleus.api.jdo.JDOPersistenceManager. Hive version is
>> >> 0.13.
>> >> > > >> >
>> >> > > >> > Thanks,
>> >> > > >> > Jack
>> >> > > >> >
>> >> > > >>
>> >> > > >>
>> >> > > >>
>> >> > > >> --
>> >> > > >> Thanks,
>> >> > > >> -Chandra.
>> >> > > >>
>> >> > > >
>> >> > > >
>> >> > > >
>> >> > > > --
>> >> > > > Thanks,
>> >> > > > Qingping
>> >> > > >
>> >> > >
>> >> > > --
>> >> > > CONFIDENTIALITY NOTICE
>> >> > > NOTICE: This message is intended for the use of the individual or
>> >> entity
>> >> > to
>> >> > > which it is addressed and may contain information that is
>> >> confidential,
>> >> > > privileged and exempt from disclosure under applicable law. If the
>> >> reader
>> >> > > of this message is not the intended recipient, you are hereby
>> notified
>> >> > that
>> >> > > any printing, copying, dissemination, distribution, disclosure or
>> >> > > forwarding of this communication is strictly prohibited. If you
>> have
>> >> > > received this communication in error, please contact the sender
>> >> > immediately
>> >> > > and delete it from your system. Thank You.
>> >> > >
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > Thanks,
>> >> > Qingping
>> >> >
>> >>
>> >> --
>> >> CONFIDENTIALITY NOTICE
>> >> NOTICE: This message is intended for the use of the individual or
>> entity
>> >> to
>> >> which it is addressed and may contain information that is confidential,
>> >> privileged and exempt from disclosure under applicable law. If the
>> reader
>> >> of this message is not the intended recipient, you are hereby notified
>> >> that
>> >> any printing, copying, dissemination, distribution, disclosure or
>> >> forwarding of this communication is strictly prohibited. If you have
>> >> received this communication in error, please contact the sender
>> >> immediately
>> >> and delete it from your system. Thank You.
>> >>
>> >
>> >
>> >
>> > --
>> > Thanks,
>> > Qingping
>> >
>>
>>
>>
>> --
>> Thanks,
>> Qingping
>>
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Is there a bug in hiveserver2 metastore caused hold huge objects
Posted by Vaibhav Gumashta <vg...@hortonworks.com>.
Thanks a lot for the dump Meng!
On Wed, May 21, 2014 at 1:41 AM, Meng QingPing <mq...@gmail.com> wrote:
> I post the heap bin file on http://jack-meng.qiniudn.com/heap.bin
>
> Thanks.
>
>
> 2014-05-21 15:41 GMT+08:00 Meng QingPing <mq...@gmail.com>:
>
> > There are 18908 PM-s. I post it on
> > http://jack-meng.qiniudn.com/hive-heap2.png
> >
> > Thanks.
> >
> >
> > 2014-05-20 0:41 GMT+08:00 Sergey Shelukhin <se...@hortonworks.com>:
> >
> > What is the count of PM-s that you are seeing when it crashes? From that
> >> screenshot I don't see what the problem is or I'm not reading it right.
> >>
> >>
> >> On Mon, May 19, 2014 at 1:17 AM, Meng QingPing <mq...@gmail.com>
> >> wrote:
> >>
> >> > Thanks.
> >> >
> >> > I post it on http://jack-meng.qiniudn.com/hive-heap.png
> >> >
> >> >
> >> >
> >> >
> >> > 2014-05-06 23:14 GMT+08:00 Sergey Shelukhin <se...@hortonworks.com>:
> >> >
> >> > > I don't think the dev list supports attachment. Can you post to some
> >> > image
> >> > > sharing service?
> >> > >
> >> > >
> >> > > On Tue, May 6, 2014 at 3:20 AM, Meng QingPing <mq...@gmail.com>
> >> > wrote:
> >> > >
> >> > > >
> >> > > > Weird, the picture attached in sent mail.
> >> > > >
> >> > > > Anyway send again.
> >> > > >
> >> > > >
> >> > > > 2014-05-05 12:17 GMT+08:00 Chandra Reddy <ch...@gmail.com>:
> >> > > >
> >> > > > seems you have missed attachment.
> >> > > >> -Chandra
> >> > > >>
> >> > > >>
> >> > > >> On Sun, May 4, 2014 at 6:57 PM, Meng QingPing <
> mqingping@gmail.com
> >> >
> >> > > >> wrote:
> >> > > >>
> >> > > >> > I run hiveserver2 with metastore in mysql. The hiveserver2 OOM
> >> and
> >> > the
> >> > > >> > heap dump show huge objects hold by "org.datanucleus.api.jdo.
> >> > > >> > JDOPersistenceManagerFactory" as attached. It seems not release
> >> > > >> > org.datanucleus.api.jdo.JDOPersistenceManager. Hive version is
> >> 0.13.
> >> > > >> >
> >> > > >> > Thanks,
> >> > > >> > Jack
> >> > > >> >
> >> > > >>
> >> > > >>
> >> > > >>
> >> > > >> --
> >> > > >> Thanks,
> >> > > >> -Chandra.
> >> > > >>
> >> > > >
> >> > > >
> >> > > >
> >> > > > --
> >> > > > Thanks,
> >> > > > Qingping
> >> > > >
> >> > >
> >> > > --
> >> > > CONFIDENTIALITY NOTICE
> >> > > NOTICE: This message is intended for the use of the individual or
> >> entity
> >> > to
> >> > > which it is addressed and may contain information that is
> >> confidential,
> >> > > privileged and exempt from disclosure under applicable law. If the
> >> reader
> >> > > of this message is not the intended recipient, you are hereby
> notified
> >> > that
> >> > > any printing, copying, dissemination, distribution, disclosure or
> >> > > forwarding of this communication is strictly prohibited. If you have
> >> > > received this communication in error, please contact the sender
> >> > immediately
> >> > > and delete it from your system. Thank You.
> >> > >
> >> >
> >> >
> >> >
> >> > --
> >> > Thanks,
> >> > Qingping
> >> >
> >>
> >> --
> >> CONFIDENTIALITY NOTICE
> >> NOTICE: This message is intended for the use of the individual or entity
> >> to
> >> which it is addressed and may contain information that is confidential,
> >> privileged and exempt from disclosure under applicable law. If the
> reader
> >> of this message is not the intended recipient, you are hereby notified
> >> that
> >> any printing, copying, dissemination, distribution, disclosure or
> >> forwarding of this communication is strictly prohibited. If you have
> >> received this communication in error, please contact the sender
> >> immediately
> >> and delete it from your system. Thank You.
> >>
> >
> >
> >
> > --
> > Thanks,
> > Qingping
> >
>
>
>
> --
> Thanks,
> Qingping
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Is there a bug in hiveserver2 metastore caused hold huge objects
Posted by Meng QingPing <mq...@gmail.com>.
I post the heap bin file on http://jack-meng.qiniudn.com/heap.bin
Thanks.
2014-05-21 15:41 GMT+08:00 Meng QingPing <mq...@gmail.com>:
> There are 18908 PM-s. I post it on
> http://jack-meng.qiniudn.com/hive-heap2.png
>
> Thanks.
>
>
> 2014-05-20 0:41 GMT+08:00 Sergey Shelukhin <se...@hortonworks.com>:
>
> What is the count of PM-s that you are seeing when it crashes? From that
>> screenshot I don't see what the problem is or I'm not reading it right.
>>
>>
>> On Mon, May 19, 2014 at 1:17 AM, Meng QingPing <mq...@gmail.com>
>> wrote:
>>
>> > Thanks.
>> >
>> > I post it on http://jack-meng.qiniudn.com/hive-heap.png
>> >
>> >
>> >
>> >
>> > 2014-05-06 23:14 GMT+08:00 Sergey Shelukhin <se...@hortonworks.com>:
>> >
>> > > I don't think the dev list supports attachment. Can you post to some
>> > image
>> > > sharing service?
>> > >
>> > >
>> > > On Tue, May 6, 2014 at 3:20 AM, Meng QingPing <mq...@gmail.com>
>> > wrote:
>> > >
>> > > >
>> > > > Weird, the picture attached in sent mail.
>> > > >
>> > > > Anyway send again.
>> > > >
>> > > >
>> > > > 2014-05-05 12:17 GMT+08:00 Chandra Reddy <ch...@gmail.com>:
>> > > >
>> > > > seems you have missed attachment.
>> > > >> -Chandra
>> > > >>
>> > > >>
>> > > >> On Sun, May 4, 2014 at 6:57 PM, Meng QingPing <mqingping@gmail.com
>> >
>> > > >> wrote:
>> > > >>
>> > > >> > I run hiveserver2 with metastore in mysql. The hiveserver2 OOM
>> and
>> > the
>> > > >> > heap dump show huge objects hold by "org.datanucleus.api.jdo.
>> > > >> > JDOPersistenceManagerFactory" as attached. It seems not release
>> > > >> > org.datanucleus.api.jdo.JDOPersistenceManager. Hive version is
>> 0.13.
>> > > >> >
>> > > >> > Thanks,
>> > > >> > Jack
>> > > >> >
>> > > >>
>> > > >>
>> > > >>
>> > > >> --
>> > > >> Thanks,
>> > > >> -Chandra.
>> > > >>
>> > > >
>> > > >
>> > > >
>> > > > --
>> > > > Thanks,
>> > > > Qingping
>> > > >
>> > >
>> > > --
>> > > CONFIDENTIALITY NOTICE
>> > > NOTICE: This message is intended for the use of the individual or
>> entity
>> > to
>> > > which it is addressed and may contain information that is
>> confidential,
>> > > privileged and exempt from disclosure under applicable law. If the
>> reader
>> > > of this message is not the intended recipient, you are hereby notified
>> > that
>> > > any printing, copying, dissemination, distribution, disclosure or
>> > > forwarding of this communication is strictly prohibited. If you have
>> > > received this communication in error, please contact the sender
>> > immediately
>> > > and delete it from your system. Thank You.
>> > >
>> >
>> >
>> >
>> > --
>> > Thanks,
>> > Qingping
>> >
>>
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to
>> which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified
>> that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender
>> immediately
>> and delete it from your system. Thank You.
>>
>
>
>
> --
> Thanks,
> Qingping
>
--
Thanks,
Qingping
Re: Is there a bug in hiveserver2 metastore caused hold huge objects
Posted by Meng QingPing <mq...@gmail.com>.
There are 18908 PM-s. I post it on
http://jack-meng.qiniudn.com/hive-heap2.png
Thanks.
2014-05-20 0:41 GMT+08:00 Sergey Shelukhin <se...@hortonworks.com>:
> What is the count of PM-s that you are seeing when it crashes? From that
> screenshot I don't see what the problem is or I'm not reading it right.
>
>
> On Mon, May 19, 2014 at 1:17 AM, Meng QingPing <mq...@gmail.com>
> wrote:
>
> > Thanks.
> >
> > I post it on http://jack-meng.qiniudn.com/hive-heap.png
> >
> >
> >
> >
> > 2014-05-06 23:14 GMT+08:00 Sergey Shelukhin <se...@hortonworks.com>:
> >
> > > I don't think the dev list supports attachment. Can you post to some
> > image
> > > sharing service?
> > >
> > >
> > > On Tue, May 6, 2014 at 3:20 AM, Meng QingPing <mq...@gmail.com>
> > wrote:
> > >
> > > >
> > > > Weird, the picture attached in sent mail.
> > > >
> > > > Anyway send again.
> > > >
> > > >
> > > > 2014-05-05 12:17 GMT+08:00 Chandra Reddy <ch...@gmail.com>:
> > > >
> > > > seems you have missed attachment.
> > > >> -Chandra
> > > >>
> > > >>
> > > >> On Sun, May 4, 2014 at 6:57 PM, Meng QingPing <mq...@gmail.com>
> > > >> wrote:
> > > >>
> > > >> > I run hiveserver2 with metastore in mysql. The hiveserver2 OOM and
> > the
> > > >> > heap dump show huge objects hold by "org.datanucleus.api.jdo.
> > > >> > JDOPersistenceManagerFactory" as attached. It seems not release
> > > >> > org.datanucleus.api.jdo.JDOPersistenceManager. Hive version is
> 0.13.
> > > >> >
> > > >> > Thanks,
> > > >> > Jack
> > > >> >
> > > >>
> > > >>
> > > >>
> > > >> --
> > > >> Thanks,
> > > >> -Chandra.
> > > >>
> > > >
> > > >
> > > >
> > > > --
> > > > Thanks,
> > > > Qingping
> > > >
> > >
> > > --
> > > CONFIDENTIALITY NOTICE
> > > NOTICE: This message is intended for the use of the individual or
> entity
> > to
> > > which it is addressed and may contain information that is confidential,
> > > privileged and exempt from disclosure under applicable law. If the
> reader
> > > of this message is not the intended recipient, you are hereby notified
> > that
> > > any printing, copying, dissemination, distribution, disclosure or
> > > forwarding of this communication is strictly prohibited. If you have
> > > received this communication in error, please contact the sender
> > immediately
> > > and delete it from your system. Thank You.
> > >
> >
> >
> >
> > --
> > Thanks,
> > Qingping
> >
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
--
Thanks,
Qingping
Re: Is there a bug in hiveserver2 metastore caused hold huge objects
Posted by Meng QingPing <mq...@gmail.com>.
There are 18908 PM-s. I post it on
http://jack-meng.qiniudn.com/hive-heap2.png<http://jack-meng.qiniudn.com/hive-heap.png>
Thanks.
2014-05-20 0:41 GMT+08:00 Sergey Shelukhin <se...@hortonworks.com>:
> What is the count of PM-s that you are seeing when it crashes? From that
> screenshot I don't see what the problem is or I'm not reading it right.
>
>
> On Mon, May 19, 2014 at 1:17 AM, Meng QingPing <mq...@gmail.com>
> wrote:
>
> > Thanks.
> >
> > I post it on http://jack-meng.qiniudn.com/hive-heap.png
> >
> >
> >
> >
> > 2014-05-06 23:14 GMT+08:00 Sergey Shelukhin <se...@hortonworks.com>:
> >
> > > I don't think the dev list supports attachment. Can you post to some
> > image
> > > sharing service?
> > >
> > >
> > > On Tue, May 6, 2014 at 3:20 AM, Meng QingPing <mq...@gmail.com>
> > wrote:
> > >
> > > >
> > > > Weird, the picture attached in sent mail.
> > > >
> > > > Anyway send again.
> > > >
> > > >
> > > > 2014-05-05 12:17 GMT+08:00 Chandra Reddy <ch...@gmail.com>:
> > > >
> > > > seems you have missed attachment.
> > > >> -Chandra
> > > >>
> > > >>
> > > >> On Sun, May 4, 2014 at 6:57 PM, Meng QingPing <mq...@gmail.com>
> > > >> wrote:
> > > >>
> > > >> > I run hiveserver2 with metastore in mysql. The hiveserver2 OOM and
> > the
> > > >> > heap dump show huge objects hold by "org.datanucleus.api.jdo.
> > > >> > JDOPersistenceManagerFactory" as attached. It seems not release
> > > >> > org.datanucleus.api.jdo.JDOPersistenceManager. Hive version is
> 0.13.
> > > >> >
> > > >> > Thanks,
> > > >> > Jack
> > > >> >
> > > >>
> > > >>
> > > >>
> > > >> --
> > > >> Thanks,
> > > >> -Chandra.
> > > >>
> > > >
> > > >
> > > >
> > > > --
> > > > Thanks,
> > > > Qingping
> > > >
> > >
> > > --
> > > CONFIDENTIALITY NOTICE
> > > NOTICE: This message is intended for the use of the individual or
> entity
> > to
> > > which it is addressed and may contain information that is confidential,
> > > privileged and exempt from disclosure under applicable law. If the
> reader
> > > of this message is not the intended recipient, you are hereby notified
> > that
> > > any printing, copying, dissemination, distribution, disclosure or
> > > forwarding of this communication is strictly prohibited. If you have
> > > received this communication in error, please contact the sender
> > immediately
> > > and delete it from your system. Thank You.
> > >
> >
> >
> >
> > --
> > Thanks,
> > Qingping
> >
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
--
Thanks,
Qingping
Re: Is there a bug in hiveserver2 metastore caused hold huge objects
Posted by Sergey Shelukhin <se...@hortonworks.com>.
What is the count of PM-s that you are seeing when it crashes? From that
screenshot I don't see what the problem is or I'm not reading it right.
On Mon, May 19, 2014 at 1:17 AM, Meng QingPing <mq...@gmail.com> wrote:
> Thanks.
>
> I post it on http://jack-meng.qiniudn.com/hive-heap.png
>
>
>
>
> 2014-05-06 23:14 GMT+08:00 Sergey Shelukhin <se...@hortonworks.com>:
>
> > I don't think the dev list supports attachment. Can you post to some
> image
> > sharing service?
> >
> >
> > On Tue, May 6, 2014 at 3:20 AM, Meng QingPing <mq...@gmail.com>
> wrote:
> >
> > >
> > > Weird, the picture attached in sent mail.
> > >
> > > Anyway send again.
> > >
> > >
> > > 2014-05-05 12:17 GMT+08:00 Chandra Reddy <ch...@gmail.com>:
> > >
> > > seems you have missed attachment.
> > >> -Chandra
> > >>
> > >>
> > >> On Sun, May 4, 2014 at 6:57 PM, Meng QingPing <mq...@gmail.com>
> > >> wrote:
> > >>
> > >> > I run hiveserver2 with metastore in mysql. The hiveserver2 OOM and
> the
> > >> > heap dump show huge objects hold by "org.datanucleus.api.jdo.
> > >> > JDOPersistenceManagerFactory" as attached. It seems not release
> > >> > org.datanucleus.api.jdo.JDOPersistenceManager. Hive version is 0.13.
> > >> >
> > >> > Thanks,
> > >> > Jack
> > >> >
> > >>
> > >>
> > >>
> > >> --
> > >> Thanks,
> > >> -Chandra.
> > >>
> > >
> > >
> > >
> > > --
> > > Thanks,
> > > Qingping
> > >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
>
>
>
> --
> Thanks,
> Qingping
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Is there a bug in hiveserver2 metastore caused hold huge objects
Posted by Meng QingPing <mq...@gmail.com>.
Thanks.
I post it on http://jack-meng.qiniudn.com/hive-heap.png
2014-05-06 23:14 GMT+08:00 Sergey Shelukhin <se...@hortonworks.com>:
> I don't think the dev list supports attachment. Can you post to some image
> sharing service?
>
>
> On Tue, May 6, 2014 at 3:20 AM, Meng QingPing <mq...@gmail.com> wrote:
>
> >
> > Weird, the picture attached in sent mail.
> >
> > Anyway send again.
> >
> >
> > 2014-05-05 12:17 GMT+08:00 Chandra Reddy <ch...@gmail.com>:
> >
> > seems you have missed attachment.
> >> -Chandra
> >>
> >>
> >> On Sun, May 4, 2014 at 6:57 PM, Meng QingPing <mq...@gmail.com>
> >> wrote:
> >>
> >> > I run hiveserver2 with metastore in mysql. The hiveserver2 OOM and the
> >> > heap dump show huge objects hold by "org.datanucleus.api.jdo.
> >> > JDOPersistenceManagerFactory" as attached. It seems not release
> >> > org.datanucleus.api.jdo.JDOPersistenceManager. Hive version is 0.13.
> >> >
> >> > Thanks,
> >> > Jack
> >> >
> >>
> >>
> >>
> >> --
> >> Thanks,
> >> -Chandra.
> >>
> >
> >
> >
> > --
> > Thanks,
> > Qingping
> >
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
--
Thanks,
Qingping
Re: Is there a bug in hiveserver2 metastore caused hold huge objects
Posted by Sergey Shelukhin <se...@hortonworks.com>.
I don't think the dev list supports attachment. Can you post to some image
sharing service?
On Tue, May 6, 2014 at 3:20 AM, Meng QingPing <mq...@gmail.com> wrote:
>
> Weird, the picture attached in sent mail.
>
> Anyway send again.
>
>
> 2014-05-05 12:17 GMT+08:00 Chandra Reddy <ch...@gmail.com>:
>
> seems you have missed attachment.
>> -Chandra
>>
>>
>> On Sun, May 4, 2014 at 6:57 PM, Meng QingPing <mq...@gmail.com>
>> wrote:
>>
>> > I run hiveserver2 with metastore in mysql. The hiveserver2 OOM and the
>> > heap dump show huge objects hold by "org.datanucleus.api.jdo.
>> > JDOPersistenceManagerFactory" as attached. It seems not release
>> > org.datanucleus.api.jdo.JDOPersistenceManager. Hive version is 0.13.
>> >
>> > Thanks,
>> > Jack
>> >
>>
>>
>>
>> --
>> Thanks,
>> -Chandra.
>>
>
>
>
> --
> Thanks,
> Qingping
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Is there a bug in hiveserver2 metastore caused hold huge objects
Posted by Meng QingPing <mq...@gmail.com>.
Weird, the picture attached in sent mail.
Anyway send again.
2014-05-05 12:17 GMT+08:00 Chandra Reddy <ch...@gmail.com>:
> seems you have missed attachment.
> -Chandra
>
>
> On Sun, May 4, 2014 at 6:57 PM, Meng QingPing <mq...@gmail.com> wrote:
>
> > I run hiveserver2 with metastore in mysql. The hiveserver2 OOM and the
> > heap dump show huge objects hold by "org.datanucleus.api.jdo.
> > JDOPersistenceManagerFactory" as attached. It seems not release
> > org.datanucleus.api.jdo.JDOPersistenceManager. Hive version is 0.13.
> >
> > Thanks,
> > Jack
> >
>
>
>
> --
> Thanks,
> -Chandra.
>
--
Thanks,
Qingping
Re: Is there a bug in hiveserver2 metastore caused hold huge objects
Posted by Chandra Reddy <ch...@gmail.com>.
seems you have missed attachment.
-Chandra
On Sun, May 4, 2014 at 6:57 PM, Meng QingPing <mq...@gmail.com> wrote:
> I run hiveserver2 with metastore in mysql. The hiveserver2 OOM and the
> heap dump show huge objects hold by "org.datanucleus.api.jdo.
> JDOPersistenceManagerFactory" as attached. It seems not release
> org.datanucleus.api.jdo.JDOPersistenceManager. Hive version is 0.13.
>
> Thanks,
> Jack
>
--
Thanks,
-Chandra.