You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by lars hofhansl <la...@apache.org> on 2013/09/04 02:35:47 UTC
Re: (HBASE-5261)HBase 0.94 cerification for JDK7
We (Salesforce) are using HBase with JDK7. No issues seen so far.
0.94 is not "officially certified" to work on JDK7 (we have no JDK7 jenkins, etc).
It might be good to setup a JDK7 jenkins for 0.94. Any objections to doing that?
-- Lars
----- Original Message -----
From: anil gupta <an...@gmail.com>
To: "user@hbase.apache.org" <us...@hbase.apache.org>
Cc:
Sent: Tuesday, September 3, 2013 4:26 PM
Subject: (HBASE-5261)HBase 0.94 cerification for JDK7
Hi All,
We are thinking of running HBase(we have JVM heaps larger than 25 GB) with
JDK7 to use G1 garbage collection, but as a precaution we would like HBase
to be certified with JDK7. I see this ticket for same:
https://issues.apache.org/jira/browse/HBASE-5261
Above havent had any activity from November, 2012. Are there any timelines
to certify HBase 0.94 with JDK7?
--
Thanks & Regards,
Anil Gupta
Re: (HBASE-5261)HBase 0.94 cerification for JDK7
Posted by Elliott Clark <ec...@apache.org>.
Of course. I'll reply back when I have definitive results
On Tue, Sep 3, 2013 at 11:17 PM, anil gupta <an...@gmail.com> wrote:
> Inline.
>
> On Tue, Sep 3, 2013 at 11:04 PM, Elliott Clark <ec...@apache.org> wrote:
>
>> So since the first question is vendor specific, lets take that off list.
>>
>> The core dumps are mostly while starting a region server up under
>> load, but they are concerning. They are on JDK 1.7.15, which isn't
>> the newest. So I'm hoping that release 25 will help.
>>
> Anil: Yes, trying out 25 will be better. It would be great if you can share
> your results whenever your try out 1.7u25. Meanwhile, i will also try to do
> the same in my environment.
>
>>
>> I also run YCSB on the cluster after all the tests and during those
>> runs the region servers have been very stable.
>>
>> On Tue, Sep 3, 2013 at 10:42 PM, anil gupta <an...@gmail.com> wrote:
>> > Hi Elliot,
>> >
>> > That's cool!
>> > We have CDH Enterprise license. Would you mind pointing me to the
>> doc/link
>> > that states same?
>> > However, core dumps sounds bad for prod environment. Are there any
>> specific
>> > patterns for core-dumps? Does it only happens under very heavy load? If
>> > yes, then how much read/write load?
>> >
>> > If you want to take this offline, i am fine with that also.
>> >
>> > Thanks,
>> > Anil
>> >
>> >
>> > On Tue, Sep 3, 2013 at 10:26 PM, Elliott Clark <ec...@apache.org>
>> wrote:
>> >
>> >> Cloudera (my employer) has certified their distribution(CDH4.2+) on
>> >> JDK7. That includes HBase 94. I'm sure they would answer questions
>> >> about what was tested, on their mailing lists or forums.
>> >>
>> >> I imagine that Hortonworks has done similar testing though I am not as
>> >> well versed in it.
>> >>
>> >> I personally been running a test cluster with Integration tests (for
>> >> 0.96) on jdk7, G1 gc, and 30 gig heaps for a couple of months now.
>> >> There have been a couple of times that the region servers have core
>> >> dumped because of the JVM. However I would say the region servers are
>> >> some what stable with JDK 1.07.15 and the G1gc. My test cluster is
>> >> pretty taxed and your milage might vary; it's worth testing on your
>> >> workload.
>> >>
>> >> I'm currently upgrading the jvm to release 25 hoping that the core
>> >> dumps will be solved.
>> >>
>> >> On Tue, Sep 3, 2013 at 10:06 PM, anil gupta <an...@gmail.com>
>> wrote:
>> >> > Also, if HBase0.94 is officially certified to work with JDK7 then it
>> will
>> >> > save duplicate work from Individual users like me and you. Currently
>> GC
>> >> > with big JVM heaps is a big concern with HBase. If users will get
>> options
>> >> > to use G1GC then it might alleviate some pains of many HBase users.
>> >> >
>> >> >
>> >> > On Tue, Sep 3, 2013 at 10:03 PM, anil gupta <an...@gmail.com>
>> >> wrote:
>> >> >
>> >> >> Hi Lars,
>> >> >>
>> >> >> Even if we setup Jenkins with JDK7 then also we wont be able to use
>> JDK7
>> >> >> in prod HBase cluster. Beacuse, as per our process, we can only use
>> the
>> >> JDK
>> >> >> that is certified by Apache HBase. If we don't follow this rule then
>> >> IT/DBA
>> >> >> folks wont support us. That's why i am looking for JDK7
>> certification of
>> >> >> HBase0.94. It would be great if an official certification can be
>> done.
>> >> >>
>> >> >> Thanks,
>> >> >> Anil
>> >> >>
>> >> >>
>> >> >> On Tue, Sep 3, 2013 at 5:35 PM, lars hofhansl <la...@apache.org>
>> wrote:
>> >> >>
>> >> >>> We (Salesforce) are using HBase with JDK7. No issues seen so far.
>> >> >>>
>> >> >>> 0.94 is not "officially certified" to work on JDK7 (we have no JDK7
>> >> >>> jenkins, etc).
>> >> >>>
>> >> >>> It might be good to setup a JDK7 jenkins for 0.94. Any objections to
>> >> >>> doing that?
>> >> >>>
>> >> >>> -- Lars
>> >> >>>
>> >> >>>
>> >> >>>
>> >> >>> ----- Original Message -----
>> >> >>> From: anil gupta <an...@gmail.com>
>> >> >>> To: "user@hbase.apache.org" <us...@hbase.apache.org>
>> >> >>> Cc:
>> >> >>> Sent: Tuesday, September 3, 2013 4:26 PM
>> >> >>> Subject: (HBASE-5261)HBase 0.94 cerification for JDK7
>> >> >>>
>> >> >>> Hi All,
>> >> >>>
>> >> >>> We are thinking of running HBase(we have JVM heaps larger than 25
>> GB)
>> >> with
>> >> >>> JDK7 to use G1 garbage collection, but as a precaution we would like
>> >> HBase
>> >> >>> to be certified with JDK7. I see this ticket for same:
>> >> >>> https://issues.apache.org/jira/browse/HBASE-5261
>> >> >>> Above havent had any activity from November, 2012. Are there any
>> >> timelines
>> >> >>> to certify HBase 0.94 with JDK7?
>> >> >>>
>> >> >>> --
>> >> >>> Thanks & Regards,
>> >> >>> Anil Gupta
>> >> >>>
>> >> >>>
>> >> >>
>> >> >>
>> >> >> --
>> >> >> Thanks & Regards,
>> >> >> Anil Gupta
>> >> >>
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > Thanks & Regards,
>> >> > Anil Gupta
>> >>
>> >
>> >
>> >
>> > --
>> > Thanks & Regards,
>> > Anil Gupta
>>
>
>
>
> --
> Thanks & Regards,
> Anil Gupta
Re: (HBASE-5261)HBase 0.94 cerification for JDK7
Posted by anil gupta <an...@gmail.com>.
@Stack: Inline
On Wed, Sep 4, 2013 at 2:32 PM, Stack <st...@duboce.net> wrote:
> Anil:
>
> You having GC'ing issues Anil? You hitting Full GCs pretty regularly?
>
While testing my cluster, i did a full table scan on a table having 600
million records(at that time very few writes were going on). I was getting
around 26sec GC's. Our JVM heap is ~30 GB. This was done around 2 month
ago. Doing full table scan took us 15 min. I dont remember much more
details about it.
>
> (Setting up a jenkins build as Lars suggests or having us add a note to the
> website somewhere saying 0.94 runs on jdk7 -- presuming it passes a couple
> of jenkins builds -- would be no problem... just say what you need).
>
I think we are good since Cloudera has certified HBase with JDK7. Cloudera
is our Hadoop vendor.
>
> St.Ack
>
>
> On Wed, Sep 4, 2013 at 2:17 PM, anil gupta <an...@gmail.com> wrote:
>
> > Inline.
> >
> > On Tue, Sep 3, 2013 at 11:04 PM, Elliott Clark <ec...@apache.org>
> wrote:
> >
> > > So since the first question is vendor specific, lets take that off
> list.
> > >
> > > The core dumps are mostly while starting a region server up under
> > > load, but they are concerning. They are on JDK 1.7.15, which isn't
> > > the newest. So I'm hoping that release 25 will help.
> > >
> > Anil: Yes, trying out 25 will be better. It would be great if you can
> share
> > your results whenever your try out 1.7u25. Meanwhile, i will also try to
> do
> > the same in my environment.
> >
> > >
> > > I also run YCSB on the cluster after all the tests and during those
> > > runs the region servers have been very stable.
> > >
> > > On Tue, Sep 3, 2013 at 10:42 PM, anil gupta <an...@gmail.com>
> > wrote:
> > > > Hi Elliot,
> > > >
> > > > That's cool!
> > > > We have CDH Enterprise license. Would you mind pointing me to the
> > > doc/link
> > > > that states same?
> > > > However, core dumps sounds bad for prod environment. Are there any
> > > specific
> > > > patterns for core-dumps? Does it only happens under very heavy load?
> If
> > > > yes, then how much read/write load?
> > > >
> > > > If you want to take this offline, i am fine with that also.
> > > >
> > > > Thanks,
> > > > Anil
> > > >
> > > >
> > > > On Tue, Sep 3, 2013 at 10:26 PM, Elliott Clark <ec...@apache.org>
> > > wrote:
> > > >
> > > >> Cloudera (my employer) has certified their distribution(CDH4.2+) on
> > > >> JDK7. That includes HBase 94. I'm sure they would answer questions
> > > >> about what was tested, on their mailing lists or forums.
> > > >>
> > > >> I imagine that Hortonworks has done similar testing though I am not
> as
> > > >> well versed in it.
> > > >>
> > > >> I personally been running a test cluster with Integration tests (for
> > > >> 0.96) on jdk7, G1 gc, and 30 gig heaps for a couple of months now.
> > > >> There have been a couple of times that the region servers have core
> > > >> dumped because of the JVM. However I would say the region servers
> are
> > > >> some what stable with JDK 1.07.15 and the G1gc. My test cluster is
> > > >> pretty taxed and your milage might vary; it's worth testing on your
> > > >> workload.
> > > >>
> > > >> I'm currently upgrading the jvm to release 25 hoping that the core
> > > >> dumps will be solved.
> > > >>
> > > >> On Tue, Sep 3, 2013 at 10:06 PM, anil gupta <an...@gmail.com>
> > > wrote:
> > > >> > Also, if HBase0.94 is officially certified to work with JDK7 then
> it
> > > will
> > > >> > save duplicate work from Individual users like me and you.
> Currently
> > > GC
> > > >> > with big JVM heaps is a big concern with HBase. If users will get
> > > options
> > > >> > to use G1GC then it might alleviate some pains of many HBase
> users.
> > > >> >
> > > >> >
> > > >> > On Tue, Sep 3, 2013 at 10:03 PM, anil gupta <
> anilgupta84@gmail.com>
> > > >> wrote:
> > > >> >
> > > >> >> Hi Lars,
> > > >> >>
> > > >> >> Even if we setup Jenkins with JDK7 then also we wont be able to
> use
> > > JDK7
> > > >> >> in prod HBase cluster. Beacuse, as per our process, we can only
> use
> > > the
> > > >> JDK
> > > >> >> that is certified by Apache HBase. If we don't follow this rule
> > then
> > > >> IT/DBA
> > > >> >> folks wont support us. That's why i am looking for JDK7
> > > certification of
> > > >> >> HBase0.94. It would be great if an official certification can be
> > > done.
> > > >> >>
> > > >> >> Thanks,
> > > >> >> Anil
> > > >> >>
> > > >> >>
> > > >> >> On Tue, Sep 3, 2013 at 5:35 PM, lars hofhansl <la...@apache.org>
> > > wrote:
> > > >> >>
> > > >> >>> We (Salesforce) are using HBase with JDK7. No issues seen so
> far.
> > > >> >>>
> > > >> >>> 0.94 is not "officially certified" to work on JDK7 (we have no
> > JDK7
> > > >> >>> jenkins, etc).
> > > >> >>>
> > > >> >>> It might be good to setup a JDK7 jenkins for 0.94. Any
> objections
> > to
> > > >> >>> doing that?
> > > >> >>>
> > > >> >>> -- Lars
> > > >> >>>
> > > >> >>>
> > > >> >>>
> > > >> >>> ----- Original Message -----
> > > >> >>> From: anil gupta <an...@gmail.com>
> > > >> >>> To: "user@hbase.apache.org" <us...@hbase.apache.org>
> > > >> >>> Cc:
> > > >> >>> Sent: Tuesday, September 3, 2013 4:26 PM
> > > >> >>> Subject: (HBASE-5261)HBase 0.94 cerification for JDK7
> > > >> >>>
> > > >> >>> Hi All,
> > > >> >>>
> > > >> >>> We are thinking of running HBase(we have JVM heaps larger than
> 25
> > > GB)
> > > >> with
> > > >> >>> JDK7 to use G1 garbage collection, but as a precaution we would
> > like
> > > >> HBase
> > > >> >>> to be certified with JDK7. I see this ticket for same:
> > > >> >>> https://issues.apache.org/jira/browse/HBASE-5261
> > > >> >>> Above havent had any activity from November, 2012. Are there any
> > > >> timelines
> > > >> >>> to certify HBase 0.94 with JDK7?
> > > >> >>>
> > > >> >>> --
> > > >> >>> Thanks & Regards,
> > > >> >>> Anil Gupta
> > > >> >>>
> > > >> >>>
> > > >> >>
> > > >> >>
> > > >> >> --
> > > >> >> Thanks & Regards,
> > > >> >> Anil Gupta
> > > >> >>
> > > >> >
> > > >> >
> > > >> >
> > > >> > --
> > > >> > Thanks & Regards,
> > > >> > Anil Gupta
> > > >>
> > > >
> > > >
> > > >
> > > > --
> > > > Thanks & Regards,
> > > > Anil Gupta
> > >
> >
> >
> >
> > --
> > Thanks & Regards,
> > Anil Gupta
> >
>
--
Thanks & Regards,
Anil Gupta
Re: (HBASE-5261)HBase 0.94 cerification for JDK7
Posted by Stack <st...@duboce.net>.
Anil:
You having GC'ing issues Anil? You hitting Full GCs pretty regularly?
(Setting up a jenkins build as Lars suggests or having us add a note to the
website somewhere saying 0.94 runs on jdk7 -- presuming it passes a couple
of jenkins builds -- would be no problem... just say what you need).
St.Ack
On Wed, Sep 4, 2013 at 2:17 PM, anil gupta <an...@gmail.com> wrote:
> Inline.
>
> On Tue, Sep 3, 2013 at 11:04 PM, Elliott Clark <ec...@apache.org> wrote:
>
> > So since the first question is vendor specific, lets take that off list.
> >
> > The core dumps are mostly while starting a region server up under
> > load, but they are concerning. They are on JDK 1.7.15, which isn't
> > the newest. So I'm hoping that release 25 will help.
> >
> Anil: Yes, trying out 25 will be better. It would be great if you can share
> your results whenever your try out 1.7u25. Meanwhile, i will also try to do
> the same in my environment.
>
> >
> > I also run YCSB on the cluster after all the tests and during those
> > runs the region servers have been very stable.
> >
> > On Tue, Sep 3, 2013 at 10:42 PM, anil gupta <an...@gmail.com>
> wrote:
> > > Hi Elliot,
> > >
> > > That's cool!
> > > We have CDH Enterprise license. Would you mind pointing me to the
> > doc/link
> > > that states same?
> > > However, core dumps sounds bad for prod environment. Are there any
> > specific
> > > patterns for core-dumps? Does it only happens under very heavy load? If
> > > yes, then how much read/write load?
> > >
> > > If you want to take this offline, i am fine with that also.
> > >
> > > Thanks,
> > > Anil
> > >
> > >
> > > On Tue, Sep 3, 2013 at 10:26 PM, Elliott Clark <ec...@apache.org>
> > wrote:
> > >
> > >> Cloudera (my employer) has certified their distribution(CDH4.2+) on
> > >> JDK7. That includes HBase 94. I'm sure they would answer questions
> > >> about what was tested, on their mailing lists or forums.
> > >>
> > >> I imagine that Hortonworks has done similar testing though I am not as
> > >> well versed in it.
> > >>
> > >> I personally been running a test cluster with Integration tests (for
> > >> 0.96) on jdk7, G1 gc, and 30 gig heaps for a couple of months now.
> > >> There have been a couple of times that the region servers have core
> > >> dumped because of the JVM. However I would say the region servers are
> > >> some what stable with JDK 1.07.15 and the G1gc. My test cluster is
> > >> pretty taxed and your milage might vary; it's worth testing on your
> > >> workload.
> > >>
> > >> I'm currently upgrading the jvm to release 25 hoping that the core
> > >> dumps will be solved.
> > >>
> > >> On Tue, Sep 3, 2013 at 10:06 PM, anil gupta <an...@gmail.com>
> > wrote:
> > >> > Also, if HBase0.94 is officially certified to work with JDK7 then it
> > will
> > >> > save duplicate work from Individual users like me and you. Currently
> > GC
> > >> > with big JVM heaps is a big concern with HBase. If users will get
> > options
> > >> > to use G1GC then it might alleviate some pains of many HBase users.
> > >> >
> > >> >
> > >> > On Tue, Sep 3, 2013 at 10:03 PM, anil gupta <an...@gmail.com>
> > >> wrote:
> > >> >
> > >> >> Hi Lars,
> > >> >>
> > >> >> Even if we setup Jenkins with JDK7 then also we wont be able to use
> > JDK7
> > >> >> in prod HBase cluster. Beacuse, as per our process, we can only use
> > the
> > >> JDK
> > >> >> that is certified by Apache HBase. If we don't follow this rule
> then
> > >> IT/DBA
> > >> >> folks wont support us. That's why i am looking for JDK7
> > certification of
> > >> >> HBase0.94. It would be great if an official certification can be
> > done.
> > >> >>
> > >> >> Thanks,
> > >> >> Anil
> > >> >>
> > >> >>
> > >> >> On Tue, Sep 3, 2013 at 5:35 PM, lars hofhansl <la...@apache.org>
> > wrote:
> > >> >>
> > >> >>> We (Salesforce) are using HBase with JDK7. No issues seen so far.
> > >> >>>
> > >> >>> 0.94 is not "officially certified" to work on JDK7 (we have no
> JDK7
> > >> >>> jenkins, etc).
> > >> >>>
> > >> >>> It might be good to setup a JDK7 jenkins for 0.94. Any objections
> to
> > >> >>> doing that?
> > >> >>>
> > >> >>> -- Lars
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>> ----- Original Message -----
> > >> >>> From: anil gupta <an...@gmail.com>
> > >> >>> To: "user@hbase.apache.org" <us...@hbase.apache.org>
> > >> >>> Cc:
> > >> >>> Sent: Tuesday, September 3, 2013 4:26 PM
> > >> >>> Subject: (HBASE-5261)HBase 0.94 cerification for JDK7
> > >> >>>
> > >> >>> Hi All,
> > >> >>>
> > >> >>> We are thinking of running HBase(we have JVM heaps larger than 25
> > GB)
> > >> with
> > >> >>> JDK7 to use G1 garbage collection, but as a precaution we would
> like
> > >> HBase
> > >> >>> to be certified with JDK7. I see this ticket for same:
> > >> >>> https://issues.apache.org/jira/browse/HBASE-5261
> > >> >>> Above havent had any activity from November, 2012. Are there any
> > >> timelines
> > >> >>> to certify HBase 0.94 with JDK7?
> > >> >>>
> > >> >>> --
> > >> >>> Thanks & Regards,
> > >> >>> Anil Gupta
> > >> >>>
> > >> >>>
> > >> >>
> > >> >>
> > >> >> --
> > >> >> Thanks & Regards,
> > >> >> Anil Gupta
> > >> >>
> > >> >
> > >> >
> > >> >
> > >> > --
> > >> > Thanks & Regards,
> > >> > Anil Gupta
> > >>
> > >
> > >
> > >
> > > --
> > > Thanks & Regards,
> > > Anil Gupta
> >
>
>
>
> --
> Thanks & Regards,
> Anil Gupta
>
Re: (HBASE-5261)HBase 0.94 cerification for JDK7
Posted by anil gupta <an...@gmail.com>.
Inline.
On Tue, Sep 3, 2013 at 11:04 PM, Elliott Clark <ec...@apache.org> wrote:
> So since the first question is vendor specific, lets take that off list.
>
> The core dumps are mostly while starting a region server up under
> load, but they are concerning. They are on JDK 1.7.15, which isn't
> the newest. So I'm hoping that release 25 will help.
>
Anil: Yes, trying out 25 will be better. It would be great if you can share
your results whenever your try out 1.7u25. Meanwhile, i will also try to do
the same in my environment.
>
> I also run YCSB on the cluster after all the tests and during those
> runs the region servers have been very stable.
>
> On Tue, Sep 3, 2013 at 10:42 PM, anil gupta <an...@gmail.com> wrote:
> > Hi Elliot,
> >
> > That's cool!
> > We have CDH Enterprise license. Would you mind pointing me to the
> doc/link
> > that states same?
> > However, core dumps sounds bad for prod environment. Are there any
> specific
> > patterns for core-dumps? Does it only happens under very heavy load? If
> > yes, then how much read/write load?
> >
> > If you want to take this offline, i am fine with that also.
> >
> > Thanks,
> > Anil
> >
> >
> > On Tue, Sep 3, 2013 at 10:26 PM, Elliott Clark <ec...@apache.org>
> wrote:
> >
> >> Cloudera (my employer) has certified their distribution(CDH4.2+) on
> >> JDK7. That includes HBase 94. I'm sure they would answer questions
> >> about what was tested, on their mailing lists or forums.
> >>
> >> I imagine that Hortonworks has done similar testing though I am not as
> >> well versed in it.
> >>
> >> I personally been running a test cluster with Integration tests (for
> >> 0.96) on jdk7, G1 gc, and 30 gig heaps for a couple of months now.
> >> There have been a couple of times that the region servers have core
> >> dumped because of the JVM. However I would say the region servers are
> >> some what stable with JDK 1.07.15 and the G1gc. My test cluster is
> >> pretty taxed and your milage might vary; it's worth testing on your
> >> workload.
> >>
> >> I'm currently upgrading the jvm to release 25 hoping that the core
> >> dumps will be solved.
> >>
> >> On Tue, Sep 3, 2013 at 10:06 PM, anil gupta <an...@gmail.com>
> wrote:
> >> > Also, if HBase0.94 is officially certified to work with JDK7 then it
> will
> >> > save duplicate work from Individual users like me and you. Currently
> GC
> >> > with big JVM heaps is a big concern with HBase. If users will get
> options
> >> > to use G1GC then it might alleviate some pains of many HBase users.
> >> >
> >> >
> >> > On Tue, Sep 3, 2013 at 10:03 PM, anil gupta <an...@gmail.com>
> >> wrote:
> >> >
> >> >> Hi Lars,
> >> >>
> >> >> Even if we setup Jenkins with JDK7 then also we wont be able to use
> JDK7
> >> >> in prod HBase cluster. Beacuse, as per our process, we can only use
> the
> >> JDK
> >> >> that is certified by Apache HBase. If we don't follow this rule then
> >> IT/DBA
> >> >> folks wont support us. That's why i am looking for JDK7
> certification of
> >> >> HBase0.94. It would be great if an official certification can be
> done.
> >> >>
> >> >> Thanks,
> >> >> Anil
> >> >>
> >> >>
> >> >> On Tue, Sep 3, 2013 at 5:35 PM, lars hofhansl <la...@apache.org>
> wrote:
> >> >>
> >> >>> We (Salesforce) are using HBase with JDK7. No issues seen so far.
> >> >>>
> >> >>> 0.94 is not "officially certified" to work on JDK7 (we have no JDK7
> >> >>> jenkins, etc).
> >> >>>
> >> >>> It might be good to setup a JDK7 jenkins for 0.94. Any objections to
> >> >>> doing that?
> >> >>>
> >> >>> -- Lars
> >> >>>
> >> >>>
> >> >>>
> >> >>> ----- Original Message -----
> >> >>> From: anil gupta <an...@gmail.com>
> >> >>> To: "user@hbase.apache.org" <us...@hbase.apache.org>
> >> >>> Cc:
> >> >>> Sent: Tuesday, September 3, 2013 4:26 PM
> >> >>> Subject: (HBASE-5261)HBase 0.94 cerification for JDK7
> >> >>>
> >> >>> Hi All,
> >> >>>
> >> >>> We are thinking of running HBase(we have JVM heaps larger than 25
> GB)
> >> with
> >> >>> JDK7 to use G1 garbage collection, but as a precaution we would like
> >> HBase
> >> >>> to be certified with JDK7. I see this ticket for same:
> >> >>> https://issues.apache.org/jira/browse/HBASE-5261
> >> >>> Above havent had any activity from November, 2012. Are there any
> >> timelines
> >> >>> to certify HBase 0.94 with JDK7?
> >> >>>
> >> >>> --
> >> >>> Thanks & Regards,
> >> >>> Anil Gupta
> >> >>>
> >> >>>
> >> >>
> >> >>
> >> >> --
> >> >> Thanks & Regards,
> >> >> Anil Gupta
> >> >>
> >> >
> >> >
> >> >
> >> > --
> >> > Thanks & Regards,
> >> > Anil Gupta
> >>
> >
> >
> >
> > --
> > Thanks & Regards,
> > Anil Gupta
>
--
Thanks & Regards,
Anil Gupta
Re: (HBASE-5261)HBase 0.94 cerification for JDK7
Posted by Elliott Clark <ec...@apache.org>.
So since the first question is vendor specific, lets take that off list.
The core dumps are mostly while starting a region server up under
load, but they are concerning. They are on JDK 1.7.15, which isn't
the newest. So I'm hoping that release 25 will help.
I also run YCSB on the cluster after all the tests and during those
runs the region servers have been very stable.
On Tue, Sep 3, 2013 at 10:42 PM, anil gupta <an...@gmail.com> wrote:
> Hi Elliot,
>
> That's cool!
> We have CDH Enterprise license. Would you mind pointing me to the doc/link
> that states same?
> However, core dumps sounds bad for prod environment. Are there any specific
> patterns for core-dumps? Does it only happens under very heavy load? If
> yes, then how much read/write load?
>
> If you want to take this offline, i am fine with that also.
>
> Thanks,
> Anil
>
>
> On Tue, Sep 3, 2013 at 10:26 PM, Elliott Clark <ec...@apache.org> wrote:
>
>> Cloudera (my employer) has certified their distribution(CDH4.2+) on
>> JDK7. That includes HBase 94. I'm sure they would answer questions
>> about what was tested, on their mailing lists or forums.
>>
>> I imagine that Hortonworks has done similar testing though I am not as
>> well versed in it.
>>
>> I personally been running a test cluster with Integration tests (for
>> 0.96) on jdk7, G1 gc, and 30 gig heaps for a couple of months now.
>> There have been a couple of times that the region servers have core
>> dumped because of the JVM. However I would say the region servers are
>> some what stable with JDK 1.07.15 and the G1gc. My test cluster is
>> pretty taxed and your milage might vary; it's worth testing on your
>> workload.
>>
>> I'm currently upgrading the jvm to release 25 hoping that the core
>> dumps will be solved.
>>
>> On Tue, Sep 3, 2013 at 10:06 PM, anil gupta <an...@gmail.com> wrote:
>> > Also, if HBase0.94 is officially certified to work with JDK7 then it will
>> > save duplicate work from Individual users like me and you. Currently GC
>> > with big JVM heaps is a big concern with HBase. If users will get options
>> > to use G1GC then it might alleviate some pains of many HBase users.
>> >
>> >
>> > On Tue, Sep 3, 2013 at 10:03 PM, anil gupta <an...@gmail.com>
>> wrote:
>> >
>> >> Hi Lars,
>> >>
>> >> Even if we setup Jenkins with JDK7 then also we wont be able to use JDK7
>> >> in prod HBase cluster. Beacuse, as per our process, we can only use the
>> JDK
>> >> that is certified by Apache HBase. If we don't follow this rule then
>> IT/DBA
>> >> folks wont support us. That's why i am looking for JDK7 certification of
>> >> HBase0.94. It would be great if an official certification can be done.
>> >>
>> >> Thanks,
>> >> Anil
>> >>
>> >>
>> >> On Tue, Sep 3, 2013 at 5:35 PM, lars hofhansl <la...@apache.org> wrote:
>> >>
>> >>> We (Salesforce) are using HBase with JDK7. No issues seen so far.
>> >>>
>> >>> 0.94 is not "officially certified" to work on JDK7 (we have no JDK7
>> >>> jenkins, etc).
>> >>>
>> >>> It might be good to setup a JDK7 jenkins for 0.94. Any objections to
>> >>> doing that?
>> >>>
>> >>> -- Lars
>> >>>
>> >>>
>> >>>
>> >>> ----- Original Message -----
>> >>> From: anil gupta <an...@gmail.com>
>> >>> To: "user@hbase.apache.org" <us...@hbase.apache.org>
>> >>> Cc:
>> >>> Sent: Tuesday, September 3, 2013 4:26 PM
>> >>> Subject: (HBASE-5261)HBase 0.94 cerification for JDK7
>> >>>
>> >>> Hi All,
>> >>>
>> >>> We are thinking of running HBase(we have JVM heaps larger than 25 GB)
>> with
>> >>> JDK7 to use G1 garbage collection, but as a precaution we would like
>> HBase
>> >>> to be certified with JDK7. I see this ticket for same:
>> >>> https://issues.apache.org/jira/browse/HBASE-5261
>> >>> Above havent had any activity from November, 2012. Are there any
>> timelines
>> >>> to certify HBase 0.94 with JDK7?
>> >>>
>> >>> --
>> >>> Thanks & Regards,
>> >>> Anil Gupta
>> >>>
>> >>>
>> >>
>> >>
>> >> --
>> >> Thanks & Regards,
>> >> Anil Gupta
>> >>
>> >
>> >
>> >
>> > --
>> > Thanks & Regards,
>> > Anil Gupta
>>
>
>
>
> --
> Thanks & Regards,
> Anil Gupta
Re: (HBASE-5261)HBase 0.94 cerification for JDK7
Posted by anil gupta <an...@gmail.com>.
Hi Elliot,
That's cool!
We have CDH Enterprise license. Would you mind pointing me to the doc/link
that states same?
However, core dumps sounds bad for prod environment. Are there any specific
patterns for core-dumps? Does it only happens under very heavy load? If
yes, then how much read/write load?
If you want to take this offline, i am fine with that also.
Thanks,
Anil
On Tue, Sep 3, 2013 at 10:26 PM, Elliott Clark <ec...@apache.org> wrote:
> Cloudera (my employer) has certified their distribution(CDH4.2+) on
> JDK7. That includes HBase 94. I'm sure they would answer questions
> about what was tested, on their mailing lists or forums.
>
> I imagine that Hortonworks has done similar testing though I am not as
> well versed in it.
>
> I personally been running a test cluster with Integration tests (for
> 0.96) on jdk7, G1 gc, and 30 gig heaps for a couple of months now.
> There have been a couple of times that the region servers have core
> dumped because of the JVM. However I would say the region servers are
> some what stable with JDK 1.07.15 and the G1gc. My test cluster is
> pretty taxed and your milage might vary; it's worth testing on your
> workload.
>
> I'm currently upgrading the jvm to release 25 hoping that the core
> dumps will be solved.
>
> On Tue, Sep 3, 2013 at 10:06 PM, anil gupta <an...@gmail.com> wrote:
> > Also, if HBase0.94 is officially certified to work with JDK7 then it will
> > save duplicate work from Individual users like me and you. Currently GC
> > with big JVM heaps is a big concern with HBase. If users will get options
> > to use G1GC then it might alleviate some pains of many HBase users.
> >
> >
> > On Tue, Sep 3, 2013 at 10:03 PM, anil gupta <an...@gmail.com>
> wrote:
> >
> >> Hi Lars,
> >>
> >> Even if we setup Jenkins with JDK7 then also we wont be able to use JDK7
> >> in prod HBase cluster. Beacuse, as per our process, we can only use the
> JDK
> >> that is certified by Apache HBase. If we don't follow this rule then
> IT/DBA
> >> folks wont support us. That's why i am looking for JDK7 certification of
> >> HBase0.94. It would be great if an official certification can be done.
> >>
> >> Thanks,
> >> Anil
> >>
> >>
> >> On Tue, Sep 3, 2013 at 5:35 PM, lars hofhansl <la...@apache.org> wrote:
> >>
> >>> We (Salesforce) are using HBase with JDK7. No issues seen so far.
> >>>
> >>> 0.94 is not "officially certified" to work on JDK7 (we have no JDK7
> >>> jenkins, etc).
> >>>
> >>> It might be good to setup a JDK7 jenkins for 0.94. Any objections to
> >>> doing that?
> >>>
> >>> -- Lars
> >>>
> >>>
> >>>
> >>> ----- Original Message -----
> >>> From: anil gupta <an...@gmail.com>
> >>> To: "user@hbase.apache.org" <us...@hbase.apache.org>
> >>> Cc:
> >>> Sent: Tuesday, September 3, 2013 4:26 PM
> >>> Subject: (HBASE-5261)HBase 0.94 cerification for JDK7
> >>>
> >>> Hi All,
> >>>
> >>> We are thinking of running HBase(we have JVM heaps larger than 25 GB)
> with
> >>> JDK7 to use G1 garbage collection, but as a precaution we would like
> HBase
> >>> to be certified with JDK7. I see this ticket for same:
> >>> https://issues.apache.org/jira/browse/HBASE-5261
> >>> Above havent had any activity from November, 2012. Are there any
> timelines
> >>> to certify HBase 0.94 with JDK7?
> >>>
> >>> --
> >>> Thanks & Regards,
> >>> Anil Gupta
> >>>
> >>>
> >>
> >>
> >> --
> >> Thanks & Regards,
> >> Anil Gupta
> >>
> >
> >
> >
> > --
> > Thanks & Regards,
> > Anil Gupta
>
--
Thanks & Regards,
Anil Gupta
Re: (HBASE-5261)HBase 0.94 cerification for JDK7
Posted by Elliott Clark <ec...@apache.org>.
Cloudera (my employer) has certified their distribution(CDH4.2+) on
JDK7. That includes HBase 94. I'm sure they would answer questions
about what was tested, on their mailing lists or forums.
I imagine that Hortonworks has done similar testing though I am not as
well versed in it.
I personally been running a test cluster with Integration tests (for
0.96) on jdk7, G1 gc, and 30 gig heaps for a couple of months now.
There have been a couple of times that the region servers have core
dumped because of the JVM. However I would say the region servers are
some what stable with JDK 1.07.15 and the G1gc. My test cluster is
pretty taxed and your milage might vary; it's worth testing on your
workload.
I'm currently upgrading the jvm to release 25 hoping that the core
dumps will be solved.
On Tue, Sep 3, 2013 at 10:06 PM, anil gupta <an...@gmail.com> wrote:
> Also, if HBase0.94 is officially certified to work with JDK7 then it will
> save duplicate work from Individual users like me and you. Currently GC
> with big JVM heaps is a big concern with HBase. If users will get options
> to use G1GC then it might alleviate some pains of many HBase users.
>
>
> On Tue, Sep 3, 2013 at 10:03 PM, anil gupta <an...@gmail.com> wrote:
>
>> Hi Lars,
>>
>> Even if we setup Jenkins with JDK7 then also we wont be able to use JDK7
>> in prod HBase cluster. Beacuse, as per our process, we can only use the JDK
>> that is certified by Apache HBase. If we don't follow this rule then IT/DBA
>> folks wont support us. That's why i am looking for JDK7 certification of
>> HBase0.94. It would be great if an official certification can be done.
>>
>> Thanks,
>> Anil
>>
>>
>> On Tue, Sep 3, 2013 at 5:35 PM, lars hofhansl <la...@apache.org> wrote:
>>
>>> We (Salesforce) are using HBase with JDK7. No issues seen so far.
>>>
>>> 0.94 is not "officially certified" to work on JDK7 (we have no JDK7
>>> jenkins, etc).
>>>
>>> It might be good to setup a JDK7 jenkins for 0.94. Any objections to
>>> doing that?
>>>
>>> -- Lars
>>>
>>>
>>>
>>> ----- Original Message -----
>>> From: anil gupta <an...@gmail.com>
>>> To: "user@hbase.apache.org" <us...@hbase.apache.org>
>>> Cc:
>>> Sent: Tuesday, September 3, 2013 4:26 PM
>>> Subject: (HBASE-5261)HBase 0.94 cerification for JDK7
>>>
>>> Hi All,
>>>
>>> We are thinking of running HBase(we have JVM heaps larger than 25 GB) with
>>> JDK7 to use G1 garbage collection, but as a precaution we would like HBase
>>> to be certified with JDK7. I see this ticket for same:
>>> https://issues.apache.org/jira/browse/HBASE-5261
>>> Above havent had any activity from November, 2012. Are there any timelines
>>> to certify HBase 0.94 with JDK7?
>>>
>>> --
>>> Thanks & Regards,
>>> Anil Gupta
>>>
>>>
>>
>>
>> --
>> Thanks & Regards,
>> Anil Gupta
>>
>
>
>
> --
> Thanks & Regards,
> Anil Gupta
Re: (HBASE-5261)HBase 0.94 cerification for JDK7
Posted by anil gupta <an...@gmail.com>.
Also, if HBase0.94 is officially certified to work with JDK7 then it will
save duplicate work from Individual users like me and you. Currently GC
with big JVM heaps is a big concern with HBase. If users will get options
to use G1GC then it might alleviate some pains of many HBase users.
On Tue, Sep 3, 2013 at 10:03 PM, anil gupta <an...@gmail.com> wrote:
> Hi Lars,
>
> Even if we setup Jenkins with JDK7 then also we wont be able to use JDK7
> in prod HBase cluster. Beacuse, as per our process, we can only use the JDK
> that is certified by Apache HBase. If we don't follow this rule then IT/DBA
> folks wont support us. That's why i am looking for JDK7 certification of
> HBase0.94. It would be great if an official certification can be done.
>
> Thanks,
> Anil
>
>
> On Tue, Sep 3, 2013 at 5:35 PM, lars hofhansl <la...@apache.org> wrote:
>
>> We (Salesforce) are using HBase with JDK7. No issues seen so far.
>>
>> 0.94 is not "officially certified" to work on JDK7 (we have no JDK7
>> jenkins, etc).
>>
>> It might be good to setup a JDK7 jenkins for 0.94. Any objections to
>> doing that?
>>
>> -- Lars
>>
>>
>>
>> ----- Original Message -----
>> From: anil gupta <an...@gmail.com>
>> To: "user@hbase.apache.org" <us...@hbase.apache.org>
>> Cc:
>> Sent: Tuesday, September 3, 2013 4:26 PM
>> Subject: (HBASE-5261)HBase 0.94 cerification for JDK7
>>
>> Hi All,
>>
>> We are thinking of running HBase(we have JVM heaps larger than 25 GB) with
>> JDK7 to use G1 garbage collection, but as a precaution we would like HBase
>> to be certified with JDK7. I see this ticket for same:
>> https://issues.apache.org/jira/browse/HBASE-5261
>> Above havent had any activity from November, 2012. Are there any timelines
>> to certify HBase 0.94 with JDK7?
>>
>> --
>> Thanks & Regards,
>> Anil Gupta
>>
>>
>
>
> --
> Thanks & Regards,
> Anil Gupta
>
--
Thanks & Regards,
Anil Gupta
Re: (HBASE-5261)HBase 0.94 cerification for JDK7
Posted by anil gupta <an...@gmail.com>.
Hi Lars,
Even if we setup Jenkins with JDK7 then also we wont be able to use JDK7 in
prod HBase cluster. Beacuse, as per our process, we can only use the JDK
that is certified by Apache HBase. If we don't follow this rule then IT/DBA
folks wont support us. That's why i am looking for JDK7 certification of
HBase0.94. It would be great if an official certification can be done.
Thanks,
Anil
On Tue, Sep 3, 2013 at 5:35 PM, lars hofhansl <la...@apache.org> wrote:
> We (Salesforce) are using HBase with JDK7. No issues seen so far.
>
> 0.94 is not "officially certified" to work on JDK7 (we have no JDK7
> jenkins, etc).
>
> It might be good to setup a JDK7 jenkins for 0.94. Any objections to doing
> that?
>
> -- Lars
>
>
>
> ----- Original Message -----
> From: anil gupta <an...@gmail.com>
> To: "user@hbase.apache.org" <us...@hbase.apache.org>
> Cc:
> Sent: Tuesday, September 3, 2013 4:26 PM
> Subject: (HBASE-5261)HBase 0.94 cerification for JDK7
>
> Hi All,
>
> We are thinking of running HBase(we have JVM heaps larger than 25 GB) with
> JDK7 to use G1 garbage collection, but as a precaution we would like HBase
> to be certified with JDK7. I see this ticket for same:
> https://issues.apache.org/jira/browse/HBASE-5261
> Above havent had any activity from November, 2012. Are there any timelines
> to certify HBase 0.94 with JDK7?
>
> --
> Thanks & Regards,
> Anil Gupta
>
>
--
Thanks & Regards,
Anil Gupta