You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Otis Gospodnetic <ot...@gmail.com> on 2013/07/10 21:00:35 UTC
G1 before/after GC time graph
Hi,
There was talk of G1 and HBase here over the past few days. I wanted
to share a fresh and telling SPM graph showing G1 + some other params
in action:
Result first: https://apps.sematext.com/spm/s/wN0hKVixxX
This is what we had before:
-XX:+HeapDumpOnOutOfMemoryError -XX:+UseG1GC
-XX:InitiatingHeapOccupancyPercent=35 -XX:G1ReservePercent=25
And then we added:
-XX:MaxGCPauseMillis=200 -XX:NewRatio=4
I hope this helps.
Otis
--
HBase Performance Monitoring -- http://sematext.com/spm
RE: G1 before/after GC time graph
Posted by Vladimir Rodionov <vr...@carrieriq.com>.
+1
1.8G heap is on a very low side. 32-64GB is more interesting cases.
Best regards,
Vladimir Rodionov
Principal Platform Engineer
Carrier IQ, www.carrieriq.com
e-mail: vrodionov@carrieriq.com
________________________________________
From: Kevin O'dell [kevin.odell@cloudera.com]
Sent: Wednesday, July 10, 2013 2:27 PM
To: user@hbase.apache.org
Subject: Re: G1 before/after GC time graph
Anyway you can test this with a 32GB heap? :)
On Wed, Jul 10, 2013 at 5:23 PM, Otis Gospodnetic <
otis.gospodnetic@gmail.com> wrote:
> But, very importantly:
>
> CPU after changes: https://apps.sematext.com/spm/s/CpZ9aPhL9L
> Load after changes: https://apps.sematext.com/spm/s/i7f3x6MXdZ
>
> So in practical terms, use something like -XX:MaxGCPauseMillis=200
> -XX:NewRatio=4 to force short GC pauses, but count on having more of
> them and CPU sweating more. This gives you smaller pauses, no big STW
> pauses, but be prepared to pay in CPU cycles.
>
> HTH
>
> Otis
> --
> HBase Performance Monitoring -- http://sematext.com/spm
>
>
>
> On Wed, Jul 10, 2013 at 4:20 PM, Otis Gospodnetic
> <ot...@gmail.com> wrote:
> > Not big in this case - 1800m
> >
> > Otis
> > --
> > HBase Performance Monitoring -- http://sematext.com/spm
> >
> >
> >
> > On Wed, Jul 10, 2013 at 3:57 PM, Vladimir Rodionov
> > <vr...@carrieriq.com> wrote:
> >>
> >> What is -Xmx heap size?
> >>
> >> Best regards,
> >> Vladimir Rodionov
> >> Principal Platform Engineer
> >> Carrier IQ, www.carrieriq.com
> >> e-mail: vrodionov@carrieriq.com
> >>
> >> ________________________________________
> >> From: Otis Gospodnetic [otis.gospodnetic@gmail.com]
> >> Sent: Wednesday, July 10, 2013 12:00 PM
> >> To: user@hbase.apache.org
> >> Subject: G1 before/after GC time graph
> >>
> >> Hi,
> >>
> >> There was talk of G1 and HBase here over the past few days. I wanted
> >> to share a fresh and telling SPM graph showing G1 + some other params
> >> in action:
> >>
> >> Result first: https://apps.sematext.com/spm/s/wN0hKVixxX
> >>
> >> This is what we had before:
> >> -XX:+HeapDumpOnOutOfMemoryError -XX:+UseG1GC
> >> -XX:InitiatingHeapOccupancyPercent=35 -XX:G1ReservePercent=25
> >>
> >> And then we added:
> >> -XX:MaxGCPauseMillis=200 -XX:NewRatio=4
> >>
> >> I hope this helps.
> >>
> >> Otis
> >> --
> >> HBase Performance Monitoring -- http://sematext.com/spm
> >>
> >> Confidentiality Notice: The information contained in this message,
> including any attachments hereto, may be confidential and is intended to be
> read only by the individual or entity to whom this message is addressed. If
> the reader of this message is not the intended recipient or an agent or
> designee of the intended recipient, please note that any review, use,
> disclosure or distribution of this message or its attachments, in any form,
> is strictly prohibited. If you have received this message in error, please
> immediately notify the sender and/or Notifications@carrieriq.com and
> delete or destroy any copy of this message and its attachments.
>
--
Kevin O'Dell
Systems Engineer, Cloudera
Confidentiality Notice: The information contained in this message, including any attachments hereto, may be confidential and is intended to be read only by the individual or entity to whom this message is addressed. If the reader of this message is not the intended recipient or an agent or designee of the intended recipient, please note that any review, use, disclosure or distribution of this message or its attachments, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or Notifications@carrieriq.com and delete or destroy any copy of this message and its attachments.
Re: G1 before/after GC time graph
Posted by Otis Gospodnetic <ot...@gmail.com>.
Correct!
Otis
Solr & ElasticSearch Support
http://sematext.com/
On Jul 11, 2013 1:18 PM, "Asaf Mesika" <as...@gmail.com> wrote:
> This means you can safely run Hadoop and Hbase on jvm 7?
> We were just considering switching in production to java 7.
>
> On Thursday, July 11, 2013, Azuryy Yu wrote:
>
> > Otis,
> >
> > I will do this test, maybe on the end of this month. because I haven't
> big
> > memory server for test now util the end of this month.
> >
> >
> >
> >
> > On Thu, Jul 11, 2013 at 9:38 AM, Otis Gospodnetic <
> > otis.gospodnetic@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > Probably not any time in the near future. We could do it, plop SPM in
> > > it and watch, but don't have time for it now.
> > >
> > > If anyone wants to give it a shot and use SPM to capture various
> > > JVM/HBase/server metrics, let me know if help around SPM is needed,
> > > longer trials, or whatever.
> > >
> > > Otis
> > > --
> > > HBase Performance Monitoring -- http://sematext.com/spm
> > >
> > >
> > >
> > > On Wed, Jul 10, 2013 at 5:27 PM, Kevin O'dell <
> kevin.odell@cloudera.com>
> > > wrote:
> > > > Anyway you can test this with a 32GB heap? :)
> > > >
> > > >
> > > > On Wed, Jul 10, 2013 at 5:23 PM, Otis Gospodnetic <
> > > > otis.gospodnetic@gmail.com> wrote:
> > > >
> > > >> But, very importantly:
> > > >>
> > > >> CPU after changes: https://apps.sematext.com/spm/s/CpZ9aPhL9L
> > > >> Load after changes: https://apps.sematext.com/spm/s/i7f3x6MXdZ
> > > >>
> > > >> So in practical terms, use something like -XX:MaxGCPauseMillis=200
> > > >> -XX:NewRatio=4 to force short GC pauses, but count on having more of
> > > >> them and CPU sweating more. This gives you smaller pauses, no big
> STW
> > > >> pauses, but be prepared to pay in CPU cycles.
> > > >>
> > > >> HTH
> > > >>
> > > >> Otis
> > > >> --
> > > >> HBase Performance Monitoring -- http://sematext.com/spm
> > > >>
> > > >>
> > > >>
> > > >> On Wed, Jul 10, 2013 at 4:20 PM, Otis Gospodnetic
> > > >> <ot...@gmail.com> wrote:
> > > >> > Not big in this case - 1800m
> > > >> >
> > > >> > Otis
> > > >> > --
> > > >> > HBase Performance Monitoring -- http://sematext.com/spm
> > > >> >
> > > >> >
> > > >> >
> > > >> > On Wed, Jul 10, 2013 at 3:57 PM, Vladimir Rodionov
> > > >> > <vr...@carrieriq.com> wrote:
> > > >> >>
> > > >> >> What is -Xmx heap size?
> > > >> >>
> > > >> >> Best regards,
> > > >> >> Vladimir Rodionov
> > > >> >> Principal Platform Engineer
> > > >> >> Carrier IQ, www.carrieriq.com
> > > >> >> e-mail: vrodionov@carrieriq.com
> > > >> >>
> > > >> >> ________________________________________
> > > >> >> From: Otis Gospodnetic [otis.gospodnetic@gmail.com]
> > > >> >> Sent: Wednesday, July 10, 2013 12:00 PM
> > > >> >> To: user@hbase.apache.org
> > > >> >> Subject: G1 before/after GC time graph
> > > >> >>
> > > >> >> Hi,
> > > >> >>
> > > >> >> There was talk of G1 and HBase here over the past few days. I
> > wanted
> > > >> >> to share a fresh and telling SPM graph showing G1 + some other
> > params
> > > >> >> in action:
> > > >> >>
> > > >> >> Result first: https://apps.sematext.com/spm/s/wN0hKVixxX
> > > >> >>
> > > >> >> This is what we had before:
> > > >> >> -XX:+HeapDumpOnOutOfMemoryError -XX:+UseG1GC
> > > >> >> -XX:InitiatingHeapOccupancyPercent=35 -XX:G1ReservePercent=25
> > > >> >>
> > > >> >> And then we added:
> > > >> >>
>
Re: G1 before/after GC time graph
Posted by Azuryy Yu <az...@gmail.com>.
our prod clustet also run on java7 for a long time.
On Jul 12, 2013 1:18 AM, "Asaf Mesika" <as...@gmail.com> wrote:
> This means you can safely run Hadoop and Hbase on jvm 7?
> We were just considering switching in production to java 7.
>
> On Thursday, July 11, 2013, Azuryy Yu wrote:
>
> > Otis,
> >
> > I will do this test, maybe on the end of this month. because I haven't
> big
> > memory server for test now util the end of this month.
> >
> >
> >
> >
> > On Thu, Jul 11, 2013 at 9:38 AM, Otis Gospodnetic <
> > otis.gospodnetic@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > Probably not any time in the near future. We could do it, plop SPM in
> > > it and watch, but don't have time for it now.
> > >
> > > If anyone wants to give it a shot and use SPM to capture various
> > > JVM/HBase/server metrics, let me know if help around SPM is needed,
> > > longer trials, or whatever.
> > >
> > > Otis
> > > --
> > > HBase Performance Monitoring -- http://sematext.com/spm
> > >
> > >
> > >
> > > On Wed, Jul 10, 2013 at 5:27 PM, Kevin O'dell <
> kevin.odell@cloudera.com>
> > > wrote:
> > > > Anyway you can test this with a 32GB heap? :)
> > > >
> > > >
> > > > On Wed, Jul 10, 2013 at 5:23 PM, Otis Gospodnetic <
> > > > otis.gospodnetic@gmail.com> wrote:
> > > >
> > > >> But, very importantly:
> > > >>
> > > >> CPU after changes: https://apps.sematext.com/spm/s/CpZ9aPhL9L
> > > >> Load after changes: https://apps.sematext.com/spm/s/i7f3x6MXdZ
> > > >>
> > > >> So in practical terms, use something like -XX:MaxGCPauseMillis=200
> > > >> -XX:NewRatio=4 to force short GC pauses, but count on having more of
> > > >> them and CPU sweating more. This gives you smaller pauses, no big
> STW
> > > >> pauses, but be prepared to pay in CPU cycles.
> > > >>
> > > >> HTH
> > > >>
> > > >> Otis
> > > >> --
> > > >> HBase Performance Monitoring -- http://sematext.com/spm
> > > >>
> > > >>
> > > >>
> > > >> On Wed, Jul 10, 2013 at 4:20 PM, Otis Gospodnetic
> > > >> <ot...@gmail.com> wrote:
> > > >> > Not big in this case - 1800m
> > > >> >
> > > >> > Otis
> > > >> > --
> > > >> > HBase Performance Monitoring -- http://sematext.com/spm
> > > >> >
> > > >> >
> > > >> >
> > > >> > On Wed, Jul 10, 2013 at 3:57 PM, Vladimir Rodionov
> > > >> > <vr...@carrieriq.com> wrote:
> > > >> >>
> > > >> >> What is -Xmx heap size?
> > > >> >>
> > > >> >> Best regards,
> > > >> >> Vladimir Rodionov
> > > >> >> Principal Platform Engineer
> > > >> >> Carrier IQ, www.carrieriq.com
> > > >> >> e-mail: vrodionov@carrieriq.com
> > > >> >>
> > > >> >> ________________________________________
> > > >> >> From: Otis Gospodnetic [otis.gospodnetic@gmail.com]
> > > >> >> Sent: Wednesday, July 10, 2013 12:00 PM
> > > >> >> To: user@hbase.apache.org
> > > >> >> Subject: G1 before/after GC time graph
> > > >> >>
> > > >> >> Hi,
> > > >> >>
> > > >> >> There was talk of G1 and HBase here over the past few days. I
> > wanted
> > > >> >> to share a fresh and telling SPM graph showing G1 + some other
> > params
> > > >> >> in action:
> > > >> >>
> > > >> >> Result first: https://apps.sematext.com/spm/s/wN0hKVixxX
> > > >> >>
> > > >> >> This is what we had before:
> > > >> >> -XX:+HeapDumpOnOutOfMemoryError -XX:+UseG1GC
> > > >> >> -XX:InitiatingHeapOccupancyPercent=35 -XX:G1ReservePercent=25
> > > >> >>
> > > >> >> And then we added:
> > > >> >>
>
Re: G1 before/after GC time graph
Posted by Asaf Mesika <as...@gmail.com>.
This means you can safely run Hadoop and Hbase on jvm 7?
We were just considering switching in production to java 7.
On Thursday, July 11, 2013, Azuryy Yu wrote:
> Otis,
>
> I will do this test, maybe on the end of this month. because I haven't big
> memory server for test now util the end of this month.
>
>
>
>
> On Thu, Jul 11, 2013 at 9:38 AM, Otis Gospodnetic <
> otis.gospodnetic@gmail.com> wrote:
>
> > Hi,
> >
> > Probably not any time in the near future. We could do it, plop SPM in
> > it and watch, but don't have time for it now.
> >
> > If anyone wants to give it a shot and use SPM to capture various
> > JVM/HBase/server metrics, let me know if help around SPM is needed,
> > longer trials, or whatever.
> >
> > Otis
> > --
> > HBase Performance Monitoring -- http://sematext.com/spm
> >
> >
> >
> > On Wed, Jul 10, 2013 at 5:27 PM, Kevin O'dell <ke...@cloudera.com>
> > wrote:
> > > Anyway you can test this with a 32GB heap? :)
> > >
> > >
> > > On Wed, Jul 10, 2013 at 5:23 PM, Otis Gospodnetic <
> > > otis.gospodnetic@gmail.com> wrote:
> > >
> > >> But, very importantly:
> > >>
> > >> CPU after changes: https://apps.sematext.com/spm/s/CpZ9aPhL9L
> > >> Load after changes: https://apps.sematext.com/spm/s/i7f3x6MXdZ
> > >>
> > >> So in practical terms, use something like -XX:MaxGCPauseMillis=200
> > >> -XX:NewRatio=4 to force short GC pauses, but count on having more of
> > >> them and CPU sweating more. This gives you smaller pauses, no big STW
> > >> pauses, but be prepared to pay in CPU cycles.
> > >>
> > >> HTH
> > >>
> > >> Otis
> > >> --
> > >> HBase Performance Monitoring -- http://sematext.com/spm
> > >>
> > >>
> > >>
> > >> On Wed, Jul 10, 2013 at 4:20 PM, Otis Gospodnetic
> > >> <ot...@gmail.com> wrote:
> > >> > Not big in this case - 1800m
> > >> >
> > >> > Otis
> > >> > --
> > >> > HBase Performance Monitoring -- http://sematext.com/spm
> > >> >
> > >> >
> > >> >
> > >> > On Wed, Jul 10, 2013 at 3:57 PM, Vladimir Rodionov
> > >> > <vr...@carrieriq.com> wrote:
> > >> >>
> > >> >> What is -Xmx heap size?
> > >> >>
> > >> >> Best regards,
> > >> >> Vladimir Rodionov
> > >> >> Principal Platform Engineer
> > >> >> Carrier IQ, www.carrieriq.com
> > >> >> e-mail: vrodionov@carrieriq.com
> > >> >>
> > >> >> ________________________________________
> > >> >> From: Otis Gospodnetic [otis.gospodnetic@gmail.com]
> > >> >> Sent: Wednesday, July 10, 2013 12:00 PM
> > >> >> To: user@hbase.apache.org
> > >> >> Subject: G1 before/after GC time graph
> > >> >>
> > >> >> Hi,
> > >> >>
> > >> >> There was talk of G1 and HBase here over the past few days. I
> wanted
> > >> >> to share a fresh and telling SPM graph showing G1 + some other
> params
> > >> >> in action:
> > >> >>
> > >> >> Result first: https://apps.sematext.com/spm/s/wN0hKVixxX
> > >> >>
> > >> >> This is what we had before:
> > >> >> -XX:+HeapDumpOnOutOfMemoryError -XX:+UseG1GC
> > >> >> -XX:InitiatingHeapOccupancyPercent=35 -XX:G1ReservePercent=25
> > >> >>
> > >> >> And then we added:
> > >> >>
Re: G1 before/after GC time graph
Posted by Azuryy Yu <az...@gmail.com>.
Otis,
I will do this test, maybe on the end of this month. because I haven't big
memory server for test now util the end of this month.
On Thu, Jul 11, 2013 at 9:38 AM, Otis Gospodnetic <
otis.gospodnetic@gmail.com> wrote:
> Hi,
>
> Probably not any time in the near future. We could do it, plop SPM in
> it and watch, but don't have time for it now.
>
> If anyone wants to give it a shot and use SPM to capture various
> JVM/HBase/server metrics, let me know if help around SPM is needed,
> longer trials, or whatever.
>
> Otis
> --
> HBase Performance Monitoring -- http://sematext.com/spm
>
>
>
> On Wed, Jul 10, 2013 at 5:27 PM, Kevin O'dell <ke...@cloudera.com>
> wrote:
> > Anyway you can test this with a 32GB heap? :)
> >
> >
> > On Wed, Jul 10, 2013 at 5:23 PM, Otis Gospodnetic <
> > otis.gospodnetic@gmail.com> wrote:
> >
> >> But, very importantly:
> >>
> >> CPU after changes: https://apps.sematext.com/spm/s/CpZ9aPhL9L
> >> Load after changes: https://apps.sematext.com/spm/s/i7f3x6MXdZ
> >>
> >> So in practical terms, use something like -XX:MaxGCPauseMillis=200
> >> -XX:NewRatio=4 to force short GC pauses, but count on having more of
> >> them and CPU sweating more. This gives you smaller pauses, no big STW
> >> pauses, but be prepared to pay in CPU cycles.
> >>
> >> HTH
> >>
> >> Otis
> >> --
> >> HBase Performance Monitoring -- http://sematext.com/spm
> >>
> >>
> >>
> >> On Wed, Jul 10, 2013 at 4:20 PM, Otis Gospodnetic
> >> <ot...@gmail.com> wrote:
> >> > Not big in this case - 1800m
> >> >
> >> > Otis
> >> > --
> >> > HBase Performance Monitoring -- http://sematext.com/spm
> >> >
> >> >
> >> >
> >> > On Wed, Jul 10, 2013 at 3:57 PM, Vladimir Rodionov
> >> > <vr...@carrieriq.com> wrote:
> >> >>
> >> >> What is -Xmx heap size?
> >> >>
> >> >> Best regards,
> >> >> Vladimir Rodionov
> >> >> Principal Platform Engineer
> >> >> Carrier IQ, www.carrieriq.com
> >> >> e-mail: vrodionov@carrieriq.com
> >> >>
> >> >> ________________________________________
> >> >> From: Otis Gospodnetic [otis.gospodnetic@gmail.com]
> >> >> Sent: Wednesday, July 10, 2013 12:00 PM
> >> >> To: user@hbase.apache.org
> >> >> Subject: G1 before/after GC time graph
> >> >>
> >> >> Hi,
> >> >>
> >> >> There was talk of G1 and HBase here over the past few days. I wanted
> >> >> to share a fresh and telling SPM graph showing G1 + some other params
> >> >> in action:
> >> >>
> >> >> Result first: https://apps.sematext.com/spm/s/wN0hKVixxX
> >> >>
> >> >> This is what we had before:
> >> >> -XX:+HeapDumpOnOutOfMemoryError -XX:+UseG1GC
> >> >> -XX:InitiatingHeapOccupancyPercent=35 -XX:G1ReservePercent=25
> >> >>
> >> >> And then we added:
> >> >> -XX:MaxGCPauseMillis=200 -XX:NewRatio=4
> >> >>
> >> >> I hope this helps.
> >> >>
> >> >> Otis
> >> >> --
> >> >> HBase Performance Monitoring -- http://sematext.com/spm
> >> >>
> >> >> Confidentiality Notice: The information contained in this message,
> >> including any attachments hereto, may be confidential and is intended
> to be
> >> read only by the individual or entity to whom this message is
> addressed. If
> >> the reader of this message is not the intended recipient or an agent or
> >> designee of the intended recipient, please note that any review, use,
> >> disclosure or distribution of this message or its attachments, in any
> form,
> >> is strictly prohibited. If you have received this message in error,
> please
> >> immediately notify the sender and/or Notifications@carrieriq.com and
> >> delete or destroy any copy of this message and its attachments.
> >>
> >
> >
> >
> > --
> > Kevin O'Dell
> > Systems Engineer, Cloudera
>
Re: G1 before/after GC time graph
Posted by Otis Gospodnetic <ot...@gmail.com>.
Hi,
Probably not any time in the near future. We could do it, plop SPM in
it and watch, but don't have time for it now.
If anyone wants to give it a shot and use SPM to capture various
JVM/HBase/server metrics, let me know if help around SPM is needed,
longer trials, or whatever.
Otis
--
HBase Performance Monitoring -- http://sematext.com/spm
On Wed, Jul 10, 2013 at 5:27 PM, Kevin O'dell <ke...@cloudera.com> wrote:
> Anyway you can test this with a 32GB heap? :)
>
>
> On Wed, Jul 10, 2013 at 5:23 PM, Otis Gospodnetic <
> otis.gospodnetic@gmail.com> wrote:
>
>> But, very importantly:
>>
>> CPU after changes: https://apps.sematext.com/spm/s/CpZ9aPhL9L
>> Load after changes: https://apps.sematext.com/spm/s/i7f3x6MXdZ
>>
>> So in practical terms, use something like -XX:MaxGCPauseMillis=200
>> -XX:NewRatio=4 to force short GC pauses, but count on having more of
>> them and CPU sweating more. This gives you smaller pauses, no big STW
>> pauses, but be prepared to pay in CPU cycles.
>>
>> HTH
>>
>> Otis
>> --
>> HBase Performance Monitoring -- http://sematext.com/spm
>>
>>
>>
>> On Wed, Jul 10, 2013 at 4:20 PM, Otis Gospodnetic
>> <ot...@gmail.com> wrote:
>> > Not big in this case - 1800m
>> >
>> > Otis
>> > --
>> > HBase Performance Monitoring -- http://sematext.com/spm
>> >
>> >
>> >
>> > On Wed, Jul 10, 2013 at 3:57 PM, Vladimir Rodionov
>> > <vr...@carrieriq.com> wrote:
>> >>
>> >> What is -Xmx heap size?
>> >>
>> >> Best regards,
>> >> Vladimir Rodionov
>> >> Principal Platform Engineer
>> >> Carrier IQ, www.carrieriq.com
>> >> e-mail: vrodionov@carrieriq.com
>> >>
>> >> ________________________________________
>> >> From: Otis Gospodnetic [otis.gospodnetic@gmail.com]
>> >> Sent: Wednesday, July 10, 2013 12:00 PM
>> >> To: user@hbase.apache.org
>> >> Subject: G1 before/after GC time graph
>> >>
>> >> Hi,
>> >>
>> >> There was talk of G1 and HBase here over the past few days. I wanted
>> >> to share a fresh and telling SPM graph showing G1 + some other params
>> >> in action:
>> >>
>> >> Result first: https://apps.sematext.com/spm/s/wN0hKVixxX
>> >>
>> >> This is what we had before:
>> >> -XX:+HeapDumpOnOutOfMemoryError -XX:+UseG1GC
>> >> -XX:InitiatingHeapOccupancyPercent=35 -XX:G1ReservePercent=25
>> >>
>> >> And then we added:
>> >> -XX:MaxGCPauseMillis=200 -XX:NewRatio=4
>> >>
>> >> I hope this helps.
>> >>
>> >> Otis
>> >> --
>> >> HBase Performance Monitoring -- http://sematext.com/spm
>> >>
>> >> Confidentiality Notice: The information contained in this message,
>> including any attachments hereto, may be confidential and is intended to be
>> read only by the individual or entity to whom this message is addressed. If
>> the reader of this message is not the intended recipient or an agent or
>> designee of the intended recipient, please note that any review, use,
>> disclosure or distribution of this message or its attachments, in any form,
>> is strictly prohibited. If you have received this message in error, please
>> immediately notify the sender and/or Notifications@carrieriq.com and
>> delete or destroy any copy of this message and its attachments.
>>
>
>
>
> --
> Kevin O'Dell
> Systems Engineer, Cloudera
Re: G1 before/after GC time graph
Posted by Kevin O'dell <ke...@cloudera.com>.
Anyway you can test this with a 32GB heap? :)
On Wed, Jul 10, 2013 at 5:23 PM, Otis Gospodnetic <
otis.gospodnetic@gmail.com> wrote:
> But, very importantly:
>
> CPU after changes: https://apps.sematext.com/spm/s/CpZ9aPhL9L
> Load after changes: https://apps.sematext.com/spm/s/i7f3x6MXdZ
>
> So in practical terms, use something like -XX:MaxGCPauseMillis=200
> -XX:NewRatio=4 to force short GC pauses, but count on having more of
> them and CPU sweating more. This gives you smaller pauses, no big STW
> pauses, but be prepared to pay in CPU cycles.
>
> HTH
>
> Otis
> --
> HBase Performance Monitoring -- http://sematext.com/spm
>
>
>
> On Wed, Jul 10, 2013 at 4:20 PM, Otis Gospodnetic
> <ot...@gmail.com> wrote:
> > Not big in this case - 1800m
> >
> > Otis
> > --
> > HBase Performance Monitoring -- http://sematext.com/spm
> >
> >
> >
> > On Wed, Jul 10, 2013 at 3:57 PM, Vladimir Rodionov
> > <vr...@carrieriq.com> wrote:
> >>
> >> What is -Xmx heap size?
> >>
> >> Best regards,
> >> Vladimir Rodionov
> >> Principal Platform Engineer
> >> Carrier IQ, www.carrieriq.com
> >> e-mail: vrodionov@carrieriq.com
> >>
> >> ________________________________________
> >> From: Otis Gospodnetic [otis.gospodnetic@gmail.com]
> >> Sent: Wednesday, July 10, 2013 12:00 PM
> >> To: user@hbase.apache.org
> >> Subject: G1 before/after GC time graph
> >>
> >> Hi,
> >>
> >> There was talk of G1 and HBase here over the past few days. I wanted
> >> to share a fresh and telling SPM graph showing G1 + some other params
> >> in action:
> >>
> >> Result first: https://apps.sematext.com/spm/s/wN0hKVixxX
> >>
> >> This is what we had before:
> >> -XX:+HeapDumpOnOutOfMemoryError -XX:+UseG1GC
> >> -XX:InitiatingHeapOccupancyPercent=35 -XX:G1ReservePercent=25
> >>
> >> And then we added:
> >> -XX:MaxGCPauseMillis=200 -XX:NewRatio=4
> >>
> >> I hope this helps.
> >>
> >> Otis
> >> --
> >> HBase Performance Monitoring -- http://sematext.com/spm
> >>
> >> Confidentiality Notice: The information contained in this message,
> including any attachments hereto, may be confidential and is intended to be
> read only by the individual or entity to whom this message is addressed. If
> the reader of this message is not the intended recipient or an agent or
> designee of the intended recipient, please note that any review, use,
> disclosure or distribution of this message or its attachments, in any form,
> is strictly prohibited. If you have received this message in error, please
> immediately notify the sender and/or Notifications@carrieriq.com and
> delete or destroy any copy of this message and its attachments.
>
--
Kevin O'Dell
Systems Engineer, Cloudera
Re: G1 before/after GC time graph
Posted by Otis Gospodnetic <ot...@gmail.com>.
But, very importantly:
CPU after changes: https://apps.sematext.com/spm/s/CpZ9aPhL9L
Load after changes: https://apps.sematext.com/spm/s/i7f3x6MXdZ
So in practical terms, use something like -XX:MaxGCPauseMillis=200
-XX:NewRatio=4 to force short GC pauses, but count on having more of
them and CPU sweating more. This gives you smaller pauses, no big STW
pauses, but be prepared to pay in CPU cycles.
HTH
Otis
--
HBase Performance Monitoring -- http://sematext.com/spm
On Wed, Jul 10, 2013 at 4:20 PM, Otis Gospodnetic
<ot...@gmail.com> wrote:
> Not big in this case - 1800m
>
> Otis
> --
> HBase Performance Monitoring -- http://sematext.com/spm
>
>
>
> On Wed, Jul 10, 2013 at 3:57 PM, Vladimir Rodionov
> <vr...@carrieriq.com> wrote:
>>
>> What is -Xmx heap size?
>>
>> Best regards,
>> Vladimir Rodionov
>> Principal Platform Engineer
>> Carrier IQ, www.carrieriq.com
>> e-mail: vrodionov@carrieriq.com
>>
>> ________________________________________
>> From: Otis Gospodnetic [otis.gospodnetic@gmail.com]
>> Sent: Wednesday, July 10, 2013 12:00 PM
>> To: user@hbase.apache.org
>> Subject: G1 before/after GC time graph
>>
>> Hi,
>>
>> There was talk of G1 and HBase here over the past few days. I wanted
>> to share a fresh and telling SPM graph showing G1 + some other params
>> in action:
>>
>> Result first: https://apps.sematext.com/spm/s/wN0hKVixxX
>>
>> This is what we had before:
>> -XX:+HeapDumpOnOutOfMemoryError -XX:+UseG1GC
>> -XX:InitiatingHeapOccupancyPercent=35 -XX:G1ReservePercent=25
>>
>> And then we added:
>> -XX:MaxGCPauseMillis=200 -XX:NewRatio=4
>>
>> I hope this helps.
>>
>> Otis
>> --
>> HBase Performance Monitoring -- http://sematext.com/spm
>>
>> Confidentiality Notice: The information contained in this message, including any attachments hereto, may be confidential and is intended to be read only by the individual or entity to whom this message is addressed. If the reader of this message is not the intended recipient or an agent or designee of the intended recipient, please note that any review, use, disclosure or distribution of this message or its attachments, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or Notifications@carrieriq.com and delete or destroy any copy of this message and its attachments.
Re: G1 before/after GC time graph
Posted by Otis Gospodnetic <ot...@gmail.com>.
Not big in this case - 1800m
Otis
--
HBase Performance Monitoring -- http://sematext.com/spm
On Wed, Jul 10, 2013 at 3:57 PM, Vladimir Rodionov
<vr...@carrieriq.com> wrote:
>
> What is -Xmx heap size?
>
> Best regards,
> Vladimir Rodionov
> Principal Platform Engineer
> Carrier IQ, www.carrieriq.com
> e-mail: vrodionov@carrieriq.com
>
> ________________________________________
> From: Otis Gospodnetic [otis.gospodnetic@gmail.com]
> Sent: Wednesday, July 10, 2013 12:00 PM
> To: user@hbase.apache.org
> Subject: G1 before/after GC time graph
>
> Hi,
>
> There was talk of G1 and HBase here over the past few days. I wanted
> to share a fresh and telling SPM graph showing G1 + some other params
> in action:
>
> Result first: https://apps.sematext.com/spm/s/wN0hKVixxX
>
> This is what we had before:
> -XX:+HeapDumpOnOutOfMemoryError -XX:+UseG1GC
> -XX:InitiatingHeapOccupancyPercent=35 -XX:G1ReservePercent=25
>
> And then we added:
> -XX:MaxGCPauseMillis=200 -XX:NewRatio=4
>
> I hope this helps.
>
> Otis
> --
> HBase Performance Monitoring -- http://sematext.com/spm
>
> Confidentiality Notice: The information contained in this message, including any attachments hereto, may be confidential and is intended to be read only by the individual or entity to whom this message is addressed. If the reader of this message is not the intended recipient or an agent or designee of the intended recipient, please note that any review, use, disclosure or distribution of this message or its attachments, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or Notifications@carrieriq.com and delete or destroy any copy of this message and its attachments.
RE: G1 before/after GC time graph
Posted by Vladimir Rodionov <vr...@carrieriq.com>.
What is -Xmx heap size?
Best regards,
Vladimir Rodionov
Principal Platform Engineer
Carrier IQ, www.carrieriq.com
e-mail: vrodionov@carrieriq.com
________________________________________
From: Otis Gospodnetic [otis.gospodnetic@gmail.com]
Sent: Wednesday, July 10, 2013 12:00 PM
To: user@hbase.apache.org
Subject: G1 before/after GC time graph
Hi,
There was talk of G1 and HBase here over the past few days. I wanted
to share a fresh and telling SPM graph showing G1 + some other params
in action:
Result first: https://apps.sematext.com/spm/s/wN0hKVixxX
This is what we had before:
-XX:+HeapDumpOnOutOfMemoryError -XX:+UseG1GC
-XX:InitiatingHeapOccupancyPercent=35 -XX:G1ReservePercent=25
And then we added:
-XX:MaxGCPauseMillis=200 -XX:NewRatio=4
I hope this helps.
Otis
--
HBase Performance Monitoring -- http://sematext.com/spm
Confidentiality Notice: The information contained in this message, including any attachments hereto, may be confidential and is intended to be read only by the individual or entity to whom this message is addressed. If the reader of this message is not the intended recipient or an agent or designee of the intended recipient, please note that any review, use, disclosure or distribution of this message or its attachments, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or Notifications@carrieriq.com and delete or destroy any copy of this message and its attachments.
Re: G1 before/after GC time graph
Posted by Elliott Clark <ec...@apache.org>.
Awesome. Thanks for the info it's really useful.
On Wed, Jul 10, 2013 at 12:00 PM, Otis Gospodnetic
<ot...@gmail.com> wrote:
> Hi,
>
> There was talk of G1 and HBase here over the past few days. I wanted
> to share a fresh and telling SPM graph showing G1 + some other params
> in action:
>
> Result first: https://apps.sematext.com/spm/s/wN0hKVixxX
>
> This is what we had before:
> -XX:+HeapDumpOnOutOfMemoryError -XX:+UseG1GC
> -XX:InitiatingHeapOccupancyPercent=35 -XX:G1ReservePercent=25
>
> And then we added:
> -XX:MaxGCPauseMillis=200 -XX:NewRatio=4
>
> I hope this helps.
>
> Otis
> --
> HBase Performance Monitoring -- http://sematext.com/spm
Re: G1 before/after GC time graph
Posted by Otis Gospodnetic <ot...@gmail.com>.
Sure, if I remember or if somebody follows up on this thread in N weeks.
Otis
--
HBase Performance Monitoring -- http://sematext.com/spm
On Wed, Jul 10, 2013 at 3:39 PM, Stack <st...@duboce.net> wrote:
> Thanks Otis. Helps. May we see a weeks-worth if (or when) it is available?
> St.Ack
>
>
> On Wed, Jul 10, 2013 at 12:00 PM, Otis Gospodnetic <
> otis.gospodnetic@gmail.com> wrote:
>
>> Hi,
>>
>> There was talk of G1 and HBase here over the past few days. I wanted
>> to share a fresh and telling SPM graph showing G1 + some other params
>> in action:
>>
>> Result first: https://apps.sematext.com/spm/s/wN0hKVixxX
>>
>> This is what we had before:
>> -XX:+HeapDumpOnOutOfMemoryError -XX:+UseG1GC
>> -XX:InitiatingHeapOccupancyPercent=35 -XX:G1ReservePercent=25
>>
>> And then we added:
>> -XX:MaxGCPauseMillis=200 -XX:NewRatio=4
>>
>> I hope this helps.
>>
>> Otis
>> --
>> HBase Performance Monitoring -- http://sematext.com/spm
>>
Re: G1 before/after GC time graph
Posted by Stack <st...@duboce.net>.
Thanks Otis. Helps. May we see a weeks-worth if (or when) it is available?
St.Ack
On Wed, Jul 10, 2013 at 12:00 PM, Otis Gospodnetic <
otis.gospodnetic@gmail.com> wrote:
> Hi,
>
> There was talk of G1 and HBase here over the past few days. I wanted
> to share a fresh and telling SPM graph showing G1 + some other params
> in action:
>
> Result first: https://apps.sematext.com/spm/s/wN0hKVixxX
>
> This is what we had before:
> -XX:+HeapDumpOnOutOfMemoryError -XX:+UseG1GC
> -XX:InitiatingHeapOccupancyPercent=35 -XX:G1ReservePercent=25
>
> And then we added:
> -XX:MaxGCPauseMillis=200 -XX:NewRatio=4
>
> I hope this helps.
>
> Otis
> --
> HBase Performance Monitoring -- http://sematext.com/spm
>