You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Lars George <la...@gmail.com> on 2012/06/15 10:07:41 UTC
Metrics in 0.96
Hi,
I propose that we clean up the metrics for 0.96 as well (if that is not already underway. This includes switching to Hadoop Metrics v2 and adding all missing stats, as well as fixing those that are misleading or useless. For that reason I talked to our friends at Sematext during the Buzzwords HBase workshop, as well as to our internal HBase team. We all seem to agree and I'd be happy to setup some sort of call/task force to discuss what we need to work on etc. Obviously I would love for someone from the FB team to also partake as they have done heaps lately on that end - but I also understand if that is a timing issue.
What do y'all think? My reasoning is that 0.96 might become 1.0, but I would love for the metrics to be stable by then.
Cheers,
Lars
Re: Metrics in 0.96
Posted by Dave Wang <ds...@cloudera.com>.
I'm willing to contribute whatever time I can to help out.
- Dave
On Fri, Jun 15, 2012 at 4:47 PM, Enis Söztutar <en...@hortonworks.com> wrote:
> Big +1.
>
> We also need to rename some of the metrics to be consistent in naming, and
> make some it more configurable (like enable/disable per-region / per-schema
> metrics, etc)
>
> See: https://issues.apache.org/jira/browse/HBASE-5601.
>
> Enis
>
> On Fri, Jun 15, 2012 at 3:01 PM, Stack <st...@duboce.net> wrote:
>
> > On Fri, Jun 15, 2012 at 10:04 AM, Elliott Clark <ec...@stumbleupon.com>
> > wrote:
> > > Right now they are very similar to
> > > RegionServerMetrics/RegionServerStatistics and seems like there is a
> lot
> > of
> > > overlap.
> > >
> >
> > This would be really great Elliott. You'd package the metrics into
> > the region server report? protobuf it? Then these would go into
> > ClusterStatus in master? Good one.
> >
> > St.Ack
> >
>
Re: Metrics in 0.96
Posted by Lars George <la...@gmail.com>.
Hi Enis,
Hecks yeah, there are so many different prefixes alone that make finding what you need nearly impossible without practice. I agree on the configurable metrics backend, that will allow to enable what is needed optionally. We just have to find a good approach. One of the things that FB has learned the "hard" way is that some metrics at scale are not sustainable. We could, even think about building in some reasonable heuristics to disable some high throughput metrics when a threshold is crossed.
Lars
On Jun 16, 2012, at 1:47, Enis Söztutar <en...@hortonworks.com> wrote:
> Big +1.
>
> We also need to rename some of the metrics to be consistent in naming, and
> make some it more configurable (like enable/disable per-region / per-schema
> metrics, etc)
>
> See: https://issues.apache.org/jira/browse/HBASE-5601.
>
> Enis
>
> On Fri, Jun 15, 2012 at 3:01 PM, Stack <st...@duboce.net> wrote:
>
>> On Fri, Jun 15, 2012 at 10:04 AM, Elliott Clark <ec...@stumbleupon.com>
>> wrote:
>>> Right now they are very similar to
>>> RegionServerMetrics/RegionServerStatistics and seems like there is a lot
>> of
>>> overlap.
>>>
>>
>> This would be really great Elliott. You'd package the metrics into
>> the region server report? protobuf it? Then these would go into
>> ClusterStatus in master? Good one.
>>
>> St.Ack
>>
Re: Metrics in 0.96
Posted by Enis Söztutar <en...@hortonworks.com>.
Big +1.
We also need to rename some of the metrics to be consistent in naming, and
make some it more configurable (like enable/disable per-region / per-schema
metrics, etc)
See: https://issues.apache.org/jira/browse/HBASE-5601.
Enis
On Fri, Jun 15, 2012 at 3:01 PM, Stack <st...@duboce.net> wrote:
> On Fri, Jun 15, 2012 at 10:04 AM, Elliott Clark <ec...@stumbleupon.com>
> wrote:
> > Right now they are very similar to
> > RegionServerMetrics/RegionServerStatistics and seems like there is a lot
> of
> > overlap.
> >
>
> This would be really great Elliott. You'd package the metrics into
> the region server report? protobuf it? Then these would go into
> ClusterStatus in master? Good one.
>
> St.Ack
>
Re: Metrics in 0.96
Posted by Stack <st...@duboce.net>.
On Fri, Jun 15, 2012 at 10:04 AM, Elliott Clark <ec...@stumbleupon.com> wrote:
> Right now they are very similar to
> RegionServerMetrics/RegionServerStatistics and seems like there is a lot of
> overlap.
>
This would be really great Elliott. You'd package the metrics into
the region server report? protobuf it? Then these would go into
ClusterStatus in master? Good one.
St.Ack
Re: Metrics in 0.96
Posted by Elliott Clark <ec...@stumbleupon.com>.
Sounds great.
I also think we should start moving away from just averages, and move
towards using the histograms. Right now the histograms are broken, they
don't get exported into jmx but I've got a fix I think (HBASE-6211). I
would also like to look into tying Server/Region Load in with metrics.
Right now they are very similar to
RegionServerMetrics/RegionServerStatistics and seems like there is a lot of
overlap.
On Fri, Jun 15, 2012 at 8:54 AM, Lars George <la...@gmail.com> wrote:
> Hi Andy,
>
> Yes, that is exactly the plan. I am sure we have areas where we simply
> lack metrics, I have noted this down somewhere and will dig up the details.
> It would also consolidate (and close out) all open "Improve HBase Metrics"
> JIRAs.
>
> Lars
>
> On Jun 15, 2012, at 5:41 PM, Andrew Purtell wrote:
>
> > +1
> >
> > And at the same time IMHO it's worth asking if we have everything
> covered with a meaningful metric, and add if missing, as well as remove
> those not useful.
> >
> > Metrics2 is in Hadoop core 1 and 2. There was a backport into 1 at some
> point but the latest (1.0.3) has it for sure.
> >
> > - Andy
> >
> > On Jun 15, 2012, at 8:07 AM, Stack <st...@duboce.net> wrote:
> >
> >> On Fri, Jun 15, 2012 at 1:07 AM, Lars George <la...@gmail.com>
> wrote:
> >>> Hi,
> >>>
> >>> I propose that we clean up the metrics for 0.96 as well (if that is
> not already underway. This includes switching to Hadoop Metrics v2 and
> adding all missing stats, as well as fixing those that are misleading or
> useless. For that reason I talked to our friends at Sematext during the
> Buzzwords HBase workshop, as well as to our internal HBase team. We all
> seem to agree and I'd be happy to setup some sort of call/task force to
> discuss what we need to work on etc. Obviously I would love for someone
> from the FB team to also partake as they have done heaps lately on that end
> - but I also understand if that is a timing issue.
> >>>
> >>> What do y'all think? My reasoning is that 0.96 might become 1.0, but I
> would love for the metrics to be stable by then.
> >>>
> >>
> >> +1 and +1 on you being Ring Master (tell us what to do!)
> >>
> >> Some metrics are near useless.
> >>
> >> Metrics2 is in hadoop 1.0.x? 0.96.0 will require 1.0.x so that should
> be fine.
> >> St.Ack
>
>
Re: Metrics in 0.96
Posted by Lars George <la...@gmail.com>.
Hi Andy,
Yes, that is exactly the plan. I am sure we have areas where we simply lack metrics, I have noted this down somewhere and will dig up the details. It would also consolidate (and close out) all open "Improve HBase Metrics" JIRAs.
Lars
On Jun 15, 2012, at 5:41 PM, Andrew Purtell wrote:
> +1
>
> And at the same time IMHO it's worth asking if we have everything covered with a meaningful metric, and add if missing, as well as remove those not useful.
>
> Metrics2 is in Hadoop core 1 and 2. There was a backport into 1 at some point but the latest (1.0.3) has it for sure.
>
> - Andy
>
> On Jun 15, 2012, at 8:07 AM, Stack <st...@duboce.net> wrote:
>
>> On Fri, Jun 15, 2012 at 1:07 AM, Lars George <la...@gmail.com> wrote:
>>> Hi,
>>>
>>> I propose that we clean up the metrics for 0.96 as well (if that is not already underway. This includes switching to Hadoop Metrics v2 and adding all missing stats, as well as fixing those that are misleading or useless. For that reason I talked to our friends at Sematext during the Buzzwords HBase workshop, as well as to our internal HBase team. We all seem to agree and I'd be happy to setup some sort of call/task force to discuss what we need to work on etc. Obviously I would love for someone from the FB team to also partake as they have done heaps lately on that end - but I also understand if that is a timing issue.
>>>
>>> What do y'all think? My reasoning is that 0.96 might become 1.0, but I would love for the metrics to be stable by then.
>>>
>>
>> +1 and +1 on you being Ring Master (tell us what to do!)
>>
>> Some metrics are near useless.
>>
>> Metrics2 is in hadoop 1.0.x? 0.96.0 will require 1.0.x so that should be fine.
>> St.Ack
Re: Metrics in 0.96
Posted by Andrew Purtell <an...@gmail.com>.
+1
And at the same time IMHO it's worth asking if we have everything covered with a meaningful metric, and add if missing, as well as remove those not useful.
Metrics2 is in Hadoop core 1 and 2. There was a backport into 1 at some point but the latest (1.0.3) has it for sure.
- Andy
On Jun 15, 2012, at 8:07 AM, Stack <st...@duboce.net> wrote:
> On Fri, Jun 15, 2012 at 1:07 AM, Lars George <la...@gmail.com> wrote:
>> Hi,
>>
>> I propose that we clean up the metrics for 0.96 as well (if that is not already underway. This includes switching to Hadoop Metrics v2 and adding all missing stats, as well as fixing those that are misleading or useless. For that reason I talked to our friends at Sematext during the Buzzwords HBase workshop, as well as to our internal HBase team. We all seem to agree and I'd be happy to setup some sort of call/task force to discuss what we need to work on etc. Obviously I would love for someone from the FB team to also partake as they have done heaps lately on that end - but I also understand if that is a timing issue.
>>
>> What do y'all think? My reasoning is that 0.96 might become 1.0, but I would love for the metrics to be stable by then.
>>
>
> +1 and +1 on you being Ring Master (tell us what to do!)
>
> Some metrics are near useless.
>
> Metrics2 is in hadoop 1.0.x? 0.96.0 will require 1.0.x so that should be fine.
> St.Ack
Re: Metrics in 0.96
Posted by Stack <st...@duboce.net>.
On Fri, Jun 15, 2012 at 1:07 AM, Lars George <la...@gmail.com> wrote:
> Hi,
>
> I propose that we clean up the metrics for 0.96 as well (if that is not already underway. This includes switching to Hadoop Metrics v2 and adding all missing stats, as well as fixing those that are misleading or useless. For that reason I talked to our friends at Sematext during the Buzzwords HBase workshop, as well as to our internal HBase team. We all seem to agree and I'd be happy to setup some sort of call/task force to discuss what we need to work on etc. Obviously I would love for someone from the FB team to also partake as they have done heaps lately on that end - but I also understand if that is a timing issue.
>
> What do y'all think? My reasoning is that 0.96 might become 1.0, but I would love for the metrics to be stable by then.
>
+1 and +1 on you being Ring Master (tell us what to do!)
Some metrics are near useless.
Metrics2 is in hadoop 1.0.x? 0.96.0 will require 1.0.x so that should be fine.
St.Ack
Re: Metrics in 0.96
Posted by Andrew Wang <an...@cloudera.com>.
I think Elliot's concern with the histogram improvements is that if it goes
in hadoop-common, HBase is only going to get it after it gets rolled into a
new hadoop-common release and HBase bumps the version on the hadoop-common
dependency. I don't think this is so bad.
For now though, I'm willing to maintain an HBase patchset against this
future improved hadoop-common until it's actually released.
Thanks,
Andrew
On Fri, Jun 29, 2012 at 5:31 PM, Andrew Purtell <an...@gmail.com>wrote:
> Metrics2 is in both Hadoop 1 and 2. (?)
>
> But my thing was the latter point below anyhow.
>
> On Jun 29, 2012, at 1:53 PM, Elliott Clark <ec...@stumbleupon.com> wrote:
>
> > I'm excited about the new accurate histogram, however I don't think that
> > we'll get it when we move to metrics2. Any direct usage would break
> > backward compat for all older hadoop installs.
> > For backwards compatibility on hadoop versions we will either have to
> > create a shim layer with reflection, or pull the code in. Since we
> already
> > have a MeticsHistogram I think pulling the code into hbase may be the
> right
> > choice.
> >
> > On Fri, Jun 29, 2012 at 1:15 PM, Andrew Purtell <ap...@apache.org>
> wrote:
> >
> >> On Fri, Jun 29, 2012 at 1:10 PM, Alex Baranau <alex.baranov.v@gmail.com
> >
> >> wrote:
> >>> Meanwhile I suggested taking on this one:
> >>> https://issues.apache.org/jira/browse/HBASE-4050 separately/first.
> What
> >> do
> >>> you think?
> >>
> >> +1
> >>
> >> In related discussion, it looks to me like Stack thinks pulling in the
> >> histogram accuracy improvement work via metrics2 is a good idea.
> >>
> >> Independent of this something I would like to be able to do is log
> >> metrics to a file as well as Ganglia concurrently, and metrics2 can do
> >> that.
> >>
> >>
> >> Best regards,
> >>
> >> - Andy
> >>
> >> Problems worthy of attack prove their worth by hitting back. - Piet
> >> Hein (via Tom White)
> >>
>
Re: Metrics in 0.96
Posted by Andrew Purtell <an...@gmail.com>.
Metrics2 is in both Hadoop 1 and 2. (?)
But my thing was the latter point below anyhow.
On Jun 29, 2012, at 1:53 PM, Elliott Clark <ec...@stumbleupon.com> wrote:
> I'm excited about the new accurate histogram, however I don't think that
> we'll get it when we move to metrics2. Any direct usage would break
> backward compat for all older hadoop installs.
> For backwards compatibility on hadoop versions we will either have to
> create a shim layer with reflection, or pull the code in. Since we already
> have a MeticsHistogram I think pulling the code into hbase may be the right
> choice.
>
> On Fri, Jun 29, 2012 at 1:15 PM, Andrew Purtell <ap...@apache.org> wrote:
>
>> On Fri, Jun 29, 2012 at 1:10 PM, Alex Baranau <al...@gmail.com>
>> wrote:
>>> Meanwhile I suggested taking on this one:
>>> https://issues.apache.org/jira/browse/HBASE-4050 separately/first. What
>> do
>>> you think?
>>
>> +1
>>
>> In related discussion, it looks to me like Stack thinks pulling in the
>> histogram accuracy improvement work via metrics2 is a good idea.
>>
>> Independent of this something I would like to be able to do is log
>> metrics to a file as well as Ganglia concurrently, and metrics2 can do
>> that.
>>
>>
>> Best regards,
>>
>> - Andy
>>
>> Problems worthy of attack prove their worth by hitting back. - Piet
>> Hein (via Tom White)
>>
Re: Metrics in 0.96
Posted by Ted Yu <yu...@gmail.com>.
I suggest continuing discussion on HBASE-4050.
Cheers
On Fri, Jun 29, 2012 at 1:53 PM, Elliott Clark <ec...@stumbleupon.com>wrote:
> I'm excited about the new accurate histogram, however I don't think that
> we'll get it when we move to metrics2. Any direct usage would break
> backward compat for all older hadoop installs.
> For backwards compatibility on hadoop versions we will either have to
> create a shim layer with reflection, or pull the code in. Since we already
> have a MeticsHistogram I think pulling the code into hbase may be the right
> choice.
>
> On Fri, Jun 29, 2012 at 1:15 PM, Andrew Purtell <ap...@apache.org>
> wrote:
>
> > On Fri, Jun 29, 2012 at 1:10 PM, Alex Baranau <al...@gmail.com>
> > wrote:
> > > Meanwhile I suggested taking on this one:
> > > https://issues.apache.org/jira/browse/HBASE-4050 separately/first.
> What
> > do
> > > you think?
> >
> > +1
> >
> > In related discussion, it looks to me like Stack thinks pulling in the
> > histogram accuracy improvement work via metrics2 is a good idea.
> >
> > Independent of this something I would like to be able to do is log
> > metrics to a file as well as Ganglia concurrently, and metrics2 can do
> > that.
> >
> >
> > Best regards,
> >
> > - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet
> > Hein (via Tom White)
> >
>
Re: Metrics in 0.96
Posted by Elliott Clark <ec...@stumbleupon.com>.
I'm excited about the new accurate histogram, however I don't think that
we'll get it when we move to metrics2. Any direct usage would break
backward compat for all older hadoop installs.
For backwards compatibility on hadoop versions we will either have to
create a shim layer with reflection, or pull the code in. Since we already
have a MeticsHistogram I think pulling the code into hbase may be the right
choice.
On Fri, Jun 29, 2012 at 1:15 PM, Andrew Purtell <ap...@apache.org> wrote:
> On Fri, Jun 29, 2012 at 1:10 PM, Alex Baranau <al...@gmail.com>
> wrote:
> > Meanwhile I suggested taking on this one:
> > https://issues.apache.org/jira/browse/HBASE-4050 separately/first. What
> do
> > you think?
>
> +1
>
> In related discussion, it looks to me like Stack thinks pulling in the
> histogram accuracy improvement work via metrics2 is a good idea.
>
> Independent of this something I would like to be able to do is log
> metrics to a file as well as Ganglia concurrently, and metrics2 can do
> that.
>
>
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet
> Hein (via Tom White)
>
Re: Metrics in 0.96
Posted by Andrew Purtell <ap...@apache.org>.
On Fri, Jun 29, 2012 at 1:10 PM, Alex Baranau <al...@gmail.com> wrote:
> Meanwhile I suggested taking on this one:
> https://issues.apache.org/jira/browse/HBASE-4050 separately/first. What do
> you think?
+1
In related discussion, it looks to me like Stack thinks pulling in the
histogram accuracy improvement work via metrics2 is a good idea.
Independent of this something I would like to be able to do is log
metrics to a file as well as Ganglia concurrently, and metrics2 can do
that.
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet
Hein (via Tom White)
Re: Metrics in 0.96
Posted by Alex Baranau <al...@gmail.com>.
Meanwhile I suggested taking on this one:
https://issues.apache.org/jira/browse/HBASE-4050 separately/first. What do
you think?
Alex
On Fri, Jun 29, 2012 at 1:21 PM, Lars George <la...@gmail.com> wrote:
> Hi Alex,
>
> Not yet, I fell short in my effort of ready all of the open and recently
> completed metrics related JIRAs. But I will finish it over the weekend and
> create the issue, if that is OK?
>
> Lars
>
> On Jun 29, 2012, at 7:06 PM, Alex Baranau wrote:
>
> > Hi Lars,
> >
> > Any chance you created umbrella jira for that?
> >
> > Thank you,
> > Alex
> >
> > On Sat, Jun 23, 2012 at 3:10 AM, Lars George <la...@gmail.com>
> wrote:
> >
> >> Hi Greg,
> >>
> >> I am going through all related JIRAs right now so that we can
> consolidate
> >> the effort into one umbrella issue. I should have that done today and
> will
> >> then list my findings.
> >>
> >> Lars
> >>
> >> On Jun 23, 2012, at 2:23, Gregory Chanan <gc...@cloudera.com> wrote:
> >>
> >>> Do we have an umbrella JIRA for this? Seems like there is a lot of
> work
> >> to
> >>> be done on this and it would help to have one similar to HBASE-5305 for
> >> the
> >>> version compatibility stuff. We can link HBASE-5601 off it to start.
> >>>
> >>> If not, I can create one.
> >>>
> >>> Greg
> >>> On Tue, Jun 19, 2012 at 9:03 AM, Elliott Clark <eclark@stumbleupon.com
> >>> wrote:
> >>>
> >>>> I'm up for that too. Just let me know and I'll be there. I've been
> >> poking
> >>>> around with metrics a lot lately and so I have a few ideas.
> >>>>
> >>>> On Mon, Jun 18, 2012 at 3:45 PM, Otis Gospodnetic <
> >>>> otis_gospodnetic@yahoo.com> wrote:
> >>>>
> >>>>> Lars & Co.,
> >>>>>
> >>>>> We're game for a chat (Skype voice, chat, phone...) maybe around the
> >>>>> middle of next week. Alex is currently busy chasing fish in the
> >>>> Caribbean.
> >>>>>
> >>>>> Otis
> >>>>> ----
> >>>>> Performance Monitoring for Solr / ElasticSearch / HBase -
> >>>>> http://sematext.com/spm
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>> ----- Original Message -----
> >>>>>> From: Lars George <la...@gmail.com>
> >>>>>> To: dev@hbase.apache.org
> >>>>>> Cc:
> >>>>>> Sent: Friday, June 15, 2012 4:07 AM
> >>>>>> Subject: Metrics in 0.96
> >>>>>>
> >>>>>> Hi,
> >>>>>>
> >>>>>> I propose that we clean up the metrics for 0.96 as well (if that is
> >> not
> >>>>> already
> >>>>>> underway. This includes switching to Hadoop Metrics v2 and adding
> all
> >>>>> missing
> >>>>>> stats, as well as fixing those that are misleading or useless. For
> >> that
> >>>>> reason I
> >>>>>> talked to our friends at Sematext during the Buzzwords HBase
> workshop,
> >>>>> as well
> >>>>>> as to our internal HBase team. We all seem to agree and I'd be happy
> >> to
> >>>>>> setup some sort of call/task force to discuss what we need to work
> on
> >>>>> etc.
> >>>>>> Obviously I would love for someone from the FB team to also partake
> as
> >>>>> they have
> >>>>>> done heaps lately on that end - but I also understand if that is a
> >>>>> timing issue.
> >>>>>>
> >>>>>> What do y'all think? My reasoning is that 0.96 might become 1.0,
> but I
> >>>>> would
> >>>>>> love for the metrics to be stable by then.
> >>>>>>
> >>>>>> Cheers,
> >>>>>> Lars
> >>>>>>
> >>>>>
> >>>>
> >>
>
>
Re: Metrics in 0.96
Posted by Lars George <la...@gmail.com>.
Hi Alex,
Not yet, I fell short in my effort of ready all of the open and recently completed metrics related JIRAs. But I will finish it over the weekend and create the issue, if that is OK?
Lars
On Jun 29, 2012, at 7:06 PM, Alex Baranau wrote:
> Hi Lars,
>
> Any chance you created umbrella jira for that?
>
> Thank you,
> Alex
>
> On Sat, Jun 23, 2012 at 3:10 AM, Lars George <la...@gmail.com> wrote:
>
>> Hi Greg,
>>
>> I am going through all related JIRAs right now so that we can consolidate
>> the effort into one umbrella issue. I should have that done today and will
>> then list my findings.
>>
>> Lars
>>
>> On Jun 23, 2012, at 2:23, Gregory Chanan <gc...@cloudera.com> wrote:
>>
>>> Do we have an umbrella JIRA for this? Seems like there is a lot of work
>> to
>>> be done on this and it would help to have one similar to HBASE-5305 for
>> the
>>> version compatibility stuff. We can link HBASE-5601 off it to start.
>>>
>>> If not, I can create one.
>>>
>>> Greg
>>> On Tue, Jun 19, 2012 at 9:03 AM, Elliott Clark <eclark@stumbleupon.com
>>> wrote:
>>>
>>>> I'm up for that too. Just let me know and I'll be there. I've been
>> poking
>>>> around with metrics a lot lately and so I have a few ideas.
>>>>
>>>> On Mon, Jun 18, 2012 at 3:45 PM, Otis Gospodnetic <
>>>> otis_gospodnetic@yahoo.com> wrote:
>>>>
>>>>> Lars & Co.,
>>>>>
>>>>> We're game for a chat (Skype voice, chat, phone...) maybe around the
>>>>> middle of next week. Alex is currently busy chasing fish in the
>>>> Caribbean.
>>>>>
>>>>> Otis
>>>>> ----
>>>>> Performance Monitoring for Solr / ElasticSearch / HBase -
>>>>> http://sematext.com/spm
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ----- Original Message -----
>>>>>> From: Lars George <la...@gmail.com>
>>>>>> To: dev@hbase.apache.org
>>>>>> Cc:
>>>>>> Sent: Friday, June 15, 2012 4:07 AM
>>>>>> Subject: Metrics in 0.96
>>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I propose that we clean up the metrics for 0.96 as well (if that is
>> not
>>>>> already
>>>>>> underway. This includes switching to Hadoop Metrics v2 and adding all
>>>>> missing
>>>>>> stats, as well as fixing those that are misleading or useless. For
>> that
>>>>> reason I
>>>>>> talked to our friends at Sematext during the Buzzwords HBase workshop,
>>>>> as well
>>>>>> as to our internal HBase team. We all seem to agree and I'd be happy
>> to
>>>>>> setup some sort of call/task force to discuss what we need to work on
>>>>> etc.
>>>>>> Obviously I would love for someone from the FB team to also partake as
>>>>> they have
>>>>>> done heaps lately on that end - but I also understand if that is a
>>>>> timing issue.
>>>>>>
>>>>>> What do y'all think? My reasoning is that 0.96 might become 1.0, but I
>>>>> would
>>>>>> love for the metrics to be stable by then.
>>>>>>
>>>>>> Cheers,
>>>>>> Lars
>>>>>>
>>>>>
>>>>
>>
Re: Metrics in 0.96
Posted by Alex Baranau <al...@gmail.com>.
Hi Lars,
Any chance you created umbrella jira for that?
Thank you,
Alex
On Sat, Jun 23, 2012 at 3:10 AM, Lars George <la...@gmail.com> wrote:
> Hi Greg,
>
> I am going through all related JIRAs right now so that we can consolidate
> the effort into one umbrella issue. I should have that done today and will
> then list my findings.
>
> Lars
>
> On Jun 23, 2012, at 2:23, Gregory Chanan <gc...@cloudera.com> wrote:
>
> > Do we have an umbrella JIRA for this? Seems like there is a lot of work
> to
> > be done on this and it would help to have one similar to HBASE-5305 for
> the
> > version compatibility stuff. We can link HBASE-5601 off it to start.
> >
> > If not, I can create one.
> >
> > Greg
> > On Tue, Jun 19, 2012 at 9:03 AM, Elliott Clark <eclark@stumbleupon.com
> >wrote:
> >
> >> I'm up for that too. Just let me know and I'll be there. I've been
> poking
> >> around with metrics a lot lately and so I have a few ideas.
> >>
> >> On Mon, Jun 18, 2012 at 3:45 PM, Otis Gospodnetic <
> >> otis_gospodnetic@yahoo.com> wrote:
> >>
> >>> Lars & Co.,
> >>>
> >>> We're game for a chat (Skype voice, chat, phone...) maybe around the
> >>> middle of next week. Alex is currently busy chasing fish in the
> >> Caribbean.
> >>>
> >>> Otis
> >>> ----
> >>> Performance Monitoring for Solr / ElasticSearch / HBase -
> >>> http://sematext.com/spm
> >>>
> >>>
> >>>
> >>>
> >>> ----- Original Message -----
> >>>> From: Lars George <la...@gmail.com>
> >>>> To: dev@hbase.apache.org
> >>>> Cc:
> >>>> Sent: Friday, June 15, 2012 4:07 AM
> >>>> Subject: Metrics in 0.96
> >>>>
> >>>> Hi,
> >>>>
> >>>> I propose that we clean up the metrics for 0.96 as well (if that is
> not
> >>> already
> >>>> underway. This includes switching to Hadoop Metrics v2 and adding all
> >>> missing
> >>>> stats, as well as fixing those that are misleading or useless. For
> that
> >>> reason I
> >>>> talked to our friends at Sematext during the Buzzwords HBase workshop,
> >>> as well
> >>>> as to our internal HBase team. We all seem to agree and I'd be happy
> to
> >>>> setup some sort of call/task force to discuss what we need to work on
> >>> etc.
> >>>> Obviously I would love for someone from the FB team to also partake as
> >>> they have
> >>>> done heaps lately on that end - but I also understand if that is a
> >>> timing issue.
> >>>>
> >>>> What do y'all think? My reasoning is that 0.96 might become 1.0, but I
> >>> would
> >>>> love for the metrics to be stable by then.
> >>>>
> >>>> Cheers,
> >>>> Lars
> >>>>
> >>>
> >>
>
Re: Metrics in 0.96
Posted by Lars George <la...@gmail.com>.
Hi Greg,
I am going through all related JIRAs right now so that we can consolidate the effort into one umbrella issue. I should have that done today and will then list my findings.
Lars
On Jun 23, 2012, at 2:23, Gregory Chanan <gc...@cloudera.com> wrote:
> Do we have an umbrella JIRA for this? Seems like there is a lot of work to
> be done on this and it would help to have one similar to HBASE-5305 for the
> version compatibility stuff. We can link HBASE-5601 off it to start.
>
> If not, I can create one.
>
> Greg
> On Tue, Jun 19, 2012 at 9:03 AM, Elliott Clark <ec...@stumbleupon.com>wrote:
>
>> I'm up for that too. Just let me know and I'll be there. I've been poking
>> around with metrics a lot lately and so I have a few ideas.
>>
>> On Mon, Jun 18, 2012 at 3:45 PM, Otis Gospodnetic <
>> otis_gospodnetic@yahoo.com> wrote:
>>
>>> Lars & Co.,
>>>
>>> We're game for a chat (Skype voice, chat, phone...) maybe around the
>>> middle of next week. Alex is currently busy chasing fish in the
>> Caribbean.
>>>
>>> Otis
>>> ----
>>> Performance Monitoring for Solr / ElasticSearch / HBase -
>>> http://sematext.com/spm
>>>
>>>
>>>
>>>
>>> ----- Original Message -----
>>>> From: Lars George <la...@gmail.com>
>>>> To: dev@hbase.apache.org
>>>> Cc:
>>>> Sent: Friday, June 15, 2012 4:07 AM
>>>> Subject: Metrics in 0.96
>>>>
>>>> Hi,
>>>>
>>>> I propose that we clean up the metrics for 0.96 as well (if that is not
>>> already
>>>> underway. This includes switching to Hadoop Metrics v2 and adding all
>>> missing
>>>> stats, as well as fixing those that are misleading or useless. For that
>>> reason I
>>>> talked to our friends at Sematext during the Buzzwords HBase workshop,
>>> as well
>>>> as to our internal HBase team. We all seem to agree and I'd be happy to
>>>> setup some sort of call/task force to discuss what we need to work on
>>> etc.
>>>> Obviously I would love for someone from the FB team to also partake as
>>> they have
>>>> done heaps lately on that end - but I also understand if that is a
>>> timing issue.
>>>>
>>>> What do y'all think? My reasoning is that 0.96 might become 1.0, but I
>>> would
>>>> love for the metrics to be stable by then.
>>>>
>>>> Cheers,
>>>> Lars
>>>>
>>>
>>
Re: Metrics in 0.96
Posted by Gregory Chanan <gc...@cloudera.com>.
Do we have an umbrella JIRA for this? Seems like there is a lot of work to
be done on this and it would help to have one similar to HBASE-5305 for the
version compatibility stuff. We can link HBASE-5601 off it to start.
If not, I can create one.
Greg
On Tue, Jun 19, 2012 at 9:03 AM, Elliott Clark <ec...@stumbleupon.com>wrote:
> I'm up for that too. Just let me know and I'll be there. I've been poking
> around with metrics a lot lately and so I have a few ideas.
>
> On Mon, Jun 18, 2012 at 3:45 PM, Otis Gospodnetic <
> otis_gospodnetic@yahoo.com> wrote:
>
> > Lars & Co.,
> >
> > We're game for a chat (Skype voice, chat, phone...) maybe around the
> > middle of next week. Alex is currently busy chasing fish in the
> Caribbean.
> >
> > Otis
> > ----
> > Performance Monitoring for Solr / ElasticSearch / HBase -
> > http://sematext.com/spm
> >
> >
> >
> >
> > ----- Original Message -----
> > > From: Lars George <la...@gmail.com>
> > > To: dev@hbase.apache.org
> > > Cc:
> > > Sent: Friday, June 15, 2012 4:07 AM
> > > Subject: Metrics in 0.96
> > >
> > > Hi,
> > >
> > > I propose that we clean up the metrics for 0.96 as well (if that is not
> > already
> > > underway. This includes switching to Hadoop Metrics v2 and adding all
> > missing
> > > stats, as well as fixing those that are misleading or useless. For that
> > reason I
> > > talked to our friends at Sematext during the Buzzwords HBase workshop,
> > as well
> > > as to our internal HBase team. We all seem to agree and I'd be happy to
> > > setup some sort of call/task force to discuss what we need to work on
> > etc.
> > > Obviously I would love for someone from the FB team to also partake as
> > they have
> > > done heaps lately on that end - but I also understand if that is a
> > timing issue.
> > >
> > > What do y'all think? My reasoning is that 0.96 might become 1.0, but I
> > would
> > > love for the metrics to be stable by then.
> > >
> > > Cheers,
> > > Lars
> > >
> >
>
Re: Metrics in 0.96
Posted by Elliott Clark <ec...@stumbleupon.com>.
I'm up for that too. Just let me know and I'll be there. I've been poking
around with metrics a lot lately and so I have a few ideas.
On Mon, Jun 18, 2012 at 3:45 PM, Otis Gospodnetic <
otis_gospodnetic@yahoo.com> wrote:
> Lars & Co.,
>
> We're game for a chat (Skype voice, chat, phone...) maybe around the
> middle of next week. Alex is currently busy chasing fish in the Caribbean.
>
> Otis
> ----
> Performance Monitoring for Solr / ElasticSearch / HBase -
> http://sematext.com/spm
>
>
>
>
> ----- Original Message -----
> > From: Lars George <la...@gmail.com>
> > To: dev@hbase.apache.org
> > Cc:
> > Sent: Friday, June 15, 2012 4:07 AM
> > Subject: Metrics in 0.96
> >
> > Hi,
> >
> > I propose that we clean up the metrics for 0.96 as well (if that is not
> already
> > underway. This includes switching to Hadoop Metrics v2 and adding all
> missing
> > stats, as well as fixing those that are misleading or useless. For that
> reason I
> > talked to our friends at Sematext during the Buzzwords HBase workshop,
> as well
> > as to our internal HBase team. We all seem to agree and I'd be happy to
> > setup some sort of call/task force to discuss what we need to work on
> etc.
> > Obviously I would love for someone from the FB team to also partake as
> they have
> > done heaps lately on that end - but I also understand if that is a
> timing issue.
> >
> > What do y'all think? My reasoning is that 0.96 might become 1.0, but I
> would
> > love for the metrics to be stable by then.
> >
> > Cheers,
> > Lars
> >
>
Re: Metrics in 0.96
Posted by Otis Gospodnetic <ot...@yahoo.com>.
Lars & Co.,
We're game for a chat (Skype voice, chat, phone...) maybe around the middle of next week. Alex is currently busy chasing fish in the Caribbean.
Otis
----
Performance Monitoring for Solr / ElasticSearch / HBase - http://sematext.com/spm
----- Original Message -----
> From: Lars George <la...@gmail.com>
> To: dev@hbase.apache.org
> Cc:
> Sent: Friday, June 15, 2012 4:07 AM
> Subject: Metrics in 0.96
>
> Hi,
>
> I propose that we clean up the metrics for 0.96 as well (if that is not already
> underway. This includes switching to Hadoop Metrics v2 and adding all missing
> stats, as well as fixing those that are misleading or useless. For that reason I
> talked to our friends at Sematext during the Buzzwords HBase workshop, as well
> as to our internal HBase team. We all seem to agree and I'd be happy to
> setup some sort of call/task force to discuss what we need to work on etc.
> Obviously I would love for someone from the FB team to also partake as they have
> done heaps lately on that end - but I also understand if that is a timing issue.
>
> What do y'all think? My reasoning is that 0.96 might become 1.0, but I would
> love for the metrics to be stable by then.
>
> Cheers,
> Lars
>