You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Siva <sb...@gmail.com> on 2015/04/06 23:33:33 UTC
Monitoring tools for Hbase
Hi,
Could someone recommend the good monitoring tools for Hbase to see
distribution of data over the regions, Hfiles for a table, how the reads
are happening on each region and to collect some metrics.
Any recommendations are appreciated.
Thanks,
Siva.
Re: Monitoring tools for Hbase
Posted by Siva <sb...@gmail.com>.
Thanks Nick for your suggestions.
On Wed, Apr 8, 2015 at 1:34 PM, Nick Dimiduk <nd...@gmail.com> wrote:
> On the OSS side, have a look at Bosun [0]. I haven't used it myself, but it
> builds on OpenTSDB, which itself is an HBase application. It looks like the
> just-released Ambari 2.0 [1] also has improved metrics/monitoring support,
> which also appear to use HBase.
>
> -n
>
> [0]: http://bosun.org
> [1]:
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=30755705
>
> On Wed, Apr 8, 2015 at 1:14 PM, Siva <sb...@gmail.com> wrote:
>
> > Hi Otis,
> >
> > Thanks for your inputs.
> >
> > It seems like it is Vendor specific.
> >
> > We are looking more of like open source rather than locked by a Vendor.
> >
> > Thanks,
> > Siva.
> >
> > On Mon, Apr 6, 2015 at 8:57 PM, Otis Gospodnetic <
> > otis.gospodnetic@gmail.com
> > > wrote:
> >
> > > Hi Siva,
> > >
> > > Have a look at SPM <http://sematext.com/>. It captures a pile of
> HBase
> > > metrics <
> > > http://blog.sematext.com/2015/03/24/hbase-0-98-monitoring-support/>,
> > > has built in alerting, anomaly detection, event and log correlation,
> even
> > > transaction tracking. Here's one of the interesting HBase metrics in
> > SPM I
> > > like: https://twitter.com/otisg/status/577509735185932288
> > >
> > > Otis
> > > --
> > > Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> > > Solr & Elasticsearch Support * http://sematext.com/
> > >
> > >
> > > On Mon, Apr 6, 2015 at 5:33 PM, Siva <sb...@gmail.com> wrote:
> > >
> > > > Hi,
> > > >
> > > > Could someone recommend the good monitoring tools for Hbase to see
> > > > distribution of data over the regions, Hfiles for a table, how the
> > reads
> > > > are happening on each region and to collect some metrics.
> > > >
> > > > Any recommendations are appreciated.
> > > >
> > > > Thanks,
> > > > Siva.
> > > >
> > >
> >
>
Re: Monitoring tools for Hbase
Posted by Siva <sb...@gmail.com>.
Thanks Nick for your suggestions.
On Wed, Apr 8, 2015 at 1:34 PM, Nick Dimiduk <nd...@gmail.com> wrote:
> On the OSS side, have a look at Bosun [0]. I haven't used it myself, but it
> builds on OpenTSDB, which itself is an HBase application. It looks like the
> just-released Ambari 2.0 [1] also has improved metrics/monitoring support,
> which also appear to use HBase.
>
> -n
>
> [0]: http://bosun.org
> [1]:
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=30755705
>
> On Wed, Apr 8, 2015 at 1:14 PM, Siva <sb...@gmail.com> wrote:
>
> > Hi Otis,
> >
> > Thanks for your inputs.
> >
> > It seems like it is Vendor specific.
> >
> > We are looking more of like open source rather than locked by a Vendor.
> >
> > Thanks,
> > Siva.
> >
> > On Mon, Apr 6, 2015 at 8:57 PM, Otis Gospodnetic <
> > otis.gospodnetic@gmail.com
> > > wrote:
> >
> > > Hi Siva,
> > >
> > > Have a look at SPM <http://sematext.com/>. It captures a pile of
> HBase
> > > metrics <
> > > http://blog.sematext.com/2015/03/24/hbase-0-98-monitoring-support/>,
> > > has built in alerting, anomaly detection, event and log correlation,
> even
> > > transaction tracking. Here's one of the interesting HBase metrics in
> > SPM I
> > > like: https://twitter.com/otisg/status/577509735185932288
> > >
> > > Otis
> > > --
> > > Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> > > Solr & Elasticsearch Support * http://sematext.com/
> > >
> > >
> > > On Mon, Apr 6, 2015 at 5:33 PM, Siva <sb...@gmail.com> wrote:
> > >
> > > > Hi,
> > > >
> > > > Could someone recommend the good monitoring tools for Hbase to see
> > > > distribution of data over the regions, Hfiles for a table, how the
> > reads
> > > > are happening on each region and to collect some metrics.
> > > >
> > > > Any recommendations are appreciated.
> > > >
> > > > Thanks,
> > > > Siva.
> > > >
> > >
> >
>
Re: Monitoring tools for Hbase
Posted by Nick Dimiduk <nd...@gmail.com>.
On the OSS side, have a look at Bosun [0]. I haven't used it myself, but it
builds on OpenTSDB, which itself is an HBase application. It looks like the
just-released Ambari 2.0 [1] also has improved metrics/monitoring support,
which also appear to use HBase.
-n
[0]: http://bosun.org
[1]:
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=30755705
On Wed, Apr 8, 2015 at 1:14 PM, Siva <sb...@gmail.com> wrote:
> Hi Otis,
>
> Thanks for your inputs.
>
> It seems like it is Vendor specific.
>
> We are looking more of like open source rather than locked by a Vendor.
>
> Thanks,
> Siva.
>
> On Mon, Apr 6, 2015 at 8:57 PM, Otis Gospodnetic <
> otis.gospodnetic@gmail.com
> > wrote:
>
> > Hi Siva,
> >
> > Have a look at SPM <http://sematext.com/>. It captures a pile of HBase
> > metrics <
> > http://blog.sematext.com/2015/03/24/hbase-0-98-monitoring-support/>,
> > has built in alerting, anomaly detection, event and log correlation, even
> > transaction tracking. Here's one of the interesting HBase metrics in
> SPM I
> > like: https://twitter.com/otisg/status/577509735185932288
> >
> > Otis
> > --
> > Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> > Solr & Elasticsearch Support * http://sematext.com/
> >
> >
> > On Mon, Apr 6, 2015 at 5:33 PM, Siva <sb...@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > Could someone recommend the good monitoring tools for Hbase to see
> > > distribution of data over the regions, Hfiles for a table, how the
> reads
> > > are happening on each region and to collect some metrics.
> > >
> > > Any recommendations are appreciated.
> > >
> > > Thanks,
> > > Siva.
> > >
> >
>
Re: Monitoring tools for Hbase
Posted by Nick Dimiduk <nd...@gmail.com>.
On the OSS side, have a look at Bosun [0]. I haven't used it myself, but it
builds on OpenTSDB, which itself is an HBase application. It looks like the
just-released Ambari 2.0 [1] also has improved metrics/monitoring support,
which also appear to use HBase.
-n
[0]: http://bosun.org
[1]:
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=30755705
On Wed, Apr 8, 2015 at 1:14 PM, Siva <sb...@gmail.com> wrote:
> Hi Otis,
>
> Thanks for your inputs.
>
> It seems like it is Vendor specific.
>
> We are looking more of like open source rather than locked by a Vendor.
>
> Thanks,
> Siva.
>
> On Mon, Apr 6, 2015 at 8:57 PM, Otis Gospodnetic <
> otis.gospodnetic@gmail.com
> > wrote:
>
> > Hi Siva,
> >
> > Have a look at SPM <http://sematext.com/>. It captures a pile of HBase
> > metrics <
> > http://blog.sematext.com/2015/03/24/hbase-0-98-monitoring-support/>,
> > has built in alerting, anomaly detection, event and log correlation, even
> > transaction tracking. Here's one of the interesting HBase metrics in
> SPM I
> > like: https://twitter.com/otisg/status/577509735185932288
> >
> > Otis
> > --
> > Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> > Solr & Elasticsearch Support * http://sematext.com/
> >
> >
> > On Mon, Apr 6, 2015 at 5:33 PM, Siva <sb...@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > Could someone recommend the good monitoring tools for Hbase to see
> > > distribution of data over the regions, Hfiles for a table, how the
> reads
> > > are happening on each region and to collect some metrics.
> > >
> > > Any recommendations are appreciated.
> > >
> > > Thanks,
> > > Siva.
> > >
> >
>
Re: Monitoring tools for Hbase
Posted by Siva <sb...@gmail.com>.
Hi Otis,
Thanks for your inputs.
It seems like it is Vendor specific.
We are looking more of like open source rather than locked by a Vendor.
Thanks,
Siva.
On Mon, Apr 6, 2015 at 8:57 PM, Otis Gospodnetic <otis.gospodnetic@gmail.com
> wrote:
> Hi Siva,
>
> Have a look at SPM <http://sematext.com/>. It captures a pile of HBase
> metrics <
> http://blog.sematext.com/2015/03/24/hbase-0-98-monitoring-support/>,
> has built in alerting, anomaly detection, event and log correlation, even
> transaction tracking. Here's one of the interesting HBase metrics in SPM I
> like: https://twitter.com/otisg/status/577509735185932288
>
> Otis
> --
> Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> Solr & Elasticsearch Support * http://sematext.com/
>
>
> On Mon, Apr 6, 2015 at 5:33 PM, Siva <sb...@gmail.com> wrote:
>
> > Hi,
> >
> > Could someone recommend the good monitoring tools for Hbase to see
> > distribution of data over the regions, Hfiles for a table, how the reads
> > are happening on each region and to collect some metrics.
> >
> > Any recommendations are appreciated.
> >
> > Thanks,
> > Siva.
> >
>
Re: Monitoring tools for Hbase
Posted by Siva <sb...@gmail.com>.
Hi Otis,
Thanks for your inputs.
It seems like it is Vendor specific.
We are looking more of like open source rather than locked by a Vendor.
Thanks,
Siva.
On Mon, Apr 6, 2015 at 8:57 PM, Otis Gospodnetic <otis.gospodnetic@gmail.com
> wrote:
> Hi Siva,
>
> Have a look at SPM <http://sematext.com/>. It captures a pile of HBase
> metrics <
> http://blog.sematext.com/2015/03/24/hbase-0-98-monitoring-support/>,
> has built in alerting, anomaly detection, event and log correlation, even
> transaction tracking. Here's one of the interesting HBase metrics in SPM I
> like: https://twitter.com/otisg/status/577509735185932288
>
> Otis
> --
> Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> Solr & Elasticsearch Support * http://sematext.com/
>
>
> On Mon, Apr 6, 2015 at 5:33 PM, Siva <sb...@gmail.com> wrote:
>
> > Hi,
> >
> > Could someone recommend the good monitoring tools for Hbase to see
> > distribution of data over the regions, Hfiles for a table, how the reads
> > are happening on each region and to collect some metrics.
> >
> > Any recommendations are appreciated.
> >
> > Thanks,
> > Siva.
> >
>
Re: Monitoring tools for Hbase
Posted by Otis Gospodnetic <ot...@gmail.com>.
Hi Siva,
Have a look at SPM <http://sematext.com/>. It captures a pile of HBase
metrics <http://blog.sematext.com/2015/03/24/hbase-0-98-monitoring-support/>,
has built in alerting, anomaly detection, event and log correlation, even
transaction tracking. Here's one of the interesting HBase metrics in SPM I
like: https://twitter.com/otisg/status/577509735185932288
Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
On Mon, Apr 6, 2015 at 5:33 PM, Siva <sb...@gmail.com> wrote:
> Hi,
>
> Could someone recommend the good monitoring tools for Hbase to see
> distribution of data over the regions, Hfiles for a table, how the reads
> are happening on each region and to collect some metrics.
>
> Any recommendations are appreciated.
>
> Thanks,
> Siva.
>
Re: Monitoring tools for Hbase
Posted by Siva <sb...@gmail.com>.
Thanks Kim!
On Wed, Apr 8, 2015 at 1:31 PM, Kim Chew <kc...@gmail.com> wrote:
> Siva, you may want to take a look at Apache Hannibal.
>
> Kim
>
> On Wed, Apr 8, 2015 at 1:12 PM, Siva <sb...@gmail.com> wrote:
>
> > Thanks Geovanie for your response.
> >
> > On Mon, Apr 6, 2015 at 3:20 PM, Geovanie Marquez <
> > geovanie.marquez@gmail.com
> > > wrote:
> >
> > > Cloudera Manager if you are using a distributor like them. If not,
> > OpenTSDB
> > > together with Grafana allows you to graph anything and annotate it
> which
> > > may be useful when you deploy code that may cause interesting behavior.
> > >
> > > On Mon, Apr 6, 2015 at 5:33 PM, Siva <sb...@gmail.com> wrote:
> > >
> > > > Hi,
> > > >
> > > > Could someone recommend the good monitoring tools for Hbase to see
> > > > distribution of data over the regions, Hfiles for a table, how the
> > reads
> > > > are happening on each region and to collect some metrics.
> > > >
> > > > Any recommendations are appreciated.
> > > >
> > > > Thanks,
> > > > Siva.
> > > >
> > >
> >
>
Re: Monitoring tools for Hbase
Posted by Kim Chew <kc...@gmail.com>.
Siva, you may want to take a look at Apache Hannibal.
Kim
On Wed, Apr 8, 2015 at 1:12 PM, Siva <sb...@gmail.com> wrote:
> Thanks Geovanie for your response.
>
> On Mon, Apr 6, 2015 at 3:20 PM, Geovanie Marquez <
> geovanie.marquez@gmail.com
> > wrote:
>
> > Cloudera Manager if you are using a distributor like them. If not,
> OpenTSDB
> > together with Grafana allows you to graph anything and annotate it which
> > may be useful when you deploy code that may cause interesting behavior.
> >
> > On Mon, Apr 6, 2015 at 5:33 PM, Siva <sb...@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > Could someone recommend the good monitoring tools for Hbase to see
> > > distribution of data over the regions, Hfiles for a table, how the
> reads
> > > are happening on each region and to collect some metrics.
> > >
> > > Any recommendations are appreciated.
> > >
> > > Thanks,
> > > Siva.
> > >
> >
>
Re: Monitoring tools for Hbase
Posted by Siva <sb...@gmail.com>.
Thanks Geovanie for your response.
On Mon, Apr 6, 2015 at 3:20 PM, Geovanie Marquez <geovanie.marquez@gmail.com
> wrote:
> Cloudera Manager if you are using a distributor like them. If not, OpenTSDB
> together with Grafana allows you to graph anything and annotate it which
> may be useful when you deploy code that may cause interesting behavior.
>
> On Mon, Apr 6, 2015 at 5:33 PM, Siva <sb...@gmail.com> wrote:
>
> > Hi,
> >
> > Could someone recommend the good monitoring tools for Hbase to see
> > distribution of data over the regions, Hfiles for a table, how the reads
> > are happening on each region and to collect some metrics.
> >
> > Any recommendations are appreciated.
> >
> > Thanks,
> > Siva.
> >
>
Re: Monitoring tools for Hbase
Posted by Geovanie Marquez <ge...@gmail.com>.
Cloudera Manager if you are using a distributor like them. If not, OpenTSDB
together with Grafana allows you to graph anything and annotate it which
may be useful when you deploy code that may cause interesting behavior.
On Mon, Apr 6, 2015 at 5:33 PM, Siva <sb...@gmail.com> wrote:
> Hi,
>
> Could someone recommend the good monitoring tools for Hbase to see
> distribution of data over the regions, Hfiles for a table, how the reads
> are happening on each region and to collect some metrics.
>
> Any recommendations are appreciated.
>
> Thanks,
> Siva.
>
Re: Monitoring tools for Hbase
Posted by Otis Gospodnetic <ot...@gmail.com>.
Hi Siva,
Have a look at SPM <http://sematext.com/>. It captures a pile of HBase
metrics <http://blog.sematext.com/2015/03/24/hbase-0-98-monitoring-support/>,
has built in alerting, anomaly detection, event and log correlation, even
transaction tracking. Here's one of the interesting HBase metrics in SPM I
like: https://twitter.com/otisg/status/577509735185932288
Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
On Mon, Apr 6, 2015 at 5:33 PM, Siva <sb...@gmail.com> wrote:
> Hi,
>
> Could someone recommend the good monitoring tools for Hbase to see
> distribution of data over the regions, Hfiles for a table, how the reads
> are happening on each region and to collect some metrics.
>
> Any recommendations are appreciated.
>
> Thanks,
> Siva.
>