High CPU utilization by meta region

[Timothy Brown <ti...@siftscience.com>]

Hi,

We are seeing about 80% CPU utilization on the Region Server that solely
serves the meta table while other region servers typically have under 50%
CPU utilization. Is this expected?

Here's some more info about our cluster:
HBase version 1.2
Number of regions: 72
Number of tables: 97
Approx. requests per second to meta region server: 3k
Approx. requests per second to entire HBase cluster: 90k

Let me know what other information would be useful.

Thanks for the help,
Tim

Re: High CPU utilization by meta region

[Jean-Marc Spaggiari <je...@spaggiari.org>]

To add to what Stack asked, do you have the metrics for your META vs he
other regions? Is the meta hot-spotted, which might create an increase on
the CPU usage? Not just the requests per seconds, but also the number of
calls. Does the META have way more? Or almost the same? Or less?

thanks,

JMS


2016-11-22 0:04 GMT-05:00 Stack <st...@duboce.net>:

> Can we see configs -- encodings? -- and a thread dump?  Any I/O? If you
> look in HDFS, many files under hbase:meta? Is it big? When was last time it
> major compacted?
>
> Thanks,
> S
>
> On Mon, Nov 21, 2016 at 5:50 PM, Timothy Brown <ti...@siftscience.com>
> wrote:
>
> > Hi,
> >
> > We are seeing about 80% CPU utilization on the Region Server that solely
> > serves the meta table while other region servers typically have under 50%
> > CPU utilization. Is this expected?
> >
> > Here's some more info about our cluster:
> > HBase version 1.2
> > Number of regions: 72
> > Number of tables: 97
> > Approx. requests per second to meta region server: 3k
> > Approx. requests per second to entire HBase cluster: 90k
> >
> > Let me know what other information would be useful.
> >
> > Thanks for the help,
> > Tim
> >
>

Re: High CPU utilization by meta region

[Stack <st...@duboce.net>]

Can we see configs -- encodings? -- and a thread dump?  Any I/O? If you
look in HDFS, many files under hbase:meta? Is it big? When was last time it
major compacted?

Thanks,
S

On Mon, Nov 21, 2016 at 5:50 PM, Timothy Brown <ti...@siftscience.com> wrote:

> Hi,
>
> We are seeing about 80% CPU utilization on the Region Server that solely
> serves the meta table while other region servers typically have under 50%
> CPU utilization. Is this expected?
>
> Here's some more info about our cluster:
> HBase version 1.2
> Number of regions: 72
> Number of tables: 97
> Approx. requests per second to meta region server: 3k
> Approx. requests per second to entire HBase cluster: 90k
>
> Let me know what other information would be useful.
>
> Thanks for the help,
> Tim
>