You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by ja...@legtux.org on 2019/10/31 11:37:02 UTC

oversized partition detection ? monitoring the partitions growth ?

Hi,
how can I detect a partition that reaches the 100MB ? is it possible to log the size of every partition one time per day ?

regards,
Nicolas Jäger

Re: oversized partition detection ? monitoring the partitions growth ?

Posted by Chris Lohfink <cl...@gmail.com>.
You can set compaction_large_partition_warning_threshold_mb and alert on
logs
<https://github.com/apache/cassandra/blob/33eada06a6dd3529da644377dba180795f522176/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java#L209>
.

Writing large partition {}/{}:{} ({}) to sstable {}

Chris

On Thu, Oct 31, 2019 at 8:01 AM Eric LELEU <er...@strapdata.com> wrote:

> Hi,
>
> I'm not sure that your are able to log which partition has reached 100MB
> but you may monitor the "EstimatedPartitionSizeHistogram" and take the
> max value (or 99ct, 95ct) to trigger an alert using your monitoring system.
>
> http://cassandra.apache.org/doc/latest/operating/metrics.html#table-metrics
>
> regards,
>
> Eric
>
> Le 31/10/2019 à 12:37, jagernicolas@legtux.org a écrit :
>
>
> Hi,
> how can I detect a partition that reaches the 100MB ? is it possible to
> log the size of every partition one time per day ?
>
> regards,
> Nicolas Jäger
>
>

Re: oversized partition detection ? monitoring the partitions growth ?

Posted by Eric LELEU <er...@strapdata.com>.
Hi,

I'm not sure that your are able to log which partition has reached 100MB 
but you may monitor the "EstimatedPartitionSizeHistogram"and take the 
max value (or 99ct, 95ct) to trigger an alert using your monitoring system.

http://cassandra.apache.org/doc/latest/operating/metrics.html#table-metrics

regards,

Eric

Le 31/10/2019 à 12:37, jagernicolas@legtux.org a écrit :
>
> Hi,
> how can I detect a partition that reaches the 100MB ? is it possible 
> to log the size of every partition one time per day ?
>
> regards,
> Nicolas Jäger