You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Pranay akula <pr...@gmail.com> on 2016/10/27 15:45:47 UTC
how to get the size of the particular partition key belonging to an
sstable ??
how can i get the size of a particular partition key belonging to an
sstable ?? can we find it using index or summary or Statistics.db files ??
does reading the hexdump of these files help ??
Thanks
Pranay.
Re: how to get the size of the particular partition key belonging to
an sstable ??
Posted by Edward Capriolo <ed...@gmail.com>.
There are actually multiple tickets for different size functions. Examples
include computing size of collections, number of rows, and physical sizes
server side.
I also have a patch to make the warn and info settable at runtime.
https://issues.apache.org/jira/browse/CASSANDRA-12661?filter=-1
It is an ask that has come up multiple times now.
On Fri, Oct 28, 2016 at 3:40 PM, Jeff Jirsa <je...@crowdstrike.com>
wrote:
> See also https://issues.apache.org/jira/browse/CASSANDRA-12367
>
>
>
>
>
>
>
> *From: *Justin Cameron <ju...@instaclustr.com>
> *Reply-To: *"user@cassandra.apache.org" <us...@cassandra.apache.org>
> *Date: *Friday, October 28, 2016 at 12:35 PM
> *To: *"user@cassandra.apache.org" <us...@cassandra.apache.org>
> *Subject: *Re: how to get the size of the particular partition key
> belonging to an sstable ??
>
>
>
>
>
> nodetool cfhistograms / nodetool tablehistograms will also output
> partition size statistics for a given table: http://docs.datastax.com/en/
> cassandra/3.0/cassandra/tools/toolsTablehisto.html
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__docs.datastax.com_en_cassandra_3.0_cassandra_tools_toolsTablehisto.html&d=DQMFaQ&c=08AGY6txKsvMOP6lYkHQpPMRA1U6kqhAwGa8-0QCg3M&r=yfYEBHVkX6l0zImlOIBID0gmhluYPD5Jje-3CtaT3ow&m=gZ7B7cTGjBGBZSMl9K7ekY-yjT_dBSC4gBB1P-TZRGE&s=NqTA5xzMoPFPlBnU0gwEiEGckIaS5nhSviDtYaKZE4U&e=>
>
>
>
>
>
> On Fri, 28 Oct 2016 at 12:32 Justin Cameron <ju...@instaclustr.com>
> wrote:
>
> If you're trying to determine this in order to diagnose wide row issues,
> then you can check your logs - Cassandra will log a warning for partitions
> > 100MB during compaction.
>
>
>
> See https://docs.datastax.com/en/cassandra/3.x/cassandra/
> configuration/configCassandra_yaml.html#configCassandra_
> yaml__compaction_large_partition_warning_threshold_mb
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.datastax.com_en_cassandra_3.x_cassandra_configuration_configCassandra-5Fyaml.html-23configCassandra-5Fyaml-5F-5Fcompaction-5Flarge-5Fpartition-5Fwarning-5Fthreshold-5Fmb&d=DQMFaQ&c=08AGY6txKsvMOP6lYkHQpPMRA1U6kqhAwGa8-0QCg3M&r=yfYEBHVkX6l0zImlOIBID0gmhluYPD5Jje-3CtaT3ow&m=gZ7B7cTGjBGBZSMl9K7ekY-yjT_dBSC4gBB1P-TZRGE&s=_02Ohv4qCcWrej4UKgTMwt1LkgO1zqjA2c97i0Uzw0E&e=>
>
>
>
>
>
> On Fri, 28 Oct 2016 at 01:49 Oleg Krayushkin <al...@gmail.com> wrote:
>
> Hi,
>
>
>
> I guess it's about getting particular Partition Size on disk. If so, I
> would like to know this too.
>
>
>
> 2016-10-28 9:09 GMT+03:00 Vladimir Yudovin <vl...@winguzone.com>:
>
> Hi,
>
>
>
> >size of a particular partition key
>
> Can you please elucidate this? Key can be just number, or string, or
> several values.
>
>
>
> Best regards, Vladimir Yudovin,
>
>
> *Winguzone
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__winguzone.com-3Ffrom-3Dlist&d=DQMFaQ&c=08AGY6txKsvMOP6lYkHQpPMRA1U6kqhAwGa8-0QCg3M&r=yfYEBHVkX6l0zImlOIBID0gmhluYPD5Jje-3CtaT3ow&m=gZ7B7cTGjBGBZSMl9K7ekY-yjT_dBSC4gBB1P-TZRGE&s=aXMTSrF8HO80XG2WMo5lv009qY6zsIkfhWC5fyJyyno&e=>
> - Hosted Cloud CassandraLaunch your cluster in minutes.*
>
>
>
>
>
> ---- On Thu, 27 Oct 2016 11:45:47 -0400*Pranay akula
> <pranay.akula2323@gmail.com <pr...@gmail.com>>* wrote ----
>
>
>
> how can i get the size of a particular partition key belonging to an
> sstable ?? can we find it using index or summary or Statistics.db files ??
> does reading the hexdump of these files help ??
>
>
>
>
>
>
>
> Thanks
>
> Pranay.
>
>
>
>
>
>
>
> --
>
>
>
> Oleg Krayushkin
>
> --
>
> *Justin Cameron*
>
> Senior Software Engineer | Instaclustr
>
>
>
>
>
>
> This email has been sent on behalf of Instaclustr Pty Ltd (Australia) and
> Instaclustr Inc (USA).
>
> This email and any attachments may contain confidential and legally
> privileged information. If you are not the intended recipient, do not copy
> or disclose its content, but please reply to this email immediately and
> highlight the error to the sender and then immediately delete the message.
>
>
>
> --
>
> *Justin Cameron*
>
> Senior Software Engineer | Instaclustr
>
>
>
>
>
>
> This email has been sent on behalf of Instaclustr Pty Ltd (Australia) and
> Instaclustr Inc (USA).
>
> This email and any attachments may contain confidential and legally
> privileged information. If you are not the intended recipient, do not copy
> or disclose its content, but please reply to this email immediately and
> highlight the error to the sender and then immediately delete the message.
>
>
> CONFIDENTIALITY NOTE: This e-mail and any attachments are confidential and
> may be legally privileged. If you are not the intended recipient, do not
> disclose, copy, distribute, or use this email or any attachments. If you
> have received this in error please let the sender know and then delete the
> email and all attachments.
>
Re: how to get the size of the particular partition key belonging to
an sstable ??
Posted by Jeff Jirsa <je...@crowdstrike.com>.
See also https://issues.apache.org/jira/browse/CASSANDRA-12367
From: Justin Cameron <ju...@instaclustr.com>
Reply-To: "user@cassandra.apache.org" <us...@cassandra.apache.org>
Date: Friday, October 28, 2016 at 12:35 PM
To: "user@cassandra.apache.org" <us...@cassandra.apache.org>
Subject: Re: how to get the size of the particular partition key belonging to an sstable ??
nodetool cfhistograms / nodetool tablehistograms will also output partition size statistics for a given table: http://docs.datastax.com/en/cassandra/3.0/cassandra/tools/toolsTablehisto.html
On Fri, 28 Oct 2016 at 12:32 Justin Cameron <ju...@instaclustr.com> wrote:
If you're trying to determine this in order to diagnose wide row issues, then you can check your logs - Cassandra will log a warning for partitions > 100MB during compaction.
See https://docs.datastax.com/en/cassandra/3.x/cassandra/configuration/configCassandra_yaml.html#configCassandra_yaml__compaction_large_partition_warning_threshold_mb
On Fri, 28 Oct 2016 at 01:49 Oleg Krayushkin <al...@gmail.com> wrote:
Hi,
I guess it's about getting particular Partition Size on disk. If so, I would like to know this too.
2016-10-28 9:09 GMT+03:00 Vladimir Yudovin <vl...@winguzone.com>:
Hi,
>size of a particular partition key
Can you please elucidate this? Key can be just number, or string, or several values.
Best regards, Vladimir Yudovin,
Winguzone - Hosted Cloud Cassandra
Launch your cluster in minutes.
---- On Thu, 27 Oct 2016 11:45:47 -0400Pranay akula <pr...@gmail.com> wrote ----
how can i get the size of a particular partition key belonging to an sstable ?? can we find it using index or summary or Statistics.db files ?? does reading the hexdump of these files help ??
Thanks
Pranay.
--
Oleg Krayushkin
--
Justin Cameron
Senior Software Engineer | Instaclustr
This email has been sent on behalf of Instaclustr Pty Ltd (Australia) and Instaclustr Inc (USA).
This email and any attachments may contain confidential and legally privileged information. If you are not the intended recipient, do not copy or disclose its content, but please reply to this email immediately and highlight the error to the sender and then immediately delete the message.
--
Justin Cameron
Senior Software Engineer | Instaclustr
This email has been sent on behalf of Instaclustr Pty Ltd (Australia) and Instaclustr Inc (USA).
This email and any attachments may contain confidential and legally privileged information. If you are not the intended recipient, do not copy or disclose its content, but please reply to this email immediately and highlight the error to the sender and then immediately delete the message.
CONFIDENTIALITY NOTE: This e-mail and any attachments are confidential and may be legally privileged. If you are not the intended recipient, do not disclose, copy, distribute, or use this email or any attachments. If you have received this in error please let the sender know and then delete the email and all attachments.
Re: how to get the size of the particular partition key belonging to
an sstable ??
Posted by Justin Cameron <ju...@instaclustr.com>.
nodetool cfhistograms / nodetool tablehistograms will also output partition
size statistics for a given table:
http://docs.datastax.com/en/cassandra/3.0/cassandra/tools/toolsTablehisto.html
On Fri, 28 Oct 2016 at 12:32 Justin Cameron <ju...@instaclustr.com> wrote:
> If you're trying to determine this in order to diagnose wide row issues,
> then you can check your logs - Cassandra will log a warning for partitions
> > 100MB during compaction.
>
> See
> https://docs.datastax.com/en/cassandra/3.x/cassandra/configuration/configCassandra_yaml.html#configCassandra_yaml__compaction_large_partition_warning_threshold_mb
>
>
> On Fri, 28 Oct 2016 at 01:49 Oleg Krayushkin <al...@gmail.com> wrote:
>
> Hi,
>
> I guess it's about getting particular Partition Size on disk. If so, I
> would like to know this too.
>
> 2016-10-28 9:09 GMT+03:00 Vladimir Yudovin <vl...@winguzone.com>:
>
> Hi,
>
> >size of a particular partition key
> Can you please elucidate this? Key can be just number, or string, or
> several values.
>
> Best regards, Vladimir Yudovin,
>
> *Winguzone <https://winguzone.com?from=list> - Hosted Cloud
> CassandraLaunch your cluster in minutes.*
>
>
> ---- On Thu, 27 Oct 2016 11:45:47 -0400*Pranay akula
> <pranay.akula2323@gmail.com <pr...@gmail.com>>* wrote ----
>
> how can i get the size of a particular partition key belonging to an
> sstable ?? can we find it using index or summary or Statistics.db files ??
> does reading the hexdump of these files help ??
>
>
>
> Thanks
> Pranay.
>
>
>
>
>
> --
>
> Oleg Krayushkin
>
> --
>
> Justin Cameron
>
> Senior Software Engineer | Instaclustr
>
>
>
>
> This email has been sent on behalf of Instaclustr Pty Ltd (Australia) and
> Instaclustr Inc (USA).
>
> This email and any attachments may contain confidential and legally
> privileged information. If you are not the intended recipient, do not copy
> or disclose its content, but please reply to this email immediately and
> highlight the error to the sender and then immediately delete the message.
>
> --
Justin Cameron
Senior Software Engineer | Instaclustr
This email has been sent on behalf of Instaclustr Pty Ltd (Australia) and
Instaclustr Inc (USA).
This email and any attachments may contain confidential and legally
privileged information. If you are not the intended recipient, do not copy
or disclose its content, but please reply to this email immediately and
highlight the error to the sender and then immediately delete the message.
Re: how to get the size of the particular partition key belonging to
an sstable ??
Posted by Justin Cameron <ju...@instaclustr.com>.
If you're trying to determine this in order to diagnose wide row issues,
then you can check your logs - Cassandra will log a warning for partitions
> 100MB during compaction.
See
https://docs.datastax.com/en/cassandra/3.x/cassandra/configuration/configCassandra_yaml.html#configCassandra_yaml__compaction_large_partition_warning_threshold_mb
On Fri, 28 Oct 2016 at 01:49 Oleg Krayushkin <al...@gmail.com> wrote:
> Hi,
>
> I guess it's about getting particular Partition Size on disk. If so, I
> would like to know this too.
>
> 2016-10-28 9:09 GMT+03:00 Vladimir Yudovin <vl...@winguzone.com>:
>
> Hi,
>
> >size of a particular partition key
> Can you please elucidate this? Key can be just number, or string, or
> several values.
>
> Best regards, Vladimir Yudovin,
>
> *Winguzone <https://winguzone.com?from=list> - Hosted Cloud
> CassandraLaunch your cluster in minutes.*
>
>
> ---- On Thu, 27 Oct 2016 11:45:47 -0400*Pranay akula
> <pranay.akula2323@gmail.com <pr...@gmail.com>>* wrote ----
>
> how can i get the size of a particular partition key belonging to an
> sstable ?? can we find it using index or summary or Statistics.db files ??
> does reading the hexdump of these files help ??
>
>
>
> Thanks
> Pranay.
>
>
>
>
>
> --
>
> Oleg Krayushkin
>
--
Justin Cameron
Senior Software Engineer | Instaclustr
This email has been sent on behalf of Instaclustr Pty Ltd (Australia) and
Instaclustr Inc (USA).
This email and any attachments may contain confidential and legally
privileged information. If you are not the intended recipient, do not copy
or disclose its content, but please reply to this email immediately and
highlight the error to the sender and then immediately delete the message.
Re: how to get the size of the particular partition key belonging to
an sstable ??
Posted by Oleg Krayushkin <al...@gmail.com>.
Hi,
I guess it's about getting particular Partition Size on disk. If so, I
would like to know this too.
2016-10-28 9:09 GMT+03:00 Vladimir Yudovin <vl...@winguzone.com>:
> Hi,
>
> >size of a particular partition key
> Can you please elucidate this? Key can be just number, or string, or
> several values.
>
> Best regards, Vladimir Yudovin,
>
> *Winguzone <https://winguzone.com?from=list> - Hosted Cloud
> CassandraLaunch your cluster in minutes.*
>
>
> ---- On Thu, 27 Oct 2016 11:45:47 -0400*Pranay akula
> <pranay.akula2323@gmail.com <pr...@gmail.com>>* wrote ----
>
> how can i get the size of a particular partition key belonging to an
> sstable ?? can we find it using index or summary or Statistics.db files ??
> does reading the hexdump of these files help ??
>
>
>
> Thanks
> Pranay.
>
>
>
--
Oleg Krayushkin
Re: how to get the size of the particular partition key belonging
to an sstable ??
Posted by Vladimir Yudovin <vl...@winguzone.com>.
Hi,
>size of a particular partition key
Can you please elucidate this? Key can be just number, or string, or several values.
Best regards, Vladimir Yudovin,
Winguzone - Hosted Cloud Cassandra
Launch your cluster in minutes.
---- On Thu, 27 Oct 2016 11:45:47 -0400Pranay akula <pranay.akula2323@gmail.com> wrote ----
how can i get the size of a particular partition key belonging to an sstable ?? can we find it using index or summary or Statistics.db files ?? does reading the hexdump of these files help ??
Thanks
Pranay.