You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Parag Shah <ps...@proofpoint.com> on 2014/10/09 22:33:15 UTC

Disabling compaction

Hi all,

     I am trying to disable compaction for a few select tables. Here is a definition of one such table:

CREATE TABLE blob_2014_12_31 (
  blob_id uuid,
  blob_index int,
  blob_chunk blob,
  PRIMARY KEY (blob_id, blob_index)
) WITH
  bloom_filter_fp_chance=0.010000 AND
  caching='KEYS_ONLY' AND
  comment='' AND
  dclocal_read_repair_chance=0.000000 AND
  gc_grace_seconds=864000 AND
  index_interval=128 AND
  read_repair_chance=0.100000 AND
  replicate_on_write='true' AND
  populate_io_cache_on_flush='false' AND
  default_time_to_live=0 AND
  speculative_retry='99.0PERCENTILE' AND
  memtable_flush_period_in_ms=0 AND
  compaction={'enabled': 'false', 'class': 'SizeTieredCompactionStrategy'} AND
  compression={'sstable_compression': 'LZ4Compressor’};

I have set compaction ‘enabled’ : ‘false’ on the above table.

However, I do see compactions being run for this node:

-bash-3.2$ nodetool compactionstats
pending tasks: 55
          compaction type        keyspace           table       completed           total      unit  progress
               Compaction ids_high_awslab blob_2014_11_15     18122816990     35814893020     bytes    50.60%
               Compaction ids_high_awslab blob_2014_12_31     18576750966     34242866468     bytes    54.25%
               Compaction ids_high_awslab blob_2014_12_15     19213914904     35956698600     bytes    53.44%
Active compaction remaining time :   0h49m46s

Can you someone tell me why this is happening? Do I need to set the compaction threshold  to 0 0?

Regards
Parag

Re: Disabling compaction

Posted by Parag Shah <ps...@proofpoint.com>.
Thanks, Marcus.

Regards
Parag

From: Marcus Eriksson <kr...@gmail.com>>
Reply-To: "user@cassandra.apache.org<ma...@cassandra.apache.org>" <us...@cassandra.apache.org>>
Date: Friday, October 10, 2014 at 10:59 AM
To: "user@cassandra.apache.org<ma...@cassandra.apache.org>" <us...@cassandra.apache.org>>
Subject: Re: Disabling compaction

this is fixed in 2.0.8; https://issues.apache.org/jira/browse/CASSANDRA-7187<https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_CASSANDRA-2D7187&d=AAMFaQ&c=Vxt5e0Osvvt2gflwSlsJ5DmPGcPvTRKLJyp031rXjhg&r=Zm-paw4L-LBldtJybEWfBLLjvC5axjko2vu-eqkngMI&m=7buRq9Dt25OaWjoEDHVcOqu1FQ4kYiNX3BLqnGNXYXI&s=cGXvzXOISsNR4t-L5pm837TZYO5fk4uRra8MzdoD7Us&e=>

/Marcus

On Fri, Oct 10, 2014 at 7:11 PM, Parag Shah <ps...@proofpoint.com>> wrote:
Cassandra Version: 2.0.7

In my application, I am using Cassandra Java Driver 2.0.2

Thanks
Parag

From: Marcus Eriksson <kr...@gmail.com>>
Reply-To: "user@cassandra.apache.org<ma...@cassandra.apache.org>" <us...@cassandra.apache.org>>
Date: Thursday, October 9, 2014 at 11:56 PM
To: "user@cassandra.apache.org<ma...@cassandra.apache.org>" <us...@cassandra.apache.org>>
Subject: Re: Disabling compaction

what version are you on?

On Thu, Oct 9, 2014 at 10:33 PM, Parag Shah <ps...@proofpoint.com>> wrote:
Hi all,

     I am trying to disable compaction for a few select tables. Here is a definition of one such table:

CREATE TABLE blob_2014_12_31 (
  blob_id uuid,
  blob_index int,
  blob_chunk blob,
  PRIMARY KEY (blob_id, blob_index)
) WITH
  bloom_filter_fp_chance=0.010000 AND
  caching='KEYS_ONLY' AND
  comment='' AND
  dclocal_read_repair_chance=0.000000 AND
  gc_grace_seconds=864000 AND
  index_interval=128 AND
  read_repair_chance=0.100000 AND
  replicate_on_write='true' AND
  populate_io_cache_on_flush='false' AND
  default_time_to_live=0 AND
  speculative_retry='99.0PERCENTILE' AND
  memtable_flush_period_in_ms=0 AND
  compaction={'enabled': 'false', 'class': 'SizeTieredCompactionStrategy'} AND
  compression={'sstable_compression': 'LZ4Compressor’};

I have set compaction ‘enabled’ : ‘false’ on the above table.

However, I do see compactions being run for this node:

-bash-3.2$ nodetool compactionstats
pending tasks: 55
          compaction type        keyspace           table       completed           total      unit  progress
               Compaction ids_high_awslab blob_2014_11_15     18122816990<tel:18122816990>     35814893020     bytes    50.60%
               Compaction ids_high_awslab blob_2014_12_31     18576750966<tel:18576750966>     34242866468     bytes    54.25%
               Compaction ids_high_awslab blob_2014_12_15     19213914904     35956698600     bytes    53.44%
Active compaction remaining time :   0h49m46s

Can you someone tell me why this is happening? Do I need to set the compaction threshold  to 0 0?

Regards
Parag



Re: Disabling compaction

Posted by Marcus Eriksson <kr...@gmail.com>.
this is fixed in 2.0.8; https://issues.apache.org/jira/browse/CASSANDRA-7187

/Marcus

On Fri, Oct 10, 2014 at 7:11 PM, Parag Shah <ps...@proofpoint.com> wrote:

>  Cassandra Version: 2.0.7
>
>  In my application, I am using Cassandra Java Driver 2.0.2
>
>  Thanks
> Parag
>
>   From: Marcus Eriksson <kr...@gmail.com>
> Reply-To: "user@cassandra.apache.org" <us...@cassandra.apache.org>
> Date: Thursday, October 9, 2014 at 11:56 PM
> To: "user@cassandra.apache.org" <us...@cassandra.apache.org>
> Subject: Re: Disabling compaction
>
>   what version are you on?
>
> On Thu, Oct 9, 2014 at 10:33 PM, Parag Shah <ps...@proofpoint.com> wrote:
>
>>  Hi all,
>>
>>       I am trying to disable compaction for a few select tables. Here is
>> a definition of one such table:
>>
>>  CREATE TABLE blob_2014_12_31 (
>>   blob_id uuid,
>>   blob_index int,
>>   blob_chunk blob,
>>   PRIMARY KEY (blob_id, blob_index)
>> ) WITH
>>   bloom_filter_fp_chance=0.010000 AND
>>   caching='KEYS_ONLY' AND
>>   comment='' AND
>>   dclocal_read_repair_chance=0.000000 AND
>>   gc_grace_seconds=864000 AND
>>   index_interval=128 AND
>>   read_repair_chance=0.100000 AND
>>   replicate_on_write='true' AND
>>   populate_io_cache_on_flush='false' AND
>>   default_time_to_live=0 AND
>>   speculative_retry='99.0PERCENTILE' AND
>>   memtable_flush_period_in_ms=0 AND
>>   compaction={'enabled': 'false', 'class':
>> 'SizeTieredCompactionStrategy'} AND
>>   compression={'sstable_compression': 'LZ4Compressor’};
>>
>>  I have set compaction ‘enabled’ : ‘false’ on the above table.
>>
>>  However, I do see compactions being run for this node:
>>
>>  -bash-3.2$ nodetool compactionstats
>> pending tasks: 55
>>           compaction type        keyspace           table       completed
>>           total      unit  progress
>>                Compaction ids_high_awslab blob_2014_11_15     18122816990
>>     35814893020     bytes    50.60%
>>                Compaction ids_high_awslab blob_2014_12_31     18576750966
>>     34242866468     bytes    54.25%
>>                Compaction ids_high_awslab blob_2014_12_15     19213914904
>>     35956698600     bytes    53.44%
>> Active compaction remaining time :   0h49m46s
>>
>>  Can you someone tell me why this is happening? Do I need to set the
>> compaction threshold  to 0 0?
>>
>>  Regards
>>  Parag
>>
>
>

Re: Disabling compaction

Posted by Parag Shah <ps...@proofpoint.com>.
Cassandra Version: 2.0.7

In my application, I am using Cassandra Java Driver 2.0.2

Thanks
Parag

From: Marcus Eriksson <kr...@gmail.com>>
Reply-To: "user@cassandra.apache.org<ma...@cassandra.apache.org>" <us...@cassandra.apache.org>>
Date: Thursday, October 9, 2014 at 11:56 PM
To: "user@cassandra.apache.org<ma...@cassandra.apache.org>" <us...@cassandra.apache.org>>
Subject: Re: Disabling compaction

what version are you on?

On Thu, Oct 9, 2014 at 10:33 PM, Parag Shah <ps...@proofpoint.com>> wrote:
Hi all,

     I am trying to disable compaction for a few select tables. Here is a definition of one such table:

CREATE TABLE blob_2014_12_31 (
  blob_id uuid,
  blob_index int,
  blob_chunk blob,
  PRIMARY KEY (blob_id, blob_index)
) WITH
  bloom_filter_fp_chance=0.010000 AND
  caching='KEYS_ONLY' AND
  comment='' AND
  dclocal_read_repair_chance=0.000000 AND
  gc_grace_seconds=864000 AND
  index_interval=128 AND
  read_repair_chance=0.100000 AND
  replicate_on_write='true' AND
  populate_io_cache_on_flush='false' AND
  default_time_to_live=0 AND
  speculative_retry='99.0PERCENTILE' AND
  memtable_flush_period_in_ms=0 AND
  compaction={'enabled': 'false', 'class': 'SizeTieredCompactionStrategy'} AND
  compression={'sstable_compression': 'LZ4Compressor’};

I have set compaction ‘enabled’ : ‘false’ on the above table.

However, I do see compactions being run for this node:

-bash-3.2$ nodetool compactionstats
pending tasks: 55
          compaction type        keyspace           table       completed           total      unit  progress
               Compaction ids_high_awslab blob_2014_11_15     18122816990<tel:18122816990>     35814893020     bytes    50.60%
               Compaction ids_high_awslab blob_2014_12_31     18576750966<tel:18576750966>     34242866468     bytes    54.25%
               Compaction ids_high_awslab blob_2014_12_15     19213914904     35956698600     bytes    53.44%
Active compaction remaining time :   0h49m46s

Can you someone tell me why this is happening? Do I need to set the compaction threshold  to 0 0?

Regards
Parag


Re: Disabling compaction

Posted by Marcus Eriksson <kr...@gmail.com>.
what version are you on?

On Thu, Oct 9, 2014 at 10:33 PM, Parag Shah <ps...@proofpoint.com> wrote:

>  Hi all,
>
>       I am trying to disable compaction for a few select tables. Here is
> a definition of one such table:
>
>  CREATE TABLE blob_2014_12_31 (
>   blob_id uuid,
>   blob_index int,
>   blob_chunk blob,
>   PRIMARY KEY (blob_id, blob_index)
> ) WITH
>   bloom_filter_fp_chance=0.010000 AND
>   caching='KEYS_ONLY' AND
>   comment='' AND
>   dclocal_read_repair_chance=0.000000 AND
>   gc_grace_seconds=864000 AND
>   index_interval=128 AND
>   read_repair_chance=0.100000 AND
>   replicate_on_write='true' AND
>   populate_io_cache_on_flush='false' AND
>   default_time_to_live=0 AND
>   speculative_retry='99.0PERCENTILE' AND
>   memtable_flush_period_in_ms=0 AND
>   compaction={'enabled': 'false', 'class': 'SizeTieredCompactionStrategy'}
> AND
>   compression={'sstable_compression': 'LZ4Compressor’};
>
>  I have set compaction ‘enabled’ : ‘false’ on the above table.
>
>  However, I do see compactions being run for this node:
>
>  -bash-3.2$ nodetool compactionstats
> pending tasks: 55
>           compaction type        keyspace           table       completed
>           total      unit  progress
>                Compaction ids_high_awslab blob_2014_11_15     18122816990
>     35814893020     bytes    50.60%
>                Compaction ids_high_awslab blob_2014_12_31     18576750966
>     34242866468     bytes    54.25%
>                Compaction ids_high_awslab blob_2014_12_15     19213914904
>     35956698600     bytes    53.44%
> Active compaction remaining time :   0h49m46s
>
>  Can you someone tell me why this is happening? Do I need to set the
> compaction threshold  to 0 0?
>
>  Regards
> Parag
>