You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by "Hiller, Dean" <De...@nrel.gov> on 2013/03/14 15:44:41 UTC

13k pending compaction tasks but ZERO running?

How do I get my node to run through the 13k pending compaction tasks?  I had to use iptables to take the ring out of the cluster for now and he is my only node still on STCS.  In cassandra-cli, it shows LCS but on disk, I see a 36Gig file(ie. Must be STCS still).  How can I get the 13k pending tasks to start running?

Nodetool compactionstats ….
pending tasks: 13793
Active compaction remaining time :        n/a

Thanks,
Dean

Re: 13k pending compaction tasks but ZERO running?

Posted by Michael Theroux <mt...@yahoo.com>.
One more warning (which I'm sure you know, but in case others see this), nodetool compact does a major compaction for STS, and is in general, not recommended for STS.  I only ran it on the tables we've converted to LCS.

-Mike

On Mar 14, 2013, at 11:26 AM, Michael Theroux wrote:

> Hi Dean,
> 
> I saw the same behavior when we switched from STCS to LCS on a couple of our tables.  Not sure why it doesn't proceed immediately (I pinged the list, but didn't get any feedback).  However, running nodetool compact <keyspace> <table> got things moving for me.
> 
> -Mike
> 
> On Mar 14, 2013, at 10:44 AM, Hiller, Dean wrote:
> 
>> How do I get my node to run through the 13k pending compaction tasks?  I had to use iptables to take the ring out of the cluster for now and he is my only node still on STCS.  In cassandra-cli, it shows LCS but on disk, I see a 36Gig file(ie. Must be STCS still).  How can I get the 13k pending tasks to start running?
>> 
>> Nodetool compactionstats ….
>> pending tasks: 13793
>> Active compaction remaining time :        n/a
>> 
>> Thanks,
>> Dean
> 


Re: 13k pending compaction tasks but ZERO running?

Posted by "Hiller, Dean" <De...@nrel.gov>.
Duh me.  I forgot to mention I ran "nodetool compact <k> <cf>" and it was
done in 45 seconds and I still had a 36G file(darn, I am usually better
about putting the detail in my emailsŠI thought I added that).  I also
went into JMX and then did it there.

I ran it again and it took 15 seconds.  My script is as follows so that I
know the timesŠit's too bad nodetool doesn't log times for all tools they
have.  If I have time, I should just do a pull request on that.

#!/bin/bash

date > compacttimes.txt
nodetool compact databus5 nreldata >> compacttimes.txt
date >> compacttimes.txt


Thanks,
Dean

On 3/14/13 9:26 AM, "Michael Theroux" <mt...@yahoo.com> wrote:

>Hi Dean,
>
>I saw the same behavior when we switched from STCS to LCS on a couple of
>our tables.  Not sure why it doesn't proceed immediately (I pinged the
>list, but didn't get any feedback).  However, running nodetool compact
><keyspace> <table> got things moving for me.
>
>-Mike
>
>On Mar 14, 2013, at 10:44 AM, Hiller, Dean wrote:
>
>> How do I get my node to run through the 13k pending compaction tasks?
>>I had to use iptables to take the ring out of the cluster for now and he
>>is my only node still on STCS.  In cassandra-cli, it shows LCS but on
>>disk, I see a 36Gig file(ie. Must be STCS still).  How can I get the 13k
>>pending tasks to start running?
>> 
>> Nodetool compactionstats Š.
>> pending tasks: 13793
>> Active compaction remaining time :        n/a
>> 
>> Thanks,
>> Dean
>


Re: 13k pending compaction tasks but ZERO running?

Posted by Michael Theroux <mt...@yahoo.com>.
Hi Dean,

I saw the same behavior when we switched from STCS to LCS on a couple of our tables.  Not sure why it doesn't proceed immediately (I pinged the list, but didn't get any feedback).  However, running nodetool compact <keyspace> <table> got things moving for me.

-Mike

On Mar 14, 2013, at 10:44 AM, Hiller, Dean wrote:

> How do I get my node to run through the 13k pending compaction tasks?  I had to use iptables to take the ring out of the cluster for now and he is my only node still on STCS.  In cassandra-cli, it shows LCS but on disk, I see a 36Gig file(ie. Must be STCS still).  How can I get the 13k pending tasks to start running?
> 
> Nodetool compactionstats ….
> pending tasks: 13793
> Active compaction remaining time :        n/a
> 
> Thanks,
> Dean