You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Dwight Smith <Dw...@alcatel-lucent.com> on 2010/08/31 22:04:18 UTC

Question regarding tombstone removal on 0.6.4

Hi

 

I am running a three node cluster, everything works as expected.   After
running my application for ~60K iterations, I stopped the application,
then performed 

Nodetool flush on my Keyspace, the a nodetool compact, repeating this
for each node in the cluster.

 

Then I exported with sstabletojson on one of my CFs and  upon examining
the json - all the entries had the tombstone flag true.

 

This is correct, since all the application processes completed
correctly, and the entries should be removed.

 

Now for the question:  I understood that a nodetool compact would cause
the tombstone entries to be removed, is this true?

 

Thanks


					
-------------------------------------------------------------------------------------------------------------------
CONFIDENTIALITY NOTICE: This e-mail and any files attached may contain confidential and proprietary information of Alcatel-Lucent and/or its affiliated entities. Access by the intended recipient only is authorized. Any liability arising from any party acting, or refraining from acting, on any information contained in this e-mail is hereby excluded. If you are not the intended recipient, please notify the sender immediately, destroy the original transmission and its attachments and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Copyright in this e-mail and any attachments belongs to Alcatel-Lucent and/or its affiliated entities.
					

Re: Question regarding tombstone removal on 0.6.4

Posted by Edward Capriolo <ed...@gmail.com>.
On Tue, Aug 31, 2010 at 4:06 PM, Jonathan Ellis <jb...@gmail.com> wrote:
> does http://wiki.apache.org/cassandra/DistributedDeletes and
> http://wiki.apache.org/cassandra/MemtableSSTable help?
>
> On Tue, Aug 31, 2010 at 3:04 PM, Dwight Smith
> <Dw...@alcatel-lucent.com> wrote:
>> Hi
>>
>>
>>
>> I am running a three node cluster, everything works as expected.   After
>> running my application for ~60K iterations, I stopped the application, then
>> performed
>>
>> Nodetool flush on my Keyspace, the a nodetool compact, repeating this for
>> each node in the cluster.
>>
>>
>>
>> Then I exported with sstabletojson on one of my CFs and  upon examining the
>> json – all the entries had the tombstone flag true.
>>
>>
>>
>> This is correct, since all the application processes completed correctly,
>> and the entries should be removed.
>>
>>
>>
>> Now for the question:  I understood that a nodetool compact would cause the
>> tombstone entries to be removed, is this true?
>>
>>
>>
>> Thanks
>>
>>
>>
>> CONFIDENTIALITY NOTICE: This e-mail and any files attached may contain
>> confidential and proprietary information of Alcatel-Lucent and/or its
>> affiliated entities. Access by the intended recipient only is authorized.
>> Any liability arising from any party acting, or refraining from acting, on
>> any information contained in this e-mail is hereby excluded. If you are not
>> the intended recipient, please notify the sender immediately, destroy the
>> original transmission and its attachments and do not disclose the contents
>> to any other person, use it for any purpose, or store or copy the
>> information in any medium. Copyright in this e-mail and any attachments
>> belongs to Alcatel-Lucent and/or its affiliated entities.
>
>
>
> --
> Jonathan Ellis
> Project Chair, Apache Cassandra
> co-founder of Riptano, the source for professional Cassandra support
> http://riptano.com
>

The tombstones have to be older then GCGracePeriod before major
compact will remove them.

RE: Question regarding tombstone removal on 0.6.4

Posted by Dwight Smith <Dw...@alcatel-lucent.com>.
Yes - very helpful - I seemed to have forgotten the grace seconds:)

-----Original Message-----
From: Jonathan Ellis [mailto:jbellis@gmail.com] 
Sent: Tuesday, August 31, 2010 1:06 PM
To: user@cassandra.apache.org
Subject: Re: Question regarding tombstone removal on 0.6.4

does http://wiki.apache.org/cassandra/DistributedDeletes and
http://wiki.apache.org/cassandra/MemtableSSTable help?

On Tue, Aug 31, 2010 at 3:04 PM, Dwight Smith
<Dw...@alcatel-lucent.com> wrote:
> Hi
>
>
>
> I am running a three node cluster, everything works as expected.   After
> running my application for ~60K iterations, I stopped the application, then
> performed
>
> Nodetool flush on my Keyspace, the a nodetool compact, repeating this for
> each node in the cluster.
>
>
>
> Then I exported with sstabletojson on one of my CFs and  upon examining the
> json - all the entries had the tombstone flag true.
>
>
>
> This is correct, since all the application processes completed correctly,
> and the entries should be removed.
>
>
>
> Now for the question:  I understood that a nodetool compact would cause the
> tombstone entries to be removed, is this true?
>
>
>
> Thanks
>
>
>
> CONFIDENTIALITY NOTICE: This e-mail and any files attached may contain
> confidential and proprietary information of Alcatel-Lucent and/or its
> affiliated entities. Access by the intended recipient only is authorized.
> Any liability arising from any party acting, or refraining from acting, on
> any information contained in this e-mail is hereby excluded. If you are not
> the intended recipient, please notify the sender immediately, destroy the
> original transmission and its attachments and do not disclose the contents
> to any other person, use it for any purpose, or store or copy the
> information in any medium. Copyright in this e-mail and any attachments
> belongs to Alcatel-Lucent and/or its affiliated entities.



-- 
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of Riptano, the source for professional Cassandra support
http://riptano.com

					
-------------------------------------------------------------------------------------------------------------------
CONFIDENTIALITY NOTICE: This e-mail and any files attached may contain confidential and proprietary information of Alcatel-Lucent and/or its affiliated entities. Access by the intended recipient only is authorized. Any liability arising from any party acting, or refraining from acting, on any information contained in this e-mail is hereby excluded. If you are not the intended recipient, please notify the sender immediately, destroy the original transmission and its attachments and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Copyright in this e-mail and any attachments belongs to Alcatel-Lucent and/or its affiliated entities.
					

Re: Question regarding tombstone removal on 0.6.4

Posted by Jonathan Ellis <jb...@gmail.com>.
does http://wiki.apache.org/cassandra/DistributedDeletes and
http://wiki.apache.org/cassandra/MemtableSSTable help?

On Tue, Aug 31, 2010 at 3:04 PM, Dwight Smith
<Dw...@alcatel-lucent.com> wrote:
> Hi
>
>
>
> I am running a three node cluster, everything works as expected.   After
> running my application for ~60K iterations, I stopped the application, then
> performed
>
> Nodetool flush on my Keyspace, the a nodetool compact, repeating this for
> each node in the cluster.
>
>
>
> Then I exported with sstabletojson on one of my CFs and  upon examining the
> json – all the entries had the tombstone flag true.
>
>
>
> This is correct, since all the application processes completed correctly,
> and the entries should be removed.
>
>
>
> Now for the question:  I understood that a nodetool compact would cause the
> tombstone entries to be removed, is this true?
>
>
>
> Thanks
>
>
>
> CONFIDENTIALITY NOTICE: This e-mail and any files attached may contain
> confidential and proprietary information of Alcatel-Lucent and/or its
> affiliated entities. Access by the intended recipient only is authorized.
> Any liability arising from any party acting, or refraining from acting, on
> any information contained in this e-mail is hereby excluded. If you are not
> the intended recipient, please notify the sender immediately, destroy the
> original transmission and its attachments and do not disclose the contents
> to any other person, use it for any purpose, or store or copy the
> information in any medium. Copyright in this e-mail and any attachments
> belongs to Alcatel-Lucent and/or its affiliated entities.



-- 
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of Riptano, the source for professional Cassandra support
http://riptano.com