You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Joaquin Casares (Created) (JIRA)" <ji...@apache.org> on 2012/03/23 01:34:22 UTC

[jira] [Created] (CASSANDRA-4075) Dropped keyspaces and cfs do not get deleted

Dropped keyspaces and cfs do not get deleted
--------------------------------------------

                 Key: CASSANDRA-4075
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4075
             Project: Cassandra
          Issue Type: Bug
    Affects Versions: 0.8.1
            Reporter: Joaquin Casares


Tested in 0.8.10, reported in 0.8.1.

Dropped keyspaces and column families have their sstables marked as Compacted, but will not disappear, even on restart. 

Worked correctly in 1.0.8 where the sstables get deleted almost immediately following the column family drop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-4075) Dropped keyspaces and cfs do not get deleted

Posted by "sunjian (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421193#comment-13421193 ] 

sunjian commented on CASSANDRA-4075:
------------------------------------

this issues exists in 1.1.2 as well . keyspace and column family can't to be modified when the cluster have run for a while (such as one day , with not too much data(less than 1G per node)) . nothing will be happen if some operation fire at the nodes , such as drop keyspace / create coulumn family / delete column family . BUT  add/delete/edit/query data is OK .
                
> Dropped keyspaces and cfs do not get deleted
> --------------------------------------------
>
>                 Key: CASSANDRA-4075
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4075
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.1
>            Reporter: Joaquin Casares
>              Labels: datastax_qa
>
> Tested in 0.8.10, reported in 0.8.1.
> Dropped keyspaces and column families have their sstables marked as Compacted, but will not disappear, even on restart. 
> Worked correctly in 1.0.8 where the sstables get deleted almost immediately following the column family drop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-4075) Dropped keyspaces and cfs do not get deleted

Posted by "Jonathan Ellis (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236350#comment-13236350 ] 

Jonathan Ellis commented on CASSANDRA-4075:
-------------------------------------------

The title on 2942 is misleading. As I said in my first comment there, "You should be able to reproduce this even on a single node – just drop a CF, then restart. It only cleans out marked-for-delete files from known CFs."
                
> Dropped keyspaces and cfs do not get deleted
> --------------------------------------------
>
>                 Key: CASSANDRA-4075
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4075
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.1
>            Reporter: Joaquin Casares
>            Assignee: Yuki Morishita
>              Labels: datastax_qa
>
> Tested in 0.8.10, reported in 0.8.1.
> Dropped keyspaces and column families have their sstables marked as Compacted, but will not disappear, even on restart. 
> Worked correctly in 1.0.8 where the sstables get deleted almost immediately following the column family drop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Assigned] (CASSANDRA-4075) Dropped keyspaces and cfs do not get deleted

Posted by "Jonathan Ellis (Assigned) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis reassigned CASSANDRA-4075:
-----------------------------------------

    Assignee: Yuki Morishita
    
> Dropped keyspaces and cfs do not get deleted
> --------------------------------------------
>
>                 Key: CASSANDRA-4075
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4075
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.1
>            Reporter: Joaquin Casares
>            Assignee: Yuki Morishita
>              Labels: datastax_qa
>
> Tested in 0.8.10, reported in 0.8.1.
> Dropped keyspaces and column families have their sstables marked as Compacted, but will not disappear, even on restart. 
> Worked correctly in 1.0.8 where the sstables get deleted almost immediately following the column family drop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-4075) Dropped keyspaces and cfs do not get deleted

Posted by "Ghenadii Batalski (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13402761#comment-13402761 ] 

Ghenadii Batalski commented on CASSANDRA-4075:
----------------------------------------------

I also can not drop a keyspace after some data put into it:

{code}
Connected to: "Test Cluster" on 127.0.0.1/9160
Welcome to Cassandra CLI version 1.1.1

Type 'help;' or '?' for help.
Type 'quit;' or 'exit;' to quit.

[default@unknown] drop keyspace twissjava;    
ef973fdd-96ac-346a-b2db-652176a4c222
Waiting for schema agreement...
... schemas agree across the cluster
[default@unknown] create keyspace twissjava;
Keyspace names must be case-insensitively unique ("twissjava" conflicts with "Twissjava")
[default@unknown] 
{code}
                
> Dropped keyspaces and cfs do not get deleted
> --------------------------------------------
>
>                 Key: CASSANDRA-4075
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4075
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.1
>            Reporter: Joaquin Casares
>              Labels: datastax_qa
>
> Tested in 0.8.10, reported in 0.8.1.
> Dropped keyspaces and column families have their sstables marked as Compacted, but will not disappear, even on restart. 
> Worked correctly in 1.0.8 where the sstables get deleted almost immediately following the column family drop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-4075) Dropped keyspaces and cfs do not get deleted

Posted by "Joaquin Casares (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236361#comment-13236361 ] 

Joaquin Casares commented on CASSANDRA-4075:
--------------------------------------------

Yes, it may actually be that ticket then. Sorry, I misread what you meant by single node. The patch doesn't apply cleanly on 0.8.10. I'll look at it in the morning to see if it's an easy backport. If not, can we get a backport of it to 0.8.x, particularly 0.8.1?
                
> Dropped keyspaces and cfs do not get deleted
> --------------------------------------------
>
>                 Key: CASSANDRA-4075
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4075
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.1
>            Reporter: Joaquin Casares
>            Assignee: Yuki Morishita
>              Labels: datastax_qa
>
> Tested in 0.8.10, reported in 0.8.1.
> Dropped keyspaces and column families have their sstables marked as Compacted, but will not disappear, even on restart. 
> Worked correctly in 1.0.8 where the sstables get deleted almost immediately following the column family drop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Issue Comment Edited] (CASSANDRA-4075) Dropped keyspaces and cfs do not get deleted

Posted by "Jonathan Ellis (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236598#comment-13236598 ] 

Jonathan Ellis edited comment on CASSANDRA-4075 at 3/23/12 1:52 PM:
--------------------------------------------------------------------

bq. can we get a backport of it to 0.8.x, particularly 0.8.1?

No, this isn't really back-portable since it depends on CASSANDRA-2521 which was a total rewrite of the sstable deletion code, from being based on PhantomReferences triggered by GC, to manual reference counting.

bq. just tested a full gc on both 0.8.10 and 0.8.1 after waiting rpc_timeout seconds and the sstables that were marked as compacted through the drop command did clear.

Good, that's what we'd expect then.
                
      was (Author: jbellis):
    bq. can we get a backport of it to 0.8.x, particularly 0.8.1?

No, this isn't really back-portable since it was a total rewrite of the sstable deletion code, from being based on PhantomReferences triggered by GC, to manual reference counting.

bq. just tested a full gc on both 0.8.10 and 0.8.1 after waiting rpc_timeout seconds and the sstables that were marked as compacted through the drop command did clear.

Good, that's what we'd expect then.
                  
> Dropped keyspaces and cfs do not get deleted
> --------------------------------------------
>
>                 Key: CASSANDRA-4075
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4075
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.1
>            Reporter: Joaquin Casares
>            Assignee: Yuki Morishita
>              Labels: datastax_qa
>
> Tested in 0.8.10, reported in 0.8.1.
> Dropped keyspaces and column families have their sstables marked as Compacted, but will not disappear, even on restart. 
> Worked correctly in 1.0.8 where the sstables get deleted almost immediately following the column family drop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (CASSANDRA-4075) Dropped keyspaces and cfs do not get deleted

Posted by "Jonathan Ellis (Assigned) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis reassigned CASSANDRA-4075:
-----------------------------------------

    Assignee:     (was: Yuki Morishita)
    
> Dropped keyspaces and cfs do not get deleted
> --------------------------------------------
>
>                 Key: CASSANDRA-4075
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4075
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.1
>            Reporter: Joaquin Casares
>              Labels: datastax_qa
>
> Tested in 0.8.10, reported in 0.8.1.
> Dropped keyspaces and column families have their sstables marked as Compacted, but will not disappear, even on restart. 
> Worked correctly in 1.0.8 where the sstables get deleted almost immediately following the column family drop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-4075) Dropped keyspaces and cfs do not get deleted

Posted by "Joaquin Casares (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236401#comment-13236401 ] 

Joaquin Casares commented on CASSANDRA-4075:
--------------------------------------------

Also, just tested a full gc on both 0.8.10 and 0.8.1 after waiting rpc_timeout seconds and the sstables that were marked as compacted through the drop command did clear.

GC was done by using jconsole: java.lang.Memory.gc().
                
> Dropped keyspaces and cfs do not get deleted
> --------------------------------------------
>
>                 Key: CASSANDRA-4075
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4075
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.1
>            Reporter: Joaquin Casares
>            Assignee: Yuki Morishita
>              Labels: datastax_qa
>
> Tested in 0.8.10, reported in 0.8.1.
> Dropped keyspaces and column families have their sstables marked as Compacted, but will not disappear, even on restart. 
> Worked correctly in 1.0.8 where the sstables get deleted almost immediately following the column family drop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (CASSANDRA-4075) Dropped keyspaces and cfs do not get deleted

Posted by "Joaquin Casares (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joaquin Casares updated CASSANDRA-4075:
---------------------------------------

    Labels: datastax_qa  (was: )
    
> Dropped keyspaces and cfs do not get deleted
> --------------------------------------------
>
>                 Key: CASSANDRA-4075
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4075
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.1
>            Reporter: Joaquin Casares
>              Labels: datastax_qa
>
> Tested in 0.8.10, reported in 0.8.1.
> Dropped keyspaces and column families have their sstables marked as Compacted, but will not disappear, even on restart. 
> Worked correctly in 1.0.8 where the sstables get deleted almost immediately following the column family drop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-4075) Dropped keyspaces and cfs do not get deleted

Posted by "Joaquin Casares (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236347#comment-13236347 ] 

Joaquin Casares commented on CASSANDRA-4075:
--------------------------------------------

Also, on my 0.8.10 test, at first we thought it might have been CASSANDRA-2942, but this was tested on one node built out of source.
                
> Dropped keyspaces and cfs do not get deleted
> --------------------------------------------
>
>                 Key: CASSANDRA-4075
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4075
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.1
>            Reporter: Joaquin Casares
>            Assignee: Yuki Morishita
>              Labels: datastax_qa
>
> Tested in 0.8.10, reported in 0.8.1.
> Dropped keyspaces and column families have their sstables marked as Compacted, but will not disappear, even on restart. 
> Worked correctly in 1.0.8 where the sstables get deleted almost immediately following the column family drop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-4075) Dropped keyspaces and cfs do not get deleted

Posted by "Jonathan Ellis (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236290#comment-13236290 ] 

Jonathan Ellis commented on CASSANDRA-4075:
-------------------------------------------

Isn't this just normal pre-CASSANDRA-2521 "there hasn't been a full GC so I can't delete the sstables" behavior?
                
> Dropped keyspaces and cfs do not get deleted
> --------------------------------------------
>
>                 Key: CASSANDRA-4075
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4075
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.1
>            Reporter: Joaquin Casares
>            Assignee: Yuki Morishita
>              Labels: datastax_qa
>
> Tested in 0.8.10, reported in 0.8.1.
> Dropped keyspaces and column families have their sstables marked as Compacted, but will not disappear, even on restart. 
> Worked correctly in 1.0.8 where the sstables get deleted almost immediately following the column family drop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Comment Edited] (CASSANDRA-4075) Dropped keyspaces and cfs do not get deleted

Posted by "Ghenadii Batalski (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13402761#comment-13402761 ] 

Ghenadii Batalski edited comment on CASSANDRA-4075 at 6/28/12 1:29 AM:
-----------------------------------------------------------------------

I also can not drop a keyspace after some data put into it:

{code}
Connected to: "Test Cluster" on 127.0.0.1/9160
Welcome to Cassandra CLI version 1.1.1

[default@unknown] drop keyspace twissjava;    
ef973fdd-96ac-346a-b2db-652176a4c222
Waiting for schema agreement...
... schemas agree across the cluster

[default@unknown] create keyspace twissjava;
Keyspace names must be case-insensitively unique ("twissjava" conflicts with "Twissjava")

{code}
                
      was (Author: gena):
    I also can not drop a keyspace after some data put into it:

{code}
Connected to: "Test Cluster" on 127.0.0.1/9160
Welcome to Cassandra CLI version 1.1.1

Type 'help;' or '?' for help.
Type 'quit;' or 'exit;' to quit.

[default@unknown] drop keyspace twissjava;    
ef973fdd-96ac-346a-b2db-652176a4c222
Waiting for schema agreement...
... schemas agree across the cluster
[default@unknown] create keyspace twissjava;
Keyspace names must be case-insensitively unique ("twissjava" conflicts with "Twissjava")
[default@unknown] 
{code}
                  
> Dropped keyspaces and cfs do not get deleted
> --------------------------------------------
>
>                 Key: CASSANDRA-4075
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4075
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.1
>            Reporter: Joaquin Casares
>              Labels: datastax_qa
>
> Tested in 0.8.10, reported in 0.8.1.
> Dropped keyspaces and column families have their sstables marked as Compacted, but will not disappear, even on restart. 
> Worked correctly in 1.0.8 where the sstables get deleted almost immediately following the column family drop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-4075) Dropped keyspaces and cfs do not get deleted

Posted by "Jonathan Ellis (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236598#comment-13236598 ] 

Jonathan Ellis commented on CASSANDRA-4075:
-------------------------------------------

bq. can we get a backport of it to 0.8.x, particularly 0.8.1?

No, this isn't really back-portable since it was a total rewrite of the sstable deletion code, from being based on PhantomReferences triggered by GC, to manual reference counting.

bq. just tested a full gc on both 0.8.10 and 0.8.1 after waiting rpc_timeout seconds and the sstables that were marked as compacted through the drop command did clear.

Good, that's what we'd expect then.
                
> Dropped keyspaces and cfs do not get deleted
> --------------------------------------------
>
>                 Key: CASSANDRA-4075
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4075
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.1
>            Reporter: Joaquin Casares
>            Assignee: Yuki Morishita
>              Labels: datastax_qa
>
> Tested in 0.8.10, reported in 0.8.1.
> Dropped keyspaces and column families have their sstables marked as Compacted, but will not disappear, even on restart. 
> Worked correctly in 1.0.8 where the sstables get deleted almost immediately following the column family drop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira