You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jeremy Hanna (JIRA)" <ji...@apache.org> on 2011/08/29 17:42:37 UTC
[jira] [Created] (CASSANDRA-3100) Secondary index still does minor
compacting after deleting index
Secondary index still does minor compacting after deleting index
----------------------------------------------------------------
Key: CASSANDRA-3100
URL: https://issues.apache.org/jira/browse/CASSANDRA-3100
Project: Cassandra
Issue Type: Bug
Affects Versions: 0.7.8
Reporter: Jeremy Hanna
We deleted all of our secondary indexes. A couple of days later I was watching compactionstats on one of the nodes and it was in the process of minor compacting one of the deleted secondary indexes. I double checked the keyspace definitions on the CLI and there were no secondary indexes defined.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3100) Secondary index still does
minor compacting after deleting index
Posted by "Jeremy Hanna (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13099282#comment-13099282 ]
Jeremy Hanna commented on CASSANDRA-3100:
-----------------------------------------
I'm not 100% sure - we've since moved to 0.8.4 and I haven't seen it happen again.
> Secondary index still does minor compacting after deleting index
> ----------------------------------------------------------------
>
> Key: CASSANDRA-3100
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3100
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.7.8
> Reporter: Jeremy Hanna
> Fix For: 0.7.10
>
>
> We deleted all of our secondary indexes. A couple of days later I was watching compactionstats on one of the nodes and it was in the process of minor compacting one of the deleted secondary indexes. I double checked the keyspace definitions on the CLI and there were no secondary indexes defined.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3100) Secondary index still does
minor compacting after deleting index
Posted by "Sylvain Lebresne (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13130704#comment-13130704 ]
Sylvain Lebresne commented on CASSANDRA-3100:
---------------------------------------------
I agree with the cure being worse than the disease. I think it will piss off people when they have to wait 2 hours for a simple column family update because a long compaction is running. We should at least only grab the locks when the update drops an index. Even then are we sure this is solving the problem at end? In 0.7, I'm not sure why not holding the flush/compaction locks during the index drop would trigger what is described here. In particular, as long as the schema change has succeed, a bootstrapping node shouldn't be trying to build a secondary index that isn't there.
All this being said, I think we may have a legit bug in 1.0.0, since an update of column family can drop an index which will call removeAllSSTables which doesn't work as expected if the compaction lock is not hold. But this should be fixed by CASSANDRA-3116.
> Secondary index still does minor compacting after deleting index
> ----------------------------------------------------------------
>
> Key: CASSANDRA-3100
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3100
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.7.0
> Reporter: Jeremy Hanna
> Assignee: Jonathan Ellis
> Priority: Minor
> Labels: compaction
> Fix For: 0.7.10
>
> Attachments: 3100.txt
>
>
> We deleted all of our secondary indexes. A couple of days later I was watching compactionstats on one of the nodes and it was in the process of minor compacting one of the deleted secondary indexes. I double checked the keyspace definitions on the CLI and there were no secondary indexes defined.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3100) Secondary index still does minor
compacting after deleting index
Posted by "Jonathan Ellis (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-3100:
--------------------------------------
Attachment: 3100.txt
Fix attached to take out compaction + flush locks during Update migration as well as drop.
Not sure if this is worth doing, though, or if the cure is worse than the disease (see CASSANDRA-3116).
> Secondary index still does minor compacting after deleting index
> ----------------------------------------------------------------
>
> Key: CASSANDRA-3100
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3100
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.7.0
> Reporter: Jeremy Hanna
> Labels: compaction
> Fix For: 0.7.10
>
> Attachments: 3100.txt
>
>
> We deleted all of our secondary indexes. A couple of days later I was watching compactionstats on one of the nodes and it was in the process of minor compacting one of the deleted secondary indexes. I double checked the keyspace definitions on the CLI and there were no secondary indexes defined.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3100) Secondary index still does minor
compacting after deleting index
Posted by "Jonathan Ellis (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-3100:
--------------------------------------
Reviewer: slebresne
Component/s: Core
Priority: Minor (was: Major)
Affects Version/s: (was: 0.7.8)
0.7.0
Assignee: Jonathan Ellis
Labels: compaction (was: )
> Secondary index still does minor compacting after deleting index
> ----------------------------------------------------------------
>
> Key: CASSANDRA-3100
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3100
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.7.0
> Reporter: Jeremy Hanna
> Assignee: Jonathan Ellis
> Priority: Minor
> Labels: compaction
> Fix For: 0.7.10
>
> Attachments: 3100.txt
>
>
> We deleted all of our secondary indexes. A couple of days later I was watching compactionstats on one of the nodes and it was in the process of minor compacting one of the deleted secondary indexes. I double checked the keyspace definitions on the CLI and there were no secondary indexes defined.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3100) Secondary index still does minor
compacting after deleting index
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-3100:
--------------------------------------
Fix Version/s: 0.7.9
Did restarting the node fix this?
> Secondary index still does minor compacting after deleting index
> ----------------------------------------------------------------
>
> Key: CASSANDRA-3100
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3100
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.7.8
> Reporter: Jeremy Hanna
> Fix For: 0.7.10
>
>
> We deleted all of our secondary indexes. A couple of days later I was watching compactionstats on one of the nodes and it was in the process of minor compacting one of the deleted secondary indexes. I double checked the keyspace definitions on the CLI and there were no secondary indexes defined.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3100) Secondary index still does minor
compacting after deleting index
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-3100:
--------------------------------------
Fix Version/s: (was: 0.7.9)
0.7.10
> Secondary index still does minor compacting after deleting index
> ----------------------------------------------------------------
>
> Key: CASSANDRA-3100
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3100
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.7.8
> Reporter: Jeremy Hanna
> Fix For: 0.7.10
>
>
> We deleted all of our secondary indexes. A couple of days later I was watching compactionstats on one of the nodes and it was in the process of minor compacting one of the deleted secondary indexes. I double checked the keyspace definitions on the CLI and there were no secondary indexes defined.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3100) Secondary index still does
minor compacting after deleting index
Posted by "Jeremy Hanna (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13093255#comment-13093255 ]
Jeremy Hanna commented on CASSANDRA-3100:
-----------------------------------------
Also relevant, when bootstrapping a new node into the ring, it streamed data from a node and in the compactionstats I also see it's trying to build a secondary index that shouldn't be there.
> Secondary index still does minor compacting after deleting index
> ----------------------------------------------------------------
>
> Key: CASSANDRA-3100
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3100
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.7.8
> Reporter: Jeremy Hanna
>
> We deleted all of our secondary indexes. A couple of days later I was watching compactionstats on one of the nodes and it was in the process of minor compacting one of the deleted secondary indexes. I double checked the keyspace definitions on the CLI and there were no secondary indexes defined.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira