You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jeffrey Damick (JIRA)" <ji...@apache.org> on 2011/02/01 05:28:30 UTC
[jira] Created: (CASSANDRA-2086) array index out of bounds on
compact & repair
array index out of bounds on compact & repair
---------------------------------------------
Key: CASSANDRA-2086
URL: https://issues.apache.org/jira/browse/CASSANDRA-2086
Project: Cassandra
Issue Type: Bug
Affects Versions: 0.7.0
Reporter: Jeffrey Damick
Priority: Critical
We're seeing array index out of bounds exceptions (below) on 0.7.0 when running compact.
The repair seems to hang indefinitely on all nodes (also throws index oob).
On 1 node in our cluster (running compact):
INFO [CompactionExecutor:1] 2011-01-31 20:07:12,140 CompactionManager.java (line 272) Compacting [org.apache.cassandra.io.sstable.SSTableReader(path='/var/lib/cassandra/data/xxxxxxxx/XXXXXXX-e-318-Data.db'),org.apache.cassandra.io.sstable.SSTableReader(path='/var/lib/cassandra/data/xxxxxxxxxxx/xxxxxxxxxxx-e-317-Data.db')]
ERROR [CompactionExecutor:1] 2011-01-31 20:07:12,295 AbstractCassandraDaemon.java (line 91) Fatal exception in thread Thread[CompactionExecutor:1,1,main]
java.lang.ArrayIndexOutOfBoundsException: 7
at org.apache.cassandra.db.marshal.TimeUUIDType.compareTimestampBytes(TimeUUIDType.java:58)
at org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:45)
at org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:29)
at java.util.concurrent.ConcurrentSkipListMap$ComparableUsingComparator.compareTo(Unknown Source)
at java.util.concurrent.ConcurrentSkipListMap.doPut(Unknown Source)
at java.util.concurrent.ConcurrentSkipListMap.putIfAbsent(Unknown Source)
And another node (running compact):
INFO [StreamStage:1] 2011-01-31 20:03:48,663 StreamOutSession.java (line 174) Streaming to /xxx.xxx.xxx.xxx
ERROR [CompactionExecutor:1] 2011-01-31 20:03:52,587 AbstractCassandraDaemon.java (line 91) Fatal exception in thread Thread[CompactionExecutor:1,1,main]
java.lang.ArrayIndexOutOfBoundsException
ERROR [CompactionExecutor:1] 2011-01-31 20:03:54,216 AbstractCassandraDaemon.java (line 91) Fatal exception in thread Thread[CompactionExecutor:1,1,main]
java.lang.ArrayIndexOutOfBoundsException: 6
at org.apache.cassandra.db.marshal.TimeUUIDType.compareTimestampBytes(TimeUUIDType.java:56)
at org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:45)
at org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:29)
at java.util.concurrent.ConcurrentSkipListMap$ComparableUsingComparator.compareTo(Unknown Source)
at java.util.concurrent.ConcurrentSkipListMap.doPut(Unknown Source)
at java.util.concurrent.ConcurrentSkipListMap.putIfAbsent(Unknown Source)
at org.apache.cassandra.db.ColumnFamily.addColumn(ColumnFamily.java:218)
Is this related to: CASSANDRA-1959 or CASSANDRA-1992?
This has left some of my data in an unrecoverable & inaccessible state - how can i repair this situation?
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (CASSANDRA-2086) array index out of bounds on
compact & repair
Posted by "Brandon Williams (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12989258#comment-12989258 ]
Brandon Williams commented on CASSANDRA-2086:
---------------------------------------------
If the node has never successfully compacted after streaming, a simple reboot will work.
> array index out of bounds on compact & repair
> ---------------------------------------------
>
> Key: CASSANDRA-2086
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2086
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: Jeffrey Damick
> Priority: Critical
>
> We're seeing array index out of bounds exceptions (below) on 0.7.0 when running compact.
>
> The repair seems to hang indefinitely on all nodes (also throws index oob).
> On 1 node in our cluster (running compact):
> INFO [CompactionExecutor:1] 2011-01-31 20:07:12,140 CompactionManager.java (line 272) Compacting [org.apache.cassandra.io.sstable.SSTableReader(path='/var/lib/cassandra/data/xxxxxxxx/XXXXXXX-e-318-Data.db'),org.apache.cassandra.io.sstable.SSTableReader(path='/var/lib/cassandra/data/xxxxxxxxxxx/xxxxxxxxxxx-e-317-Data.db')]
> ERROR [CompactionExecutor:1] 2011-01-31 20:07:12,295 AbstractCassandraDaemon.java (line 91) Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.lang.ArrayIndexOutOfBoundsException: 7
> at org.apache.cassandra.db.marshal.TimeUUIDType.compareTimestampBytes(TimeUUIDType.java:58)
> at org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:45)
> at org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:29)
> at java.util.concurrent.ConcurrentSkipListMap$ComparableUsingComparator.compareTo(Unknown Source)
> at java.util.concurrent.ConcurrentSkipListMap.doPut(Unknown Source)
> at java.util.concurrent.ConcurrentSkipListMap.putIfAbsent(Unknown Source)
> And another node (running compact):
> INFO [StreamStage:1] 2011-01-31 20:03:48,663 StreamOutSession.java (line 174) Streaming to /xxx.xxx.xxx.xxx
> ERROR [CompactionExecutor:1] 2011-01-31 20:03:52,587 AbstractCassandraDaemon.java (line 91) Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.lang.ArrayIndexOutOfBoundsException
> ERROR [CompactionExecutor:1] 2011-01-31 20:03:54,216 AbstractCassandraDaemon.java (line 91) Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.lang.ArrayIndexOutOfBoundsException: 6
> at org.apache.cassandra.db.marshal.TimeUUIDType.compareTimestampBytes(TimeUUIDType.java:56)
> at org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:45)
> at org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:29)
> at java.util.concurrent.ConcurrentSkipListMap$ComparableUsingComparator.compareTo(Unknown Source)
> at java.util.concurrent.ConcurrentSkipListMap.doPut(Unknown Source)
> at java.util.concurrent.ConcurrentSkipListMap.putIfAbsent(Unknown Source)
> at org.apache.cassandra.db.ColumnFamily.addColumn(ColumnFamily.java:218)
> Is this related to: CASSANDRA-1959 or CASSANDRA-1992?
> This has left some of my data in an unrecoverable & inaccessible state - how can i repair this situation?
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Resolved: (CASSANDRA-2086) array index out of bounds on
compact & repair
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis resolved CASSANDRA-2086.
---------------------------------------
Resolution: Duplicate
this is CASSANDRA-1992.
> array index out of bounds on compact & repair
> ---------------------------------------------
>
> Key: CASSANDRA-2086
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2086
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: Jeffrey Damick
> Priority: Critical
>
> We're seeing array index out of bounds exceptions (below) on 0.7.0 when running compact.
>
> The repair seems to hang indefinitely on all nodes (also throws index oob).
> On 1 node in our cluster (running compact):
> INFO [CompactionExecutor:1] 2011-01-31 20:07:12,140 CompactionManager.java (line 272) Compacting [org.apache.cassandra.io.sstable.SSTableReader(path='/var/lib/cassandra/data/xxxxxxxx/XXXXXXX-e-318-Data.db'),org.apache.cassandra.io.sstable.SSTableReader(path='/var/lib/cassandra/data/xxxxxxxxxxx/xxxxxxxxxxx-e-317-Data.db')]
> ERROR [CompactionExecutor:1] 2011-01-31 20:07:12,295 AbstractCassandraDaemon.java (line 91) Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.lang.ArrayIndexOutOfBoundsException: 7
> at org.apache.cassandra.db.marshal.TimeUUIDType.compareTimestampBytes(TimeUUIDType.java:58)
> at org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:45)
> at org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:29)
> at java.util.concurrent.ConcurrentSkipListMap$ComparableUsingComparator.compareTo(Unknown Source)
> at java.util.concurrent.ConcurrentSkipListMap.doPut(Unknown Source)
> at java.util.concurrent.ConcurrentSkipListMap.putIfAbsent(Unknown Source)
> And another node (running compact):
> INFO [StreamStage:1] 2011-01-31 20:03:48,663 StreamOutSession.java (line 174) Streaming to /xxx.xxx.xxx.xxx
> ERROR [CompactionExecutor:1] 2011-01-31 20:03:52,587 AbstractCassandraDaemon.java (line 91) Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.lang.ArrayIndexOutOfBoundsException
> ERROR [CompactionExecutor:1] 2011-01-31 20:03:54,216 AbstractCassandraDaemon.java (line 91) Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.lang.ArrayIndexOutOfBoundsException: 6
> at org.apache.cassandra.db.marshal.TimeUUIDType.compareTimestampBytes(TimeUUIDType.java:56)
> at org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:45)
> at org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:29)
> at java.util.concurrent.ConcurrentSkipListMap$ComparableUsingComparator.compareTo(Unknown Source)
> at java.util.concurrent.ConcurrentSkipListMap.doPut(Unknown Source)
> at java.util.concurrent.ConcurrentSkipListMap.putIfAbsent(Unknown Source)
> at org.apache.cassandra.db.ColumnFamily.addColumn(ColumnFamily.java:218)
> Is this related to: CASSANDRA-1959 or CASSANDRA-1992?
> This has left some of my data in an unrecoverable & inaccessible state - how can i repair this situation?
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (CASSANDRA-2086) array index out of bounds on
compact & repair
Posted by "Jeffrey Damick (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12989035#comment-12989035 ]
Jeffrey Damick commented on CASSANDRA-2086:
-------------------------------------------
but is there is any way to repair the problem without deleting all of my data?
> array index out of bounds on compact & repair
> ---------------------------------------------
>
> Key: CASSANDRA-2086
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2086
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: Jeffrey Damick
> Priority: Critical
>
> We're seeing array index out of bounds exceptions (below) on 0.7.0 when running compact.
>
> The repair seems to hang indefinitely on all nodes (also throws index oob).
> On 1 node in our cluster (running compact):
> INFO [CompactionExecutor:1] 2011-01-31 20:07:12,140 CompactionManager.java (line 272) Compacting [org.apache.cassandra.io.sstable.SSTableReader(path='/var/lib/cassandra/data/xxxxxxxx/XXXXXXX-e-318-Data.db'),org.apache.cassandra.io.sstable.SSTableReader(path='/var/lib/cassandra/data/xxxxxxxxxxx/xxxxxxxxxxx-e-317-Data.db')]
> ERROR [CompactionExecutor:1] 2011-01-31 20:07:12,295 AbstractCassandraDaemon.java (line 91) Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.lang.ArrayIndexOutOfBoundsException: 7
> at org.apache.cassandra.db.marshal.TimeUUIDType.compareTimestampBytes(TimeUUIDType.java:58)
> at org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:45)
> at org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:29)
> at java.util.concurrent.ConcurrentSkipListMap$ComparableUsingComparator.compareTo(Unknown Source)
> at java.util.concurrent.ConcurrentSkipListMap.doPut(Unknown Source)
> at java.util.concurrent.ConcurrentSkipListMap.putIfAbsent(Unknown Source)
> And another node (running compact):
> INFO [StreamStage:1] 2011-01-31 20:03:48,663 StreamOutSession.java (line 174) Streaming to /xxx.xxx.xxx.xxx
> ERROR [CompactionExecutor:1] 2011-01-31 20:03:52,587 AbstractCassandraDaemon.java (line 91) Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.lang.ArrayIndexOutOfBoundsException
> ERROR [CompactionExecutor:1] 2011-01-31 20:03:54,216 AbstractCassandraDaemon.java (line 91) Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.lang.ArrayIndexOutOfBoundsException: 6
> at org.apache.cassandra.db.marshal.TimeUUIDType.compareTimestampBytes(TimeUUIDType.java:56)
> at org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:45)
> at org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:29)
> at java.util.concurrent.ConcurrentSkipListMap$ComparableUsingComparator.compareTo(Unknown Source)
> at java.util.concurrent.ConcurrentSkipListMap.doPut(Unknown Source)
> at java.util.concurrent.ConcurrentSkipListMap.putIfAbsent(Unknown Source)
> at org.apache.cassandra.db.ColumnFamily.addColumn(ColumnFamily.java:218)
> Is this related to: CASSANDRA-1959 or CASSANDRA-1992?
> This has left some of my data in an unrecoverable & inaccessible state - how can i repair this situation?
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira