You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Taras Puchko (JIRA)" <ji...@apache.org> on 2011/07/29 14:01:10 UTC
[jira] [Created] (CASSANDRA-2968) AssertionError during compaction
of CF with counter columns
AssertionError during compaction of CF with counter columns
-----------------------------------------------------------
Key: CASSANDRA-2968
URL: https://issues.apache.org/jira/browse/CASSANDRA-2968
Project: Cassandra
Issue Type: Bug
Affects Versions: 0.8.2
Environment: CentOS release 5.6
Reporter: Taras Puchko
Having upgraded from 0.8.0 to 0.8.2 we ran nodetool compact and got
Error occured during compaction
java.util.concurrent.ExecutionException: java.lang.AssertionError
at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
at java.util.concurrent.FutureTask.get(FutureTask.java:83)
at org.apache.cassandra.db.compaction.CompactionManager.performMajor(CompactionManager.java:277)
at org.apache.cassandra.db.ColumnFamilyStore.forceMajorCompaction(ColumnFamilyStore.java:1762)
at org.apache.cassandra.service.StorageService.forceTableCompaction(StorageService.java:1358)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93)
at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27)
at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)
at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)
at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360)
at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
at sun.rmi.transport.Transport$1.run(Transport.java:159)
at java.security.AccessController.doPrivileged(Native Method)
at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.AssertionError
at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:123)
at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:43)
at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
at org.apache.cassandra.db.compaction.CompactionManager.doCompactionWithoutSizeEstimation(CompactionManager.java:569)
at org.apache.cassandra.db.compaction.CompactionManager.doCompaction(CompactionManager.java:506)
at org.apache.cassandra.db.compaction.CompactionManager$4.call(CompactionManager.java:319)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
... 3 more
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2968) AssertionError during
compaction of CF with counter columns
Posted by "Andriy Denysenko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13073217#comment-13073217 ]
Andriy Denysenko commented on CASSANDRA-2968:
---------------------------------------------
yes, sstable likely corrupted but by which code? 0.8.0 or 0.8.2?
sstable2json AffiliateActivity-g-195-Data.db
(first row is parsed ok, second has state.getCount()==state.getClock())
....
"00000000019d499f": [["clicks","000100012335e4a0b2c911e000006bb62b336af7000000000000285c000000000000285c23d44780b2c911e00000f03fd2ec87ff0000000000000002000000000000000225188750b
2c911e0000058b7809d76ff00000000000000690000000000000069",1311664683623,"c",-9223372036854775808]],
"0000000000748b45": [["clicks","000100012335e4a0b2c911e000006bb62b336af78143c702fe516b748143c702fe516b7423d44780b2c911e00000f03fd2ec87ff000000000000b3c0000000000000b3c025188750b
2c911e0000058b7809d76fff082e59147f68e9cf082e59147f68e9c",1311665756252,"c",-9223372036854775808]],
....
cassandra-cli:
get AffiliateActivity[27085215];
=> (counter=clicks, value=10439) - reasonable value
get AffiliateActivity[7637829];
=> (counter=clicks, value=8198429924508872144) - nonsense value
> AssertionError during compaction of CF with counter columns
> -----------------------------------------------------------
>
> Key: CASSANDRA-2968
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2968
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8.2
> Environment: CentOS release 5.6
> Reporter: Taras Puchko
> Attachments: AffiliateActivity-g-195-Data.db, AffiliateActivity-g-195-Index.db
>
>
> Having upgraded from 0.8.0 to 0.8.2 we ran nodetool compact and got
> Error occured during compaction
> java.util.concurrent.ExecutionException: java.lang.AssertionError
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at org.apache.cassandra.db.compaction.CompactionManager.performMajor(CompactionManager.java:277)
> at org.apache.cassandra.db.ColumnFamilyStore.forceMajorCompaction(ColumnFamilyStore.java:1762)
> at org.apache.cassandra.service.StorageService.forceTableCompaction(StorageService.java:1358)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27)
> at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)
> at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)
> at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)
> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
> at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
> at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
> at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
> at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
> at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360)
> at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
> at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
> at sun.rmi.transport.Transport$1.run(Transport.java:159)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
> at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.AssertionError
> at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:123)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:43)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompactionWithoutSizeEstimation(CompactionManager.java:569)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompaction(CompactionManager.java:506)
> at org.apache.cassandra.db.compaction.CompactionManager$4.call(CompactionManager.java:319)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> ... 3 more
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2968) AssertionError during compaction
of CF with counter columns
Posted by "Sylvain Lebresne (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sylvain Lebresne updated CASSANDRA-2968:
----------------------------------------
Attachment: 2968.patch
This is actually a pretty stupid bug (not that there is smart bug): the old NodeId for the local node were read from the system table in reversed order while they shouldn't. The wrong path was then taken based on that mistake. No data was lost due to that (i.e, the total value of the counters is preserved), but non-sensical counter context were created (hence triggering the assertion).
Fixing the root cause is pretty straightforward. Fixing the nonsensical counter contexts is more subtle, but it is doable up to the fact that the local NodeId on the node(s) where the assertion is triggered will have to be renewed. Attaching a patch that does both (fixing root cause and repairing the bad data). Also add two unit tests, one for the root cause and one to check that the bad data repair code does what it is supposed to do.
After applying that patch (or upgrading on a release shipping it), you will (potentially) need to restart the node with the -Dcassandra.renew_counter_id=true (compaction will still fail if you don't but with a message saying that you should restart with the startup flag).
> AssertionError during compaction of CF with counter columns
> -----------------------------------------------------------
>
> Key: CASSANDRA-2968
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2968
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8.2
> Environment: CentOS release 5.6
> Reporter: Taras Puchko
> Assignee: Sylvain Lebresne
> Fix For: 0.8.3
>
> Attachments: 2968.patch, AffiliateActivity-g-147-Data.db, AffiliateActivity-g-147-Index.db, AffiliateActivity-g-195-Data.db, AffiliateActivity-g-195-Index.db
>
>
> Having upgraded from 0.8.0 to 0.8.2 we ran nodetool compact and got
> Error occured during compaction
> java.util.concurrent.ExecutionException: java.lang.AssertionError
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at org.apache.cassandra.db.compaction.CompactionManager.performMajor(CompactionManager.java:277)
> at org.apache.cassandra.db.ColumnFamilyStore.forceMajorCompaction(ColumnFamilyStore.java:1762)
> at org.apache.cassandra.service.StorageService.forceTableCompaction(StorageService.java:1358)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27)
> at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)
> at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)
> at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)
> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
> at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
> at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
> at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
> at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
> at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360)
> at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
> at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
> at sun.rmi.transport.Transport$1.run(Transport.java:159)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
> at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.AssertionError
> at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:123)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:43)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompactionWithoutSizeEstimation(CompactionManager.java:569)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompaction(CompactionManager.java:506)
> at org.apache.cassandra.db.compaction.CompactionManager$4.call(CompactionManager.java:319)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> ... 3 more
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2968) AssertionError during
compaction of CF with counter columns
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13076300#comment-13076300 ]
Hudson commented on CASSANDRA-2968:
-----------------------------------
Integrated in Cassandra-0.8 #252 (See [https://builds.apache.org/job/Cassandra-0.8/252/])
Fix assertion error during compaction of counter CFs
patch by slebresne; reviewed by jbellis for CASSANDRA-2968
slebresne : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1153156
Files :
* /cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/db/compaction/LazilyCompactedRow.java
* /cassandra/branches/cassandra-0.8/test/unit/org/apache/cassandra/SchemaLoader.java
* /cassandra/branches/cassandra-0.8/CHANGES.txt
* /cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/db/SystemTable.java
* /cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/utils/NodeId.java
* /cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/db/context/CounterContext.java
* /cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/db/compaction/PrecompactedRow.java
* /cassandra/branches/cassandra-0.8/test/unit/org/apache/cassandra/db/CounterMutationTest.java
> AssertionError during compaction of CF with counter columns
> -----------------------------------------------------------
>
> Key: CASSANDRA-2968
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2968
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8.2
> Environment: CentOS release 5.6
> Reporter: Taras Puchko
> Assignee: Sylvain Lebresne
> Fix For: 0.8.3
>
> Attachments: 2968.patch, AffiliateActivity-g-147-Data.db, AffiliateActivity-g-147-Index.db, AffiliateActivity-g-195-Data.db, AffiliateActivity-g-195-Index.db
>
>
> Having upgraded from 0.8.0 to 0.8.2 we ran nodetool compact and got
> Error occured during compaction
> java.util.concurrent.ExecutionException: java.lang.AssertionError
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at org.apache.cassandra.db.compaction.CompactionManager.performMajor(CompactionManager.java:277)
> at org.apache.cassandra.db.ColumnFamilyStore.forceMajorCompaction(ColumnFamilyStore.java:1762)
> at org.apache.cassandra.service.StorageService.forceTableCompaction(StorageService.java:1358)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27)
> at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)
> at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)
> at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)
> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
> at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
> at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
> at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
> at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
> at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360)
> at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
> at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
> at sun.rmi.transport.Transport$1.run(Transport.java:159)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
> at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.AssertionError
> at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:123)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:43)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompactionWithoutSizeEstimation(CompactionManager.java:569)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompaction(CompactionManager.java:506)
> at org.apache.cassandra.db.compaction.CompactionManager$4.call(CompactionManager.java:319)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> ... 3 more
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (CASSANDRA-2968) AssertionError
during compaction of CF with counter columns
Posted by "Andriy Denysenko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13073170#comment-13073170 ]
Andriy Denysenko edited comment on CASSANDRA-2968 at 7/30/11 1:21 PM:
----------------------------------------------------------------------
Reproducible test case for this bug:
create column family AffiliateActivity with default_validation_class=CounterColumnType
and key_validation_class=LongType and comparator=AsciiType
and memtable_throughput=30
and memtable_operations=0.5
and replicate_on_write=true;
put AffiliateActivity-g-195-Data.db and AffiliateActivity-g-195-Index.db(attached) into cassandra data directory for some keyspace and run nodetool scrub
Those AffiliateActivity-g-195 data files were originally created with cassandra 0.8
java.io.IOError: java.lang.AssertionError
at org.apache.cassandra.db.compaction.CompactionManager.scrubOne(CompactionManager.java:775)
at org.apache.cassandra.db.compaction.CompactionManager.doScrub(CompactionManager.java:631)
at org.apache.cassandra.db.compaction.CompactionManager.access$600(CompactionManager.java:65)
at org.apache.cassandra.db.compaction.CompactionManager$3.call(CompactionManager.java:251)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
Caused by: java.lang.AssertionError
at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:146)
at org.apache.cassandra.db.compaction.CompactionManager.scrubOne(CompactionManager.java:719)
... 8 more
was (Author: andrden):
Reproducible test case for this bug:
create column family AffiliateActivity with default_validation_class=CounterColumnType
and key_validation_class=LongType and comparator=AsciiType
and memtable_throughput=30
and memtable_operations=0.5
and replicate_on_write=true;
put AffiliateActivity-g-195-Data.db and AffiliateActivity-g-195-Index.db into cassandra data directory for some keyspace and run nodetool scrub
Those AffiliateActivity-g-195 data files were originally created with cassandra 0.8
java.io.IOError: java.lang.AssertionError
at org.apache.cassandra.db.compaction.CompactionManager.scrubOne(CompactionManager.java:775)
at org.apache.cassandra.db.compaction.CompactionManager.doScrub(CompactionManager.java:631)
at org.apache.cassandra.db.compaction.CompactionManager.access$600(CompactionManager.java:65)
at org.apache.cassandra.db.compaction.CompactionManager$3.call(CompactionManager.java:251)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
Caused by: java.lang.AssertionError
at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:146)
at org.apache.cassandra.db.compaction.CompactionManager.scrubOne(CompactionManager.java:719)
... 8 more
> AssertionError during compaction of CF with counter columns
> -----------------------------------------------------------
>
> Key: CASSANDRA-2968
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2968
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8.2
> Environment: CentOS release 5.6
> Reporter: Taras Puchko
> Attachments: AffiliateActivity-g-195-Data.db, AffiliateActivity-g-195-Index.db
>
>
> Having upgraded from 0.8.0 to 0.8.2 we ran nodetool compact and got
> Error occured during compaction
> java.util.concurrent.ExecutionException: java.lang.AssertionError
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at org.apache.cassandra.db.compaction.CompactionManager.performMajor(CompactionManager.java:277)
> at org.apache.cassandra.db.ColumnFamilyStore.forceMajorCompaction(ColumnFamilyStore.java:1762)
> at org.apache.cassandra.service.StorageService.forceTableCompaction(StorageService.java:1358)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27)
> at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)
> at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)
> at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)
> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
> at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
> at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
> at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
> at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
> at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360)
> at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
> at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
> at sun.rmi.transport.Transport$1.run(Transport.java:159)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
> at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.AssertionError
> at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:123)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:43)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompactionWithoutSizeEstimation(CompactionManager.java:569)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompaction(CompactionManager.java:506)
> at org.apache.cassandra.db.compaction.CompactionManager$4.call(CompactionManager.java:319)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> ... 3 more
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (CASSANDRA-2968) AssertionError
during compaction of CF with counter columns
Posted by "Andriy Denysenko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13073170#comment-13073170 ]
Andriy Denysenko edited comment on CASSANDRA-2968 at 7/30/11 1:22 PM:
----------------------------------------------------------------------
Reproducible test case for this bug:
create column family AffiliateActivity with default_validation_class=CounterColumnType
and key_validation_class=LongType and comparator=AsciiType
and memtable_throughput=30
and memtable_operations=0.5
and replicate_on_write=true;
put AffiliateActivity-g-195-Data.db and AffiliateActivity-g-195-Index.db (attached) into cassandra 0.8.2 data directory for some keyspace, then run cassandra server to open the files and run nodetool scrub
Those AffiliateActivity-g-195 data files were originally created with cassandra 0.8
java.io.IOError: java.lang.AssertionError
at org.apache.cassandra.db.compaction.CompactionManager.scrubOne(CompactionManager.java:775)
at org.apache.cassandra.db.compaction.CompactionManager.doScrub(CompactionManager.java:631)
at org.apache.cassandra.db.compaction.CompactionManager.access$600(CompactionManager.java:65)
at org.apache.cassandra.db.compaction.CompactionManager$3.call(CompactionManager.java:251)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
Caused by: java.lang.AssertionError
at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:146)
at org.apache.cassandra.db.compaction.CompactionManager.scrubOne(CompactionManager.java:719)
... 8 more
was (Author: andrden):
Reproducible test case for this bug:
create column family AffiliateActivity with default_validation_class=CounterColumnType
and key_validation_class=LongType and comparator=AsciiType
and memtable_throughput=30
and memtable_operations=0.5
and replicate_on_write=true;
put AffiliateActivity-g-195-Data.db and AffiliateActivity-g-195-Index.db(attached) into cassandra data directory for some keyspace and run nodetool scrub
Those AffiliateActivity-g-195 data files were originally created with cassandra 0.8
java.io.IOError: java.lang.AssertionError
at org.apache.cassandra.db.compaction.CompactionManager.scrubOne(CompactionManager.java:775)
at org.apache.cassandra.db.compaction.CompactionManager.doScrub(CompactionManager.java:631)
at org.apache.cassandra.db.compaction.CompactionManager.access$600(CompactionManager.java:65)
at org.apache.cassandra.db.compaction.CompactionManager$3.call(CompactionManager.java:251)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
Caused by: java.lang.AssertionError
at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:146)
at org.apache.cassandra.db.compaction.CompactionManager.scrubOne(CompactionManager.java:719)
... 8 more
> AssertionError during compaction of CF with counter columns
> -----------------------------------------------------------
>
> Key: CASSANDRA-2968
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2968
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8.2
> Environment: CentOS release 5.6
> Reporter: Taras Puchko
> Attachments: AffiliateActivity-g-195-Data.db, AffiliateActivity-g-195-Index.db
>
>
> Having upgraded from 0.8.0 to 0.8.2 we ran nodetool compact and got
> Error occured during compaction
> java.util.concurrent.ExecutionException: java.lang.AssertionError
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at org.apache.cassandra.db.compaction.CompactionManager.performMajor(CompactionManager.java:277)
> at org.apache.cassandra.db.ColumnFamilyStore.forceMajorCompaction(ColumnFamilyStore.java:1762)
> at org.apache.cassandra.service.StorageService.forceTableCompaction(StorageService.java:1358)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27)
> at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)
> at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)
> at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)
> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
> at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
> at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
> at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
> at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
> at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360)
> at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
> at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
> at sun.rmi.transport.Transport$1.run(Transport.java:159)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
> at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.AssertionError
> at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:123)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:43)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompactionWithoutSizeEstimation(CompactionManager.java:569)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompaction(CompactionManager.java:506)
> at org.apache.cassandra.db.compaction.CompactionManager$4.call(CompactionManager.java:319)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> ... 3 more
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2968) AssertionError during compaction
of CF with counter columns
Posted by "Andriy Denysenko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andriy Denysenko updated CASSANDRA-2968:
----------------------------------------
Attachment: AffiliateActivity-g-195-Index.db
AffiliateActivity-g-195-Data.db
Reproducible test case for this bug:
create column family AffiliateActivity with default_validation_class=CounterColumnType
and key_validation_class=LongType and comparator=AsciiType
and memtable_throughput=30
and memtable_operations=0.5
and replicate_on_write=true;
put AffiliateActivity-g-195-Data.db and AffiliateActivity-g-195-Index.db into cassandra data directory for some keyspace and run nodetool scrub
Those AffiliateActivity-g-195 data files were originally created with cassandra 0.8
java.io.IOError: java.lang.AssertionError
at org.apache.cassandra.db.compaction.CompactionManager.scrubOne(CompactionManager.java:775)
at org.apache.cassandra.db.compaction.CompactionManager.doScrub(CompactionManager.java:631)
at org.apache.cassandra.db.compaction.CompactionManager.access$600(CompactionManager.java:65)
at org.apache.cassandra.db.compaction.CompactionManager$3.call(CompactionManager.java:251)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
Caused by: java.lang.AssertionError
at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:146)
at org.apache.cassandra.db.compaction.CompactionManager.scrubOne(CompactionManager.java:719)
... 8 more
> AssertionError during compaction of CF with counter columns
> -----------------------------------------------------------
>
> Key: CASSANDRA-2968
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2968
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8.2
> Environment: CentOS release 5.6
> Reporter: Taras Puchko
> Attachments: AffiliateActivity-g-195-Data.db, AffiliateActivity-g-195-Index.db
>
>
> Having upgraded from 0.8.0 to 0.8.2 we ran nodetool compact and got
> Error occured during compaction
> java.util.concurrent.ExecutionException: java.lang.AssertionError
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at org.apache.cassandra.db.compaction.CompactionManager.performMajor(CompactionManager.java:277)
> at org.apache.cassandra.db.ColumnFamilyStore.forceMajorCompaction(ColumnFamilyStore.java:1762)
> at org.apache.cassandra.service.StorageService.forceTableCompaction(StorageService.java:1358)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27)
> at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)
> at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)
> at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)
> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
> at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
> at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
> at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
> at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
> at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360)
> at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
> at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
> at sun.rmi.transport.Transport$1.run(Transport.java:159)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
> at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.AssertionError
> at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:123)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:43)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompactionWithoutSizeEstimation(CompactionManager.java:569)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompaction(CompactionManager.java:506)
> at org.apache.cassandra.db.compaction.CompactionManager$4.call(CompactionManager.java:319)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> ... 3 more
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2968) AssertionError during
compaction of CF with counter columns
Posted by "Kyle Ambroff (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13073369#comment-13073369 ]
Kyle Ambroff commented on CASSANDRA-2968:
-----------------------------------------
For what it's worth I've seen this same bug in 0.8.1.
> AssertionError during compaction of CF with counter columns
> -----------------------------------------------------------
>
> Key: CASSANDRA-2968
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2968
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8.2
> Environment: CentOS release 5.6
> Reporter: Taras Puchko
> Assignee: Sylvain Lebresne
> Fix For: 0.8.3
>
> Attachments: AffiliateActivity-g-147-Data.db, AffiliateActivity-g-147-Index.db, AffiliateActivity-g-195-Data.db, AffiliateActivity-g-195-Index.db
>
>
> Having upgraded from 0.8.0 to 0.8.2 we ran nodetool compact and got
> Error occured during compaction
> java.util.concurrent.ExecutionException: java.lang.AssertionError
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at org.apache.cassandra.db.compaction.CompactionManager.performMajor(CompactionManager.java:277)
> at org.apache.cassandra.db.ColumnFamilyStore.forceMajorCompaction(ColumnFamilyStore.java:1762)
> at org.apache.cassandra.service.StorageService.forceTableCompaction(StorageService.java:1358)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27)
> at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)
> at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)
> at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)
> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
> at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
> at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
> at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
> at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
> at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360)
> at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
> at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
> at sun.rmi.transport.Transport$1.run(Transport.java:159)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
> at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.AssertionError
> at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:123)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:43)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompactionWithoutSizeEstimation(CompactionManager.java:569)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompaction(CompactionManager.java:506)
> at org.apache.cassandra.db.compaction.CompactionManager$4.call(CompactionManager.java:319)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> ... 3 more
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2968) AssertionError during compaction
of CF with counter columns
Posted by "Andriy Denysenko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andriy Denysenko updated CASSANDRA-2968:
----------------------------------------
Attachment: AffiliateActivity-g-147-Index.db
AffiliateActivity-g-147-Data.db
actually 0.8.2 continues to write non-compactable sstables :-(
AffiliateActivity-g-147-Data.db is a recent file written 3 days after upgrade from 0.8.0 to 0.8.2 and it cannot be even scrubbed
The pattern I can see is that we have only every other sstable file left in data directory - AffiliateActivity-g-133, 135, 137, 139, 141, 143, 145, 147. Not quite sure - but it seems 1 compaction is done to new files - otherwise where are the even numbered ones? - but those files which resulted from first compaction are broken?
Anyway that's purely 0.8.2 problem, not any upgrade issue
> AssertionError during compaction of CF with counter columns
> -----------------------------------------------------------
>
> Key: CASSANDRA-2968
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2968
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8.2
> Environment: CentOS release 5.6
> Reporter: Taras Puchko
> Assignee: Sylvain Lebresne
> Fix For: 0.8.3
>
> Attachments: AffiliateActivity-g-147-Data.db, AffiliateActivity-g-147-Index.db, AffiliateActivity-g-195-Data.db, AffiliateActivity-g-195-Index.db
>
>
> Having upgraded from 0.8.0 to 0.8.2 we ran nodetool compact and got
> Error occured during compaction
> java.util.concurrent.ExecutionException: java.lang.AssertionError
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at org.apache.cassandra.db.compaction.CompactionManager.performMajor(CompactionManager.java:277)
> at org.apache.cassandra.db.ColumnFamilyStore.forceMajorCompaction(ColumnFamilyStore.java:1762)
> at org.apache.cassandra.service.StorageService.forceTableCompaction(StorageService.java:1358)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27)
> at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)
> at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)
> at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)
> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
> at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
> at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
> at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
> at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
> at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360)
> at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
> at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
> at sun.rmi.transport.Transport$1.run(Transport.java:159)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
> at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.AssertionError
> at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:123)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:43)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompactionWithoutSizeEstimation(CompactionManager.java:569)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompaction(CompactionManager.java:506)
> at org.apache.cassandra.db.compaction.CompactionManager$4.call(CompactionManager.java:319)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> ... 3 more
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2968) AssertionError during compaction
of CF with counter columns
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-2968:
--------------------------------------
Fix Version/s: 0.8.3
Assignee: Sylvain Lebresne
> AssertionError during compaction of CF with counter columns
> -----------------------------------------------------------
>
> Key: CASSANDRA-2968
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2968
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8.2
> Environment: CentOS release 5.6
> Reporter: Taras Puchko
> Assignee: Sylvain Lebresne
> Fix For: 0.8.3
>
> Attachments: AffiliateActivity-g-195-Data.db, AffiliateActivity-g-195-Index.db
>
>
> Having upgraded from 0.8.0 to 0.8.2 we ran nodetool compact and got
> Error occured during compaction
> java.util.concurrent.ExecutionException: java.lang.AssertionError
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at org.apache.cassandra.db.compaction.CompactionManager.performMajor(CompactionManager.java:277)
> at org.apache.cassandra.db.ColumnFamilyStore.forceMajorCompaction(ColumnFamilyStore.java:1762)
> at org.apache.cassandra.service.StorageService.forceTableCompaction(StorageService.java:1358)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27)
> at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)
> at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)
> at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)
> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
> at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
> at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
> at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
> at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
> at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360)
> at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
> at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
> at sun.rmi.transport.Transport$1.run(Transport.java:159)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
> at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.AssertionError
> at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:123)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:43)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompactionWithoutSizeEstimation(CompactionManager.java:569)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompaction(CompactionManager.java:506)
> at org.apache.cassandra.db.compaction.CompactionManager$4.call(CompactionManager.java:319)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> ... 3 more
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2968) AssertionError during
compaction of CF with counter columns
Posted by "Andriy Denysenko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13073184#comment-13073184 ]
Andriy Denysenko commented on CASSANDRA-2968:
---------------------------------------------
Debugger shows at the exception breakpoint in the test case described that
"state.getCount()" -9132236803706623116
"state.getClock()" -9132236803706623116
and context.array() (exactly 100 bytes in size) is the following so the duplication is really there,
and this record in sstable is likely corrupted - but how come!
000100012335e4a0b2c911e000006bb62b336af7 8143c702fe516b74 8143c702fe516b74
23d44780b2c911e00000f03fd2ec87ff000000000000b3c
0000000000000b3c025188750b2c911e0000058b7809d76fff082e59147f68e9cf082e59147f68e9c
> AssertionError during compaction of CF with counter columns
> -----------------------------------------------------------
>
> Key: CASSANDRA-2968
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2968
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8.2
> Environment: CentOS release 5.6
> Reporter: Taras Puchko
> Attachments: AffiliateActivity-g-195-Data.db, AffiliateActivity-g-195-Index.db
>
>
> Having upgraded from 0.8.0 to 0.8.2 we ran nodetool compact and got
> Error occured during compaction
> java.util.concurrent.ExecutionException: java.lang.AssertionError
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at org.apache.cassandra.db.compaction.CompactionManager.performMajor(CompactionManager.java:277)
> at org.apache.cassandra.db.ColumnFamilyStore.forceMajorCompaction(ColumnFamilyStore.java:1762)
> at org.apache.cassandra.service.StorageService.forceTableCompaction(StorageService.java:1358)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27)
> at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)
> at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)
> at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)
> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
> at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
> at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
> at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
> at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
> at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360)
> at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
> at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
> at sun.rmi.transport.Transport$1.run(Transport.java:159)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
> at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.AssertionError
> at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:123)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:43)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompactionWithoutSizeEstimation(CompactionManager.java:569)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompaction(CompactionManager.java:506)
> at org.apache.cassandra.db.compaction.CompactionManager$4.call(CompactionManager.java:319)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> ... 3 more
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (CASSANDRA-2968) AssertionError
during compaction of CF with counter columns
Posted by "Andriy Denysenko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13073513#comment-13073513 ]
Andriy Denysenko edited comment on CASSANDRA-2968 at 8/1/11 12:39 PM:
----------------------------------------------------------------------
no, I was wrong, compaction is not the culprit
I ran nodetool flush and produced 3 new small sstables - strangely they are all numbered with odd numbers only 153 155 157 - but the point is a freshly made sstable with only 8 rows is already unreadable by compaction/scrub.
Maybe header in counter binary value is not written or what...
{code}
{
"0000000000cc71a4": [["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000010000000000000001",1312201208019,"c",-9223372036854775808]],
"0000000000748b45": [["clicks","000100002335e4a0b2c911e000006bb62b336af7000000000000009f000000000000009f23d44780b2c911e00000f03fd2ec87ffa6cd8bac6eb8a32d2fd3c2059ade464925188750b2c911e0000058b7809d76ff9a8b961aed94ef799a8b961aed94ef79",1312201220709,"c",-9223372036854775808]],
"00000000010a4465": [["clicks","00002335e4a0b2c911e000006bb62b336af700000000000045ad00000000000045ad23d44780b2c911e00000f03fd2ec87ff0000000000004bfd0000000001fae30325188750b2c911e0000058b7809d76ff000000000000038f000000000000038f",1312201219737,"c",-9223372036854775808]],
"0000000001319592": [["clicks","000100002335e4a0b2c911e000006bb62b336af70000000000000001000000000000000123d44780b2c911e00000f03fd2ec87ffdf1636876c1c1bc2df1636876c1c1bc225188750b2c911e0000058b7809d76ff0876b1020dc02ac97f12b88d9f9df751",1312201215475,"c",-9223372036854775808]],
"0000000001b9a53e": [["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000010000000000000001",1312201202338,"c",-9223372036854775808]],
"00000000004dd84f": [["clicks","000100002335e4a0b2c911e000006bb62b336af70000000000000001000000000000000123d44780b2c911e00000f03fd2ec87ff000000000017d1550000000059fb2ad925188750b2c911e0000058b7809d76ff00000000000173bf00000000000173bf",1312201205636,"c",-9223372036854775808]],
"0000000000d1d52f": [["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000020000000000000002",1312201210515,"c",-9223372036854775808]],
"0000000001410d4a": [["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000010000000000000001",1312201220365,"c",-9223372036854775808]]
}
{code}
was (Author: andrden):
no, I was wrong, compaction is not the culprit
I ran nodetool flush and produced 3 new small sstables - strangely they are all numbered with odd numbers only 153 155 157 - but the point is a freshly made sstable with only 8 rows is already unreadable by compaction/scrub.
Maybe header in counter binary value is not written or what...
{
"0000000000cc71a4": [["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000010000000000000001",1312201208019,"c",-9223372036854775808]],
"0000000000748b45": [["clicks","000100002335e4a0b2c911e000006bb62b336af7000000000000009f000000000000009f23d44780b2c911e00000f03fd2ec87ffa6cd8bac6eb8a32d2fd3c2059ade464925188750b2c911e0000058b7809d76ff9a8b961aed94ef799a8b961aed94ef79",1312201220709,"c",-9223372036854775808]],
"00000000010a4465": [["clicks","00002335e4a0b2c911e000006bb62b336af700000000000045ad00000000000045ad23d44780b2c911e00000f03fd2ec87ff0000000000004bfd0000000001fae30325188750b2c911e0000058b7809d76ff000000000000038f000000000000038f",1312201219737,"c",-9223372036854775808]],
"0000000001319592": [["clicks","000100002335e4a0b2c911e000006bb62b336af70000000000000001000000000000000123d44780b2c911e00000f03fd2ec87ffdf1636876c1c1bc2df1636876c1c1bc225188750b2c911e0000058b7809d76ff0876b1020dc02ac97f12b88d9f9df751",1312201215475,"c",-9223372036854775808]],
"0000000001b9a53e": [["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000010000000000000001",1312201202338,"c",-9223372036854775808]],
"00000000004dd84f": [["clicks","000100002335e4a0b2c911e000006bb62b336af70000000000000001000000000000000123d44780b2c911e00000f03fd2ec87ff000000000017d1550000000059fb2ad925188750b2c911e0000058b7809d76ff00000000000173bf00000000000173bf",1312201205636,"c",-9223372036854775808]],
"0000000000d1d52f": [["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000020000000000000002",1312201210515,"c",-9223372036854775808]],
"0000000001410d4a": [["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000010000000000000001",1312201220365,"c",-9223372036854775808]]
}
> AssertionError during compaction of CF with counter columns
> -----------------------------------------------------------
>
> Key: CASSANDRA-2968
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2968
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8.2
> Environment: CentOS release 5.6
> Reporter: Taras Puchko
> Assignee: Sylvain Lebresne
> Fix For: 0.8.3
>
> Attachments: AffiliateActivity-g-147-Data.db, AffiliateActivity-g-147-Index.db, AffiliateActivity-g-195-Data.db, AffiliateActivity-g-195-Index.db
>
>
> Having upgraded from 0.8.0 to 0.8.2 we ran nodetool compact and got
> Error occured during compaction
> java.util.concurrent.ExecutionException: java.lang.AssertionError
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at org.apache.cassandra.db.compaction.CompactionManager.performMajor(CompactionManager.java:277)
> at org.apache.cassandra.db.ColumnFamilyStore.forceMajorCompaction(ColumnFamilyStore.java:1762)
> at org.apache.cassandra.service.StorageService.forceTableCompaction(StorageService.java:1358)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27)
> at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)
> at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)
> at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)
> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
> at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
> at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
> at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
> at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
> at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360)
> at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
> at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
> at sun.rmi.transport.Transport$1.run(Transport.java:159)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
> at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.AssertionError
> at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:123)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:43)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompactionWithoutSizeEstimation(CompactionManager.java:569)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompaction(CompactionManager.java:506)
> at org.apache.cassandra.db.compaction.CompactionManager$4.call(CompactionManager.java:319)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> ... 3 more
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (CASSANDRA-2968) AssertionError during compaction
of CF with counter columns
Posted by "Sylvain Lebresne (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sylvain Lebresne resolved CASSANDRA-2968.
-----------------------------------------
Resolution: Fixed
Reviewer: jbellis
Committed (without println), thanks
> AssertionError during compaction of CF with counter columns
> -----------------------------------------------------------
>
> Key: CASSANDRA-2968
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2968
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8.2
> Environment: CentOS release 5.6
> Reporter: Taras Puchko
> Assignee: Sylvain Lebresne
> Fix For: 0.8.3
>
> Attachments: 2968.patch, AffiliateActivity-g-147-Data.db, AffiliateActivity-g-147-Index.db, AffiliateActivity-g-195-Data.db, AffiliateActivity-g-195-Index.db
>
>
> Having upgraded from 0.8.0 to 0.8.2 we ran nodetool compact and got
> Error occured during compaction
> java.util.concurrent.ExecutionException: java.lang.AssertionError
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at org.apache.cassandra.db.compaction.CompactionManager.performMajor(CompactionManager.java:277)
> at org.apache.cassandra.db.ColumnFamilyStore.forceMajorCompaction(ColumnFamilyStore.java:1762)
> at org.apache.cassandra.service.StorageService.forceTableCompaction(StorageService.java:1358)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27)
> at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)
> at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)
> at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)
> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
> at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
> at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
> at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
> at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
> at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360)
> at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
> at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
> at sun.rmi.transport.Transport$1.run(Transport.java:159)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
> at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.AssertionError
> at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:123)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:43)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompactionWithoutSizeEstimation(CompactionManager.java:569)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompaction(CompactionManager.java:506)
> at org.apache.cassandra.db.compaction.CompactionManager$4.call(CompactionManager.java:319)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> ... 3 more
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2968) AssertionError during
compaction of CF with counter columns
Posted by "Andriy Denysenko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13073513#comment-13073513 ]
Andriy Denysenko commented on CASSANDRA-2968:
---------------------------------------------
no, I was wrong, compaction is not the culprit
I ran nodetool flush and produced 3 new small sstables - strangely they are all numbered with odd numbers only 153 155 157 - but the point is a freshly made sstable with only 8 rows is already unreadable by compaction/scrub.
Maybe header in counter binary value is not written or what...
{
"0000000000cc71a4": [["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000010000000000000001",1312201208019,"c",-9223372036854775808]],
"0000000000748b45": [["clicks","000100002335e4a0b2c911e000006bb62b336af7000000000000009f000000000000009f23d44780b2c911e00000f03fd2ec87ffa6cd8bac6eb8a32d2fd3c2059ade464925188750b2c911e0000058b7809d76ff9a8b961aed94ef799a8b961aed94ef79",1312201220709,"c",-9223372036854775808]],
"00000000010a4465": [["clicks","00002335e4a0b2c911e000006bb62b336af700000000000045ad00000000000045ad23d44780b2c911e00000f03fd2ec87ff0000000000004bfd0000000001fae30325188750b2c911e0000058b7809d76ff000000000000038f000000000000038f",1312201219737,"c",-9223372036854775808]],
"0000000001319592": [["clicks","000100002335e4a0b2c911e000006bb62b336af70000000000000001000000000000000123d44780b2c911e00000f03fd2ec87ffdf1636876c1c1bc2df1636876c1c1bc225188750b2c911e0000058b7809d76ff0876b1020dc02ac97f12b88d9f9df751",1312201215475,"c",-9223372036854775808]],
"0000000001b9a53e": [["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000010000000000000001",1312201202338,"c",-9223372036854775808]],
"00000000004dd84f": [["clicks","000100002335e4a0b2c911e000006bb62b336af70000000000000001000000000000000123d44780b2c911e00000f03fd2ec87ff000000000017d1550000000059fb2ad925188750b2c911e0000058b7809d76ff00000000000173bf00000000000173bf",1312201205636,"c",-9223372036854775808]],
"0000000000d1d52f": [["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000020000000000000002",1312201210515,"c",-9223372036854775808]],
"0000000001410d4a": [["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000010000000000000001",1312201220365,"c",-9223372036854775808]]
}
> AssertionError during compaction of CF with counter columns
> -----------------------------------------------------------
>
> Key: CASSANDRA-2968
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2968
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8.2
> Environment: CentOS release 5.6
> Reporter: Taras Puchko
> Assignee: Sylvain Lebresne
> Fix For: 0.8.3
>
> Attachments: AffiliateActivity-g-147-Data.db, AffiliateActivity-g-147-Index.db, AffiliateActivity-g-195-Data.db, AffiliateActivity-g-195-Index.db
>
>
> Having upgraded from 0.8.0 to 0.8.2 we ran nodetool compact and got
> Error occured during compaction
> java.util.concurrent.ExecutionException: java.lang.AssertionError
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at org.apache.cassandra.db.compaction.CompactionManager.performMajor(CompactionManager.java:277)
> at org.apache.cassandra.db.ColumnFamilyStore.forceMajorCompaction(ColumnFamilyStore.java:1762)
> at org.apache.cassandra.service.StorageService.forceTableCompaction(StorageService.java:1358)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27)
> at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)
> at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)
> at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)
> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
> at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
> at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
> at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
> at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
> at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360)
> at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
> at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
> at sun.rmi.transport.Transport$1.run(Transport.java:159)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
> at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.AssertionError
> at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:123)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:43)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompactionWithoutSizeEstimation(CompactionManager.java:569)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompaction(CompactionManager.java:506)
> at org.apache.cassandra.db.compaction.CompactionManager$4.call(CompactionManager.java:319)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> ... 3 more
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2968) AssertionError during
compaction of CF with counter columns
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13076217#comment-13076217 ]
Jonathan Ellis commented on CASSANDRA-2968:
-------------------------------------------
+1 w/ println removed :)
> AssertionError during compaction of CF with counter columns
> -----------------------------------------------------------
>
> Key: CASSANDRA-2968
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2968
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8.2
> Environment: CentOS release 5.6
> Reporter: Taras Puchko
> Assignee: Sylvain Lebresne
> Fix For: 0.8.3
>
> Attachments: 2968.patch, AffiliateActivity-g-147-Data.db, AffiliateActivity-g-147-Index.db, AffiliateActivity-g-195-Data.db, AffiliateActivity-g-195-Index.db
>
>
> Having upgraded from 0.8.0 to 0.8.2 we ran nodetool compact and got
> Error occured during compaction
> java.util.concurrent.ExecutionException: java.lang.AssertionError
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at org.apache.cassandra.db.compaction.CompactionManager.performMajor(CompactionManager.java:277)
> at org.apache.cassandra.db.ColumnFamilyStore.forceMajorCompaction(ColumnFamilyStore.java:1762)
> at org.apache.cassandra.service.StorageService.forceTableCompaction(StorageService.java:1358)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93)
> at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27)
> at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)
> at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)
> at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)
> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
> at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
> at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
> at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
> at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
> at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360)
> at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
> at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
> at sun.rmi.transport.Transport$1.run(Transport.java:159)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
> at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
> at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.AssertionError
> at org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
> at org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:123)
> at org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:43)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompactionWithoutSizeEstimation(CompactionManager.java:569)
> at org.apache.cassandra.db.compaction.CompactionManager.doCompaction(CompactionManager.java:506)
> at org.apache.cassandra.db.compaction.CompactionManager$4.call(CompactionManager.java:319)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> ... 3 more
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira