You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Carlo Pires <ca...@gmail.com> on 2012/01/04 17:09:47 UTC
Cannot start cassandra node anymore
Hi,
I can't start a node of my cluster. Could someone help me to catch the
problem?
Using: debian with cassandra 1.0.6.
root@carlo-laptop:/etc/cassandra# cat /var/log/cassandra/output.log
INFO 13:46:00,596 JVM vendor/version: Java HotSpot(TM) 64-Bit Server
VM/1.6.0_26
INFO 13:46:00,600 Heap size: 1052770304/1052770304
INFO 13:46:00,601 Classpath:
/usr/share/cassandra/lib/antlr-3.2.jar:/usr/share/cassandra/lib/avro-1.4.0-fixes.jar:/usr/share/cassandra/lib/avro-1.4.0-sources-fixes.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.2.jar:/usr/share/cassandra/lib/commons-lang-2.4.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.2.jar:/usr/share/cassandra/lib/guava-r08.jar:/usr/share/cassandra/lib/high-scale-lib-1.1.2.jar:/usr/share/cassandra/lib/jackson-core-asl-1.4.0.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.4.0.jar:/usr/share/cassandra/lib/jamm-0.2.5.jar:/usr/share/cassandra/lib/jline-0.9.94.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0.6.jar:/usr/share/cassandra/lib/log4j-1.2.16.jar:/usr/share/cassandra/lib/servlet-api-2.5-20081211.jar:/usr/share/cassandra/lib/slf4j-api-1.6.1.jar:/usr/share/cassandra/lib/slf4j-log4j12-1.6.1.jar:/usr/share/cassandra/lib/snakeyaml-1.6.jar:/usr/share/cassandra/lib/snappy-java-1.0.4.1.jar:/usr/share/cassandra/apache-cassandra-1.0.6.jar:/usr/share/cassandra/apache-cassandra-thrift-1.0.6.jar:/usr/share/cassandra/apache-cassandra.jar:/usr/share/java/jna.jar:/etc/cassandra:/usr/share/java/commons-daemon.jar:/usr/share/cassandra/lib/jamm-0.2.5.jar
INFO 13:46:00,617 Unable to link C library. Native methods will be
disabled.
INFO 13:46:00,627 Loading settings from file:/etc/cassandra/cassandra.yaml
INFO 13:46:00,767 DiskAccessMode 'auto' determined to be mmap,
indexAccessMode is mmap
INFO 13:46:00,783 Global memtable threshold is enabled at 334MB
INFO 13:46:01,086 Opening /var/lib/cassandra/data/system/Versions-hc-5
(247 bytes)
INFO 13:46:01,125 Opening /var/lib/cassandra/data/system/Schema-hc-394
(1307316 bytes)
INFO 13:46:01,125 Opening /var/lib/cassandra/data/system/Schema-hc-396
(14421 bytes)
INFO 13:46:01,145 Opening /var/lib/cassandra/data/system/Migrations-hc-394
(2285452 bytes)
INFO 13:46:01,148 Opening /var/lib/cassandra/data/system/Migrations-hc-396
(18582 bytes)
INFO 13:46:01,159 Opening
/var/lib/cassandra/data/system/LocationInfo-hc-13 (415 bytes)
INFO 13:46:01,162 Opening
/var/lib/cassandra/data/system/LocationInfo-hc-15 (163 bytes)
INFO 13:46:01,162 Opening
/var/lib/cassandra/data/system/LocationInfo-hc-14 (80 bytes)
INFO 13:46:01,175 Opening
/var/lib/cassandra/data/system/HintsColumnFamily-hc-7 (13566 bytes)
INFO 13:46:01,183 Opening
/var/lib/cassandra/data/system/HintsColumnFamily-hc-6 (1019 bytes)
INFO 13:46:01,227 Loading schema version
5c583e90-3631-11e1-0000-b1d70f5561fa
INFO 13:46:01,572 Creating new commitlog segment
/var/lib/cassandra/commitlog/CommitLog-1325691961572.log
INFO 13:46:01,586 Replaying
/var/lib/cassandra/commitlog/CommitLog-1325586865178.log,
/var/lib/cassandra/commitlog/CommitLog-1325625102454.log,
/var/lib/cassandra/commitlog/CommitLog-1325674574711.log,
/var/lib/cassandra/commitlog/CommitLog-1325676430281.log,
/var/lib/cassandra/commitlog/CommitLog-1325676440840.log,
/var/lib/cassandra/commitlog/CommitLog-1325676472468.log,
/var/lib/cassandra/commitlog/CommitLog-1325690114212.log,
/var/lib/cassandra/commitlog/CommitLog-1325691142058.log,
/var/lib/cassandra/commitlog/CommitLog-1325691453774.log,
/var/lib/cassandra/commitlog/CommitLog-1325691528668.log
INFO 13:46:01,657 Finished reading
/var/lib/cassandra/commitlog/CommitLog-1325586865178.log
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.commons.daemon.support.DaemonLoader.load(DaemonLoader.java:160)
Caused by: java.lang.IllegalArgumentException
at java.nio.Buffer.limit(Buffer.java:249)
at
org.apache.cassandra.db.marshal.AbstractCompositeType.getBytes(AbstractCompositeType.java:57)
at
org.apache.cassandra.db.marshal.AbstractCompositeType.getWithShortLength(AbstractCompositeType.java:66)
at
org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:82)
at
org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:37)
at
java.util.concurrent.ConcurrentSkipListMap$ComparableUsingComparator.compareTo(ConcurrentSkipListMap.java:606)
at
java.util.concurrent.ConcurrentSkipListMap.doPut(ConcurrentSkipListMap.java:878)
at
java.util.concurrent.ConcurrentSkipListMap.putIfAbsent(ConcurrentSkipListMap.java:1893)
at
org.apache.cassandra.db.ThreadSafeSortedColumns.addColumn(ThreadSafeSortedColumns.java:88)
at
org.apache.cassandra.db.AbstractColumnContainer.addColumn(AbstractColumnContainer.java:129)
at
org.apache.cassandra.db.AbstractColumnContainer.addColumn(AbstractColumnContainer.java:124)
at
org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:148)
at
org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:139)
at
org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:132)
at
org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:401)
at
org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:285)
at
org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:172)
at
org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:196)
at
org.apache.cassandra.service.AbstractCassandraDaemon.init(AbstractCassandraDaemon.java:238)
... 5 more
Cannot load daemon
Service exit with a return value of 3
Re: Cannot start cassandra node anymore
Posted by Jonathan Ellis <jb...@gmail.com>.
Hi Carlo,
Can you post steps to reproduce over on
https://issues.apache.org/jira/browse/CASSANDRA-3819 ? We have tried
and failed to cause this problem.
On Thu, Jan 26, 2012 at 6:24 AM, Carlo Pires <ca...@gmail.com> wrote:
> I found out this is related to schema change. Happens *every time* I create
> drop and new CF with composite types. As workaround I:
>
> * never stop all nodes together
>
> To stop a node:
> * repair and compact a node before stopping it
> * stop and start it again
> * if it started fine good if not, remove all data and restart the node (and
> wait...)
>
>
> 2012/1/25 aaron morton <aa...@thelastpickle.com>
>>
>> There is someone wrong with the way a composite type value was serialized.
>> The length of a part on disk is not right.
>>
>> As a work around remove the log file, restart and then repair the node.
>>
>> How it got like that is another question. What was the schema change ?
>>
>> Cheers
>>
>>
>
--
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of DataStax, the source for professional Cassandra support
http://www.datastax.com
Re: Cannot start cassandra node anymore
Posted by Carlo Pires <ca...@gmail.com>.
I'm not in production yet. As exercise, stopped all nodes when this error
occurred and I could not start any node again.
Re: Cannot start cassandra node anymore
Posted by Sasha Dolgy <sd...@gmail.com>.
why would you ever want to stop all nodes together?
On Thu, Jan 26, 2012 at 1:24 PM, Carlo Pires <ca...@gmail.com> wrote:
> I found out this is related to schema change. Happens *every time* I create
> drop and new CF with composite types. As workaround I:
>
> * never stop all nodes together
>
> To stop a node:
> * repair and compact a node before stopping it
> * stop and start it again
> * if it started fine good if not, remove all data and restart the node (and
> wait...)
Re: Cannot start cassandra node anymore
Posted by Sylvain Lebresne <sy...@datastax.com>.
On Thu, Jan 26, 2012 at 1:24 PM, Carlo Pires <ca...@gmail.com> wrote:
> I found out this is related to schema change. Happens *every time* I create
> drop and new CF with composite types. As workaround I:
Would you mind opening a ticket on JIRA
(https://issues.apache.org/jira/browse/CASSANDRA) with the stack trace
and how you reproduce this.
--
Sylvain
>
> * never stop all nodes together
>
> To stop a node:
> * repair and compact a node before stopping it
> * stop and start it again
> * if it started fine good if not, remove all data and restart the node (and
> wait...)
>
>
> 2012/1/25 aaron morton <aa...@thelastpickle.com>
>>
>> There is someone wrong with the way a composite type value was serialized.
>> The length of a part on disk is not right.
>>
>> As a work around remove the log file, restart and then repair the node.
>>
>> How it got like that is another question. What was the schema change ?
>>
>> Cheers
>>
>>
>
Re: Cannot start cassandra node anymore
Posted by Carlo Pires <ca...@gmail.com>.
I found out this is related to schema change. Happens *every time* I create
drop and new CF with composite types. As workaround I:
* never stop all nodes together
To stop a node:
* repair and compact a node before stopping it
* stop and start it again
* if it started fine good if not, remove all data and restart the node (and
wait...)
2012/1/25 aaron morton <aa...@thelastpickle.com>
> There is someone wrong with the way a composite type value was serialized.
> The length of a part on disk is not right.
>
> As a work around remove the log file, restart and then repair the node.
>
> How it got like that is another question. What was the schema change ?
>
> Cheers
>
>
>
Re: Cannot start cassandra node anymore
Posted by huyle <hu...@springpartners.com>.
Created https://issues.apache.org/jira/browse/CASSANDRA-3819. Thanks!
Huy
> The schema change was that we created a new key space with composite type
> CFs, but later we had to change some definition/CF names, so we dropped
> the
> key space and recreated with new definition.
sounds like a bug, as Sylvain suggest can you report it here
https://issues.apache.org/jira/browse/CASSANDRA and include the schema
changes you made.
Cheers
-----------------
Aaron Morton
Freelance Developer
@aaronmorton
http://www.thelastpickle.com
--
View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cannot-start-cassandra-node-anymore-tp7150978p7240588.html
Sent from the cassandra-user@incubator.apache.org mailing list archive at Nabble.com.
Re: Cannot start cassandra node anymore
Posted by aaron morton <aa...@thelastpickle.com>.
> The schema change was that we created a new key space with composite type
> CFs, but later we had to change some definition/CF names, so we dropped the
> key space and recreated with new definition.
sounds like a bug, as Sylvain suggest can you report it here https://issues.apache.org/jira/browse/CASSANDRA and include the schema changes you made.
Cheers
-----------------
Aaron Morton
Freelance Developer
@aaronmorton
http://www.thelastpickle.com
On 27/01/2012, at 4:41 AM, huyle wrote:
> This is on single node environment, and there is a lot of data in commit logs
> needs to be flushed to sstables. So remove commit logs will cause data lost.
>
> Fortunately, this issue happens on a new key space that have CFs that use
> composite type, and we can sacrifice loosing data on this new key space. So
> we modified cassandra code so that cassandra will continue load when it
> encounters this issue. We was able to get cassandra up and running with the
> modified code, and data in other key spaces remain intact.
>
> The schema change was that we created a new key space with composite type
> CFs, but later we had to change some definition/CF names, so we dropped the
> key space and recreated with new definition.
>
> Huy
>
>
>
>
>
> --
> View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cannot-start-cassandra-node-anymore-tp7150978p7227283.html
> Sent from the cassandra-user@incubator.apache.org mailing list archive at Nabble.com.
Re: Cannot start cassandra node anymore
Posted by huyle <hu...@springpartners.com>.
This is on single node environment, and there is a lot of data in commit logs
needs to be flushed to sstables. So remove commit logs will cause data lost.
Fortunately, this issue happens on a new key space that have CFs that use
composite type, and we can sacrifice loosing data on this new key space. So
we modified cassandra code so that cassandra will continue load when it
encounters this issue. We was able to get cassandra up and running with the
modified code, and data in other key spaces remain intact.
The schema change was that we created a new key space with composite type
CFs, but later we had to change some definition/CF names, so we dropped the
key space and recreated with new definition.
Huy
--
View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cannot-start-cassandra-node-anymore-tp7150978p7227283.html
Sent from the cassandra-user@incubator.apache.org mailing list archive at Nabble.com.
Re: Cannot start cassandra node anymore
Posted by aaron morton <aa...@thelastpickle.com>.
There is someone wrong with the way a composite type value was serialized. The length of a part on disk is not right.
As a work around remove the log file, restart and then repair the node.
How it got like that is another question. What was the schema change ?
Cheers
-----------------
Aaron Morton
Freelance Developer
@aaronmorton
http://www.thelastpickle.com
On 26/01/2012, at 7:08 AM, huyle wrote:
> Hi,
>
> I am having similar or the same issue on single node environment. I did
> make schema changes recently. Any recommendation how to recover the server
> without loosing data? Here are the last few lines of debug log during start
> up.
>
> -3881-11e1-ac7f-12313d23ead3:true:4@1326223353559001,])}
> DEBUG 18:02:01,057 Reading mutation at 66336992
> DEBUG 18:02:01,058 replaying mutation for
> Springpad.696d6167652d7363616c65722d6d657461:
> {ColumnFamily(CassandraOrderedQueue
> [0,eb321490-3881-11e1-ac7f-12313d23ead3:true:4@1326223353560000,])}
> DEBUG 18:02:01,058 Reading mutation at 66337118
> DEBUG 18:02:01,058 replaying mutation for
> Springpad.737072696e674d6f64656c44617461626173652d6d657461:
> {ColumnFamily(CassandraOrderedQueue
> [0,80dc0cd0-3bc0-11e1-83a8-12313d23ead3:false:8@1326223386668000,])}
> DEBUG 18:02:01,058 Reading mutation at 66337255
> DEBUG 18:02:01,058 replaying mutation for
> system.38363233616337302d336263302d313165312d303030302d323366623834646463346633:
> {ColumnFamily(Schema
> [Avro/Schema:false:2725@1326223386807,Backups:false:431@1326223386807,Springpad:false:10814@1326223386807,SpringpadGraph:false:2931@1326223386807,])}
> DEBUG 18:02:01,059 Reading mutation at 66354352
> DEBUG 18:02:01,059 replaying mutation for
> system.4d6967726174696f6e73204b6579: {ColumnFamily(Migrations
> [8623ac70-3bc0-11e1-0000-23fb84ddc4f3:false:23728@1326223386812,])}
> DEBUG 18:02:01,059 Reading mutation at 66378184
> DEBUG 18:02:01,059 replaying mutation for
> system.4c617374204d6967726174696f6e: {ColumnFamily(Schema [Last
> Migration:false:16@1326223386812,])}
> DEBUG 18:02:01,059 Reading mutation at 66378302
> INFO 18:02:01,060 Finished reading
> /mnt/cassandra/commitlog/CommitLog-1325861435420.log
> ERROR 18:02:01,061 Exception encountered during startup
> java.lang.IllegalArgumentException
> at java.nio.Buffer.limit(Buffer.java:247)
> at
> org.apache.cassandra.db.marshal.AbstractCompositeType.getBytes(AbstractCompositeType.java:57)
> at
> org.apache.cassandra.db.marshal.AbstractCompositeType.getWithShortLength(AbstractCompositeType.java:66)
> at
> org.apache.cassandra.db.marshal.AbstractCompositeType.getString(AbstractCompositeType.java:129)
> at org.apache.cassandra.db.Column.getString(Column.java:250)
> at
> org.apache.cassandra.db.marshal.AbstractType.getColumnsString(AbstractType.java:137)
> at org.apache.cassandra.db.ColumnFamily.toString(ColumnFamily.java:280)
> at org.apache.commons.lang.ObjectUtils.toString(ObjectUtils.java:241)
> at org.apache.commons.lang.StringUtils.join(StringUtils.java:3073)
> at org.apache.commons.lang.StringUtils.join(StringUtils.java:3133)
> at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:301)
> at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:172)
> at
> org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:215)
> at
> org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:356)
> at
> org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:107)
> Exception encountered during startup: null
>
>
>
> Thanks!
>
> Huy
>
>
> --
> View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cannot-start-cassandra-node-anymore-tp7150978p7224570.html
> Sent from the cassandra-user@incubator.apache.org mailing list archive at Nabble.com.
Re: Cannot start cassandra node anymore
Posted by huyle <hu...@springpartners.com>.
Hi,
I am having similar or the same issue on single node environment. I did
make schema changes recently. Any recommendation how to recover the server
without loosing data? Here are the last few lines of debug log during start
up.
-3881-11e1-ac7f-12313d23ead3:true:4@1326223353559001,])}
DEBUG 18:02:01,057 Reading mutation at 66336992
DEBUG 18:02:01,058 replaying mutation for
Springpad.696d6167652d7363616c65722d6d657461:
{ColumnFamily(CassandraOrderedQueue
[0,eb321490-3881-11e1-ac7f-12313d23ead3:true:4@1326223353560000,])}
DEBUG 18:02:01,058 Reading mutation at 66337118
DEBUG 18:02:01,058 replaying mutation for
Springpad.737072696e674d6f64656c44617461626173652d6d657461:
{ColumnFamily(CassandraOrderedQueue
[0,80dc0cd0-3bc0-11e1-83a8-12313d23ead3:false:8@1326223386668000,])}
DEBUG 18:02:01,058 Reading mutation at 66337255
DEBUG 18:02:01,058 replaying mutation for
system.38363233616337302d336263302d313165312d303030302d323366623834646463346633:
{ColumnFamily(Schema
[Avro/Schema:false:2725@1326223386807,Backups:false:431@1326223386807,Springpad:false:10814@1326223386807,SpringpadGraph:false:2931@1326223386807,])}
DEBUG 18:02:01,059 Reading mutation at 66354352
DEBUG 18:02:01,059 replaying mutation for
system.4d6967726174696f6e73204b6579: {ColumnFamily(Migrations
[8623ac70-3bc0-11e1-0000-23fb84ddc4f3:false:23728@1326223386812,])}
DEBUG 18:02:01,059 Reading mutation at 66378184
DEBUG 18:02:01,059 replaying mutation for
system.4c617374204d6967726174696f6e: {ColumnFamily(Schema [Last
Migration:false:16@1326223386812,])}
DEBUG 18:02:01,059 Reading mutation at 66378302
INFO 18:02:01,060 Finished reading
/mnt/cassandra/commitlog/CommitLog-1325861435420.log
ERROR 18:02:01,061 Exception encountered during startup
java.lang.IllegalArgumentException
at java.nio.Buffer.limit(Buffer.java:247)
at
org.apache.cassandra.db.marshal.AbstractCompositeType.getBytes(AbstractCompositeType.java:57)
at
org.apache.cassandra.db.marshal.AbstractCompositeType.getWithShortLength(AbstractCompositeType.java:66)
at
org.apache.cassandra.db.marshal.AbstractCompositeType.getString(AbstractCompositeType.java:129)
at org.apache.cassandra.db.Column.getString(Column.java:250)
at
org.apache.cassandra.db.marshal.AbstractType.getColumnsString(AbstractType.java:137)
at org.apache.cassandra.db.ColumnFamily.toString(ColumnFamily.java:280)
at org.apache.commons.lang.ObjectUtils.toString(ObjectUtils.java:241)
at org.apache.commons.lang.StringUtils.join(StringUtils.java:3073)
at org.apache.commons.lang.StringUtils.join(StringUtils.java:3133)
at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:301)
at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:172)
at
org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:215)
at
org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:356)
at
org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:107)
Exception encountered during startup: null
Thanks!
Huy
--
View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cannot-start-cassandra-node-anymore-tp7150978p7224570.html
Sent from the cassandra-user@incubator.apache.org mailing list archive at Nabble.com.
Re: Cannot start cassandra node anymore
Posted by Peter Schuller <pe...@infidyne.com>.
(too much to quote)
Looks to me like this should be fixable by removing hints from the
node in question (I don't remember whether this is a bug that's been
identified and fixed or not).
I may be wrong because I'm just basing this on a quick look at the
stack trace but it seems to me there are hints on the node, for other
nodes, that contain writes to a deleted column family.
--
/ Peter Schuller (@scode, http://worldmodscode.wordpress.com)
Re: Cannot start cassandra node anymore
Posted by Carlo Pires <ca...@gmail.com>.
I removed commit log and tryed to start the node again. Now the other nodes
cant get synced with it (see the log bellow).
I'm baffled with this. Is live schema updates on cassandra buggy? Shoul we
avoid it for 1.0.6?
INFO 12:05:53,009 InetAddress /192.168.2.2 is now UP
INFO 12:06:38,580 Started hinted handoff for token:
85070591730234615865843651857942052864 with IP: /192.168.2.2
ERROR 12:06:38,584 Fatal exception in thread Thread[HintedHandoff:1,1,main]
java.lang.RuntimeException:
org.apache.cassandra.db.UnserializableColumnFamilyException: Couldn't find
cfId=1019
at
org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:689)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: org.apache.cassandra.db.UnserializableColumnFamilyException:
Couldn't find cfId=1019
at
org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:129)
at
org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:401)
at
org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:409)
at
org.apache.cassandra.db.HintedHandOffManager.deliverHintsToEndpoint(HintedHandOffManager.java:306)
at
org.apache.cassandra.db.HintedHandOffManager.access$100(HintedHandOffManager.java:81)
at
org.apache.cassandra.db.HintedHandOffManager$2.runMayThrow(HintedHandOffManager.java:353)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
... 3 more
ERROR 12:06:38,585 Fatal exception in thread Thread[HintedHandoff:1,1,main]
java.lang.RuntimeException:
org.apache.cassandra.db.UnserializableColumnFamilyException: Couldn't find
cfId=1019
at
org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:689)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: org.apache.cassandra.db.UnserializableColumnFamilyException:
Couldn't find cfId=1019
at
org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:129)
at
org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:401)
at
org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:409)
at
org.apache.cassandra.db.HintedHandOffManager.deliverHintsToEndpoint(HintedHandOffManager.java:306)
at
org.apache.cassandra.db.HintedHandOffManager.access$100(HintedHandOffManager.java:81)
at
org.apache.cassandra.db.HintedHandOffManager$2.runMayThrow(HintedHandOffManager.java:353)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
... 3 more
2012/1/6 Carlo Pires <ca...@gmail.com>
> It happened again. As I could understand, it is trying to write in a CF I
> dropped. But others nodes are running fine. I found out if I stop a running
> node I can't start it again (I get the same error).
>
> Can't I delete CFs on the fly in cassandra? Is this a bug?
>
> root@carlo-laptop:/var/log/cassandra# cat output.log
> INFO 10:28:24,928 JVM vendor/version: Java HotSpot(TM) 64-Bit Server
> VM/1.6.0_26
> INFO 10:28:24,932 Heap size: 1052770304/1052770304
> INFO 10:28:24,933 Classpath:
> /usr/share/cassandra/lib/antlr-3.2.jar:/usr/share/cassandra/lib/avro-1.4.0-fixes.jar:/usr/share/cassandra/lib/avro-1.4.0-sources-fixes.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.2.jar:/usr/share/cassandra/lib/commons-lang-2.4.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.2.jar:/usr/share/cassandra/lib/guava-r08.jar:/usr/share/cassandra/lib/high-scale-lib-1.1.2.jar:/usr/share/cassandra/lib/jackson-core-asl-1.4.0.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.4.0.jar:/usr/share/cassandra/lib/jamm-0.2.5.jar:/usr/share/cassandra/lib/jline-0.9.94.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0.6.jar:/usr/share/cassandra/lib/log4j-1.2.16.jar:/usr/share/cassandra/lib/servlet-api-2.5-20081211.jar:/usr/share/cassandra/lib/slf4j-api-1.6.1.jar:/usr/share/cassandra/lib/slf4j-log4j12-1.6.1.jar:/usr/share/cassandra/lib/snakeyaml-1.6.jar:/usr/share/cassandra/lib/snappy-java-1.0.4.1.jar:/usr/share/cassandra/apache-cassandra-1.0.6.jar:/usr/share/cassandra/apache-cassandra-thrift-1.0.6.jar:/usr/share/cassandra/apache-cassandra.jar:/usr/share/java/jna.jar:/etc/cassandra:/usr/share/java/commons-daemon.jar:/usr/share/cassandra/lib/jamm-0.2.5.jar
> INFO 10:28:24,955 Unable to link C library. Native methods will be
> disabled.
> INFO 10:28:25,002 Loading settings from file:/etc/cassandra/cassandra.yaml
> DEBUG 10:28:25,158 Syncing log with a period of 10000
> INFO 10:28:25,158 DiskAccessMode 'auto' determined to be mmap,
> indexAccessMode is mmap
> INFO 10:28:25,196 Global memtable threshold is enabled at 334MB
> DEBUG 10:28:25,220 loaded network topology /192.168.2.2:
> [Ljava.lang.String;@208a0544, /192.168.2.254:[Ljava.lang.String;@455fc40c
> DEBUG 10:28:25,504 setting auto_bootstrap to true
> DEBUG 10:28:25,612 Adding org.apache.cassandra.config.CFMetaData@38aa233f[cfId=0,ksName=system,cfName=LocationInfo,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=persistent
> metadata for the local
> node,rowCacheSize=0.0,keyCacheSize=0.01,readRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.BytesType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=0,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@29f01a29,mergeShardsChance=0.0,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:25,614 Adding org.apache.cassandra.config.CFMetaData@54c01e99[cfId=1,ksName=system,cfName=HintsColumnFamily,cfType=Super,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=org.apache.cassandra.db.marshal.BytesType,comment=hinted
> handoff
> data,rowCacheSize=0.0,keyCacheSize=0.01,readRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.BytesType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=0,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@29f01a29,mergeShardsChance=0.0,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:25,615 Adding org.apache.cassandra.config.CFMetaData@7ed75415[cfId=2,ksName=system,cfName=Migrations,cfType=Standard,comparator=org.apache.cassandra.db.marshal.TimeUUIDType,subcolumncomparator=<null>,comment=individual
> schema
> mutations,rowCacheSize=0.0,keyCacheSize=0.01,readRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.BytesType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=0,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@29f01a29,mergeShardsChance=0.0,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:25,616 Adding org.apache.cassandra.config.CFMetaData@5c001eb0[cfId=3,ksName=system,cfName=Schema,cfType=Standard,comparator=org.apache.cassandra.db.marshal.UTF8Type,subcolumncomparator=<null>,comment=current
> state of the
> schema,rowCacheSize=0.0,keyCacheSize=0.01,readRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.BytesType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=0,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@29f01a29,mergeShardsChance=0.0,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:25,617 Adding org.apache.cassandra.config.CFMetaData@bdee400[cfId=5,ksName=system,cfName=IndexInfo,cfType=Standard,comparator=org.apache.cassandra.db.marshal.UTF8Type,subcolumncomparator=<null>,comment=indexes
> that have been
> completed,rowCacheSize=0.0,keyCacheSize=0.01,readRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.BytesType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=0,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@29f01a29,mergeShardsChance=0.0,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:25,617 Adding org.apache.cassandra.config.CFMetaData@564ac216[cfId=6,ksName=system,cfName=NodeIdInfo,cfType=Standard,comparator=org.apache.cassandra.db.marshal.TimeUUIDType,subcolumncomparator=<null>,comment=nodeId
> and their
> metadata,rowCacheSize=0.0,keyCacheSize=0.01,readRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.BytesType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=0,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@29f01a29,mergeShardsChance=0.0,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:25,622 Adding org.apache.cassandra.config.CFMetaData@7c9e67a[cfId=7,ksName=system,cfName=Versions,cfType=Standard,comparator=org.apache.cassandra.db.marshal.UTF8Type,subcolumncomparator=<null>,comment=server
> version
> information,rowCacheSize=0.0,keyCacheSize=0.01,readRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.UTF8Type,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=0,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@29f01a29,mergeShardsChance=0.0,keyAlias=java.nio.HeapByteBuffer[pos=0
> lim=9 cap=9],column_metadata={java.nio.HeapByteBuffer[pos=0 lim=7
> cap=7]=ColumnDefinition{name=76657273696f6e,
> validator=org.apache.cassandra.db.marshal.UTF8Type, index_type=null,
> index_name='null'}},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:25,639 Removing compacted SSTable files from NodeIdInfo (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:25,642 Removing compacted SSTable files from Versions (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:25,656 Removing compacted SSTable files from
> Versions.76657273696f6e (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:25,658 Removing compacted SSTable files from IndexInfo (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:25,660 Removing compacted SSTable files from Schema (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:25,662 Removing compacted SSTable files from Migrations (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:25,664 Removing compacted SSTable files from LocationInfo (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:25,666 Removing compacted SSTable files from HintsColumnFamily
> (see http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:25,674 Initializing system.NodeIdInfo
> DEBUG 10:28:25,683 Starting CFS NodeIdInfo
> DEBUG 10:28:25,726 Creating IntervalNode from []
> DEBUG 10:28:25,727 KeyCache capacity for NodeIdInfo is 1
> DEBUG 10:28:25,730 Initializing system.Versions
> DEBUG 10:28:25,733 Starting CFS Versions
> INFO 10:28:25,737 Opening /var/lib/cassandra/data/system/Versions-hc-2
> (247 bytes)
> INFO 10:28:25,738 Opening /var/lib/cassandra/data/system/Versions-hc-1
> (247 bytes)
> DEBUG 10:28:25,739 Load metadata for
> /var/lib/cassandra/data/system/Versions-hc-2
> DEBUG 10:28:25,739 Load metadata for
> /var/lib/cassandra/data/system/Versions-hc-1
> DEBUG 10:28:25,817 INDEX LOAD TIME for
> /var/lib/cassandra/data/system/Versions-hc-2: 80 ms.
> DEBUG 10:28:25,819 key cache contains 0/0 keys
> DEBUG 10:28:25,826 INDEX LOAD TIME for
> /var/lib/cassandra/data/system/Versions-hc-1: 89 ms.
> DEBUG 10:28:25,827 key cache contains 0/0 keys
> DEBUG 10:28:25,834 Creating IntervalNode from
> [Interval(DecoratedKey(93220794208128599841715671226150005828,
> 746872696674), DecoratedKey(135285944860343992175601105924967452217,
> 63716c)), Interval(DecoratedKey(93220794208128599841715671226150005828,
> 746872696674), DecoratedKey(135285944860343992175601105924967452217,
> 63716c))]
> DEBUG 10:28:25,839 adding /var/lib/cassandra/data/system/Versions-hc-2 to
> list of files tracked for system.Versions
> DEBUG 10:28:25,840 adding /var/lib/cassandra/data/system/Versions-hc-1 to
> list of files tracked for system.Versions
> DEBUG 10:28:25,841 KeyCache capacity for Versions is 2
> DEBUG 10:28:25,842 Initializing system.IndexInfo
> DEBUG 10:28:25,847 Starting CFS IndexInfo
> DEBUG 10:28:25,850 Creating IntervalNode from []
> DEBUG 10:28:25,850 KeyCache capacity for IndexInfo is 1
> DEBUG 10:28:25,851 Initializing system.Schema
> DEBUG 10:28:25,853 Starting CFS Schema
> INFO 10:28:25,856 Opening /var/lib/cassandra/data/system/Schema-hc-205
> (816910 bytes)
> DEBUG 10:28:25,856 Load metadata for
> /var/lib/cassandra/data/system/Schema-hc-205
> DEBUG 10:28:25,884 INDEX LOAD TIME for
> /var/lib/cassandra/data/system/Schema-hc-205: 29 ms.
> DEBUG 10:28:25,885 key cache contains 0/0 keys
> DEBUG 10:28:25,886 Creating IntervalNode from
> [Interval(DecoratedKey(343351170242274426530944996757406206,
> 34656464646637302d333762342d313165312d303030302d623164373066353536316264),
> DecoratedKey(169873932720083470673001179314947116137,
> 35646535326464302d333666612d313165312d303030302d636632643263616235316662))]
> DEBUG 10:28:25,887 adding /var/lib/cassandra/data/system/Schema-hc-205 to
> list of files tracked for system.Schema
> DEBUG 10:28:25,888 KeyCache capacity for Schema is 1
> DEBUG 10:28:25,889 Initializing system.Migrations
> DEBUG 10:28:25,894 Starting CFS Migrations
> INFO 10:28:25,900 Opening
> /var/lib/cassandra/data/system/Migrations-hc-205 (1328917 bytes)
> DEBUG 10:28:25,900 Load metadata for
> /var/lib/cassandra/data/system/Migrations-hc-205
> DEBUG 10:28:25,903 INDEX LOAD TIME for
> /var/lib/cassandra/data/system/Migrations-hc-205: 3 ms.
> DEBUG 10:28:25,904 key cache contains 0/0 keys
> DEBUG 10:28:25,904 Creating IntervalNode from
> [Interval(DecoratedKey(159559397954378837828954138596956659794,
> 4d6967726174696f6e73204b6579),
> DecoratedKey(159559397954378837828954138596956659794,
> 4d6967726174696f6e73204b6579))]
> DEBUG 10:28:25,905 adding /var/lib/cassandra/data/system/Migrations-hc-205
> to list of files tracked for system.Migrations
> DEBUG 10:28:25,905 KeyCache capacity for Migrations is 1
> DEBUG 10:28:25,906 Initializing system.LocationInfo
> DEBUG 10:28:25,908 Starting CFS LocationInfo
> INFO 10:28:25,911 Opening
> /var/lib/cassandra/data/system/LocationInfo-hc-9 (415 bytes)
> INFO 10:28:25,911 Opening
> /var/lib/cassandra/data/system/LocationInfo-hc-10 (163 bytes)
> DEBUG 10:28:25,912 Load metadata for
> /var/lib/cassandra/data/system/LocationInfo-hc-9
> DEBUG 10:28:25,912 Load metadata for
> /var/lib/cassandra/data/system/LocationInfo-hc-10
> DEBUG 10:28:25,927 INDEX LOAD TIME for
> /var/lib/cassandra/data/system/LocationInfo-hc-9: 16 ms.
> DEBUG 10:28:25,928 key cache contains 0/0 keys
> DEBUG 10:28:25,932 INDEX LOAD TIME for
> /var/lib/cassandra/data/system/LocationInfo-hc-10: 21 ms.
> DEBUG 10:28:25,933 key cache contains 0/0 keys
> DEBUG 10:28:25,935 Creating IntervalNode from
> [Interval(DecoratedKey(57348442436860668951429860183380413967, 52696e67),
> DecoratedKey(136380791207214638541884810421800860241, 426f6f747374726170)),
> Interval(DecoratedKey(61078635599166706937511052402724559481, 4c),
> DecoratedKey(136380791207214638541884810421800860241, 426f6f747374726170))]
> DEBUG 10:28:25,936 adding /var/lib/cassandra/data/system/LocationInfo-hc-9
> to list of files tracked for system.LocationInfo
> DEBUG 10:28:25,937 adding
> /var/lib/cassandra/data/system/LocationInfo-hc-10 to list of files tracked
> for system.LocationInfo
> DEBUG 10:28:25,938 KeyCache capacity for LocationInfo is 2
> DEBUG 10:28:25,938 Initializing system.HintsColumnFamily
> DEBUG 10:28:25,940 Starting CFS HintsColumnFamily
> DEBUG 10:28:25,942 Creating IntervalNode from []
> DEBUG 10:28:25,942 KeyCache capacity for HintsColumnFamily is 1
> DEBUG 10:28:25,950 collectTimeOrderedData
> DEBUG 10:28:26,008 collectTimeOrderedData
> INFO 10:28:26,034 Loading schema version
> d1c4fc80-37bd-11e1-0000-b1d70f5561bd
> DEBUG 10:28:26,039 collectAllData
> DEBUG 10:28:26,064 collecting 0 of 2147483647:
> Avro/Schema:false:2725@1325782420552
> DEBUG 10:28:26,065 collecting 1 of 2147483647:
> services:false:3494@1325782420552
> DEBUG 10:28:26,065 collecting 2 of 2147483647:
> tabaserver:false:1460@1325782420552
> DEBUG 10:28:26,066 collecting 3 of 2147483647:
> users:false:4011@1325782420552
> DEBUG 10:28:26,385 Adding org.apache.cassandra.config.CFMetaData@535c97e4
> [cfId=1008,ksName=services,cfName=PublishedServices,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.TimeUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@63f8247d,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
> lim=7 cap=7]=ColumnDefinition{name=63726561746564,
> validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=6
> cap=6]=ColumnDefinition{name=646f6d61696e,
> validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=2
> cap=2]=ColumnDefinition{name=6964,
> validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=10
> cap=10]=ColumnDefinition{name=69735f656e61626c6564,
> validator=org.apache.cassandra.db.marshal.BooleanType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
> cap=7]=ColumnDefinition{name=73657276696365,
> validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
> index_name='null'}},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:26,386 Adding org.apache.cassandra.config.CFMetaData@54a6af6e
> [cfId=1005,ksName=services,cfName=ServicesIndexAsciiType,cfType=Standard,comparator=org.apache.cassandra.db.marshal.AsciiType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.TimeUUIDType,keyValidator=org.apache.cassandra.db.marshal.AsciiType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@b478a2d,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:26,392 Adding org.apache.cassandra.config.CFMetaData@26c1186f
> [cfId=1009,ksName=services,cfName=PublishedServicesIndexTimeUUIDType,cfType=Standard,comparator=org.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db.marshal.TimeUUIDType,org.apache.cassandra.db.marshal.TimeUUIDType),subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.TimeUUIDType,keyValidator=org.apache.cassandra.db.marshal.AsciiType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@1d34263a,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:26,393 Adding org.apache.cassandra.config.CFMetaData@4ab9b8d0
> [cfId=1006,ksName=services,cfName=Services,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.TimeUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@67148603,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
> lim=7 cap=7]=ColumnDefinition{name=63726561746564,
> validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=2
> cap=2]=ColumnDefinition{name=6964,
> validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=4
> cap=4]=ColumnDefinition{name=6e616d65,
> validator=org.apache.cassandra.db.marshal.UTF8Type, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=5
> cap=5]=ColumnDefinition{name=6f776e6572,
> validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
> cap=7]=ColumnDefinition{name=75706461746564,
> validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
> index_name='null'}},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:26,393 Adding org.apache.cassandra.config.CFMetaData@746a63d3
> [cfId=1003,ksName=services,cfName=DomainsIndexAsciiType,cfType=Standard,comparator=org.apache.cassandra.db.marshal.AsciiType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.TimeUUIDType,keyValidator=org.apache.cassandra.db.marshal.AsciiType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@74bfed5a,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:26,394 Adding org.apache.cassandra.config.CFMetaData@6477eb97
> [cfId=1004,ksName=services,cfName=Domains,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.TimeUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@7d0c3a08,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
> lim=7 cap=7]=ColumnDefinition{name=63726561746564,
> validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=8
> cap=8]=ColumnDefinition{name=686f73746e616d65,
> validator=org.apache.cassandra.db.marshal.AsciiType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=2
> cap=2]=ColumnDefinition{name=6964,
> validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=5
> cap=5]=ColumnDefinition{name=6f776e6572,
> validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
> cap=7]=ColumnDefinition{name=75706461746564,
> validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
> index_name='null'}},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:26,395 Adding org.apache.cassandra.config.CFMetaData@2db6235b
> [cfId=1007,ksName=services,cfName=PublishedServicesIndexAsciiType,cfType=Standard,comparator=org.apache.cassandra.db.marshal.AsciiType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.TimeUUIDType,keyValidator=org.apache.cassandra.db.marshal.AsciiType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@10cb42cf,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:26,396 Adding org.apache.cassandra.config.CFMetaData@108f2ca6
> [cfId=1014,ksName=tabaserver,cfName=RSAKeys,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.TimeUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@27bc4ec8,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
> lim=5 cap=5]=ColumnDefinition{name=6279746573,
> validator=org.apache.cassandra.db.marshal.BytesType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
> cap=7]=ColumnDefinition{name=63726561746564,
> validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=2
> cap=2]=ColumnDefinition{name=6964,
> validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
> cap=7]=ColumnDefinition{name=6b65796e616d65,
> validator=org.apache.cassandra.db.marshal.BytesType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=5
> cap=5]=ColumnDefinition{name=6f776e6572,
> validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
> cap=7]=ColumnDefinition{name=75706461746564,
> validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
> index_name='null'}},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:26,396 Adding org.apache.cassandra.config.CFMetaData@3bd840d9
> [cfId=1013,ksName=tabaserver,cfName=RSAKeysIndexBytesType,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.TimeUUIDType,keyValidator=org.apache.cassandra.db.marshal.AsciiType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@72898540,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:26,397 Adding org.apache.cassandra.config.CFMetaData@228b677f
> [cfId=1016,ksName=tabaserver,cfName=Volatile,cfType=Standard,comparator=org.apache.cassandra.db.marshal.TimeUUIDType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.AsciiType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@6e37d490,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:26,397 Adding org.apache.cassandra.config.CFMetaData@13647278
> [cfId=1000,ksName=users,cfName=UsersIndexAsciiType,cfType=Standard,comparator=org.apache.cassandra.db.marshal.AsciiType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.TimeUUIDType,keyValidator=org.apache.cassandra.db.marshal.AsciiType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@27972e3a,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:26,398 Adding org.apache.cassandra.config.CFMetaData@4f7cd15d
> [cfId=1002,ksName=users,cfName=UsersIndexBooleanType,cfType=Standard,comparator=org.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db.marshal.BooleanType,org.apache.cassandra.db.marshal.TimeUUIDType),subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.TimeUUIDType,keyValidator=org.apache.cassandra.db.marshal.AsciiType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@b955970,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:26,398 Adding org.apache.cassandra.config.CFMetaData@7a22ce00
> [cfId=1012,ksName=users,cfName=RolesMembersOfcdb6ab3cdeeb5c2262ccbc4b388f18eff78b7483,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.TimeUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@302a0a5,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
> lim=7 cap=7]=ColumnDefinition{name=63726561746564,
> validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=2
> cap=2]=ColumnDefinition{name=6964,
> validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
> index_name='null'}},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:26,399 Adding org.apache.cassandra.config.CFMetaData@2180b22e
> [cfId=1001,ksName=users,cfName=Users,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.TimeUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@831fb31,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
> lim=7 cap=7]=ColumnDefinition{name=63726561746564,
> validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=5
> cap=5]=ColumnDefinition{name=656d61696c,
> validator=org.apache.cassandra.db.marshal.AsciiType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=8
> cap=8]=ColumnDefinition{name=66756c6c6e616d65,
> validator=org.apache.cassandra.db.marshal.UTF8Type, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=2
> cap=2]=ColumnDefinition{name=6964,
> validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=8
> cap=8]=ColumnDefinition{name=69735f61646d696e,
> validator=org.apache.cassandra.db.marshal.BooleanType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=8
> cap=8]=ColumnDefinition{name=70617373776f7264,
> validator=org.apache.cassandra.db.marshal.BytesType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
> cap=7]=ColumnDefinition{name=75706461746564,
> validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=8
> cap=8]=ColumnDefinition{name=757365726e616d65,
> validator=org.apache.cassandra.db.marshal.AsciiType, index_type=null,
> index_name='null'}},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:26,400 Adding org.apache.cassandra.config.CFMetaData@962522b
> [cfId=1011,ksName=users,cfName=RolesOf4daf582c37b411e1b5df001e68e87fec,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.TimeUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@160089dd,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
> lim=7 cap=7]=ColumnDefinition{name=63726561746564,
> validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
> cap=7]=ColumnDefinition{name=63726561746f72,
> validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=11
> cap=11]=ColumnDefinition{name=6465736372697074696f6e,
> validator=org.apache.cassandra.db.marshal.UTF8Type, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=2
> cap=2]=ColumnDefinition{name=6964,
> validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=4
> cap=4]=ColumnDefinition{name=6e616d65,
> validator=org.apache.cassandra.db.marshal.UTF8Type, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=6
> cap=6]=ColumnDefinition{name=706172656e74,
> validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
> cap=7]=ColumnDefinition{name=75706461746564,
> validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
> index_name='null'}},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:26,401 Adding org.apache.cassandra.config.CFMetaData@7d5b1773
> [cfId=1010,ksName=users,cfName=RolesOf4daf582c37b411e1b5df001e68e87fecIndexUTF8Type,cfType=Standard,comparator=org.apache.cassandra.db.marshal.UTF8Type,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.TimeUUIDType,keyValidator=org.apache.cassandra.db.marshal.AsciiType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@6760bf50,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:26,402 Adding org.apache.cassandra.config.CFMetaData@b05236
> [cfId=1015,ksName=users,cfName=UserSessions,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.TimeUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=
> 2147483647
> ,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@37e55794,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
> lim=5 cap=5]=ColumnDefinition{name=6279746573,
> validator=org.apache.cassandra.db.marshal.BytesType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=6
> cap=6]=ColumnDefinition{name=636c6f736564,
> validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
> cap=7]=ColumnDefinition{name=63726561746564,
> validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=2
> cap=2]=ColumnDefinition{name=6964,
> validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=17
> cap=17]=ColumnDefinition{name=7075626c69736865645f73657276696365,
> validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
> cap=7]=ColumnDefinition{name=75706461746564,
> validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
> index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=4
> cap=4]=ColumnDefinition{name=75736572,
> validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
> index_name='null'}},compactionStrategyClass=class
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
> to cfIdMap
> DEBUG 10:28:26,404 Removing compacted SSTable files from PublishedServices
> (see http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,405 Removing compacted SSTable files from
> PublishedServices.63726561746564 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,406 Removing compacted SSTable files from
> PublishedServices.646f6d61696e (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,406 Removing compacted SSTable files from
> PublishedServices.6964 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,407 Removing compacted SSTable files from
> PublishedServices.69735f656e61626c6564 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,407 Removing compacted SSTable files from
> PublishedServices.73657276696365 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,408 Removing compacted SSTable files from
> ServicesIndexAsciiType (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,408 Removing compacted SSTable files from
> PublishedServicesIndexTimeUUIDType (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,409 Removing compacted SSTable files from Services (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,409 Removing compacted SSTable files from
> Services.63726561746564 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,410 Removing compacted SSTable files from Services.6964
> (see http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,410 Removing compacted SSTable files from Services.6e616d65
> (see http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,411 Removing compacted SSTable files from
> Services.6f776e6572 (see http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,411 Removing compacted SSTable files from
> Services.75706461746564 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,412 Removing compacted SSTable files from
> DomainsIndexAsciiType (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,412 Removing compacted SSTable files from Domains (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,413 Removing compacted SSTable files from
> Domains.63726561746564 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,413 Removing compacted SSTable files from
> Domains.686f73746e616d65 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,414 Removing compacted SSTable files from Domains.6964 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,414 Removing compacted SSTable files from
> Domains.6f776e6572 (see http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,415 Removing compacted SSTable files from
> Domains.75706461746564 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,415 Removing compacted SSTable files from
> PublishedServicesIndexAsciiType (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,416 Removing compacted SSTable files from NodeIdInfo (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,417 Removing compacted SSTable files from Versions (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,419 Removing compacted SSTable files from
> Versions.76657273696f6e (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,421 Removing compacted SSTable files from IndexInfo (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,422 Removing compacted SSTable files from Schema (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,424 Removing compacted SSTable files from Migrations (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,426 Removing compacted SSTable files from LocationInfo (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,428 Removing compacted SSTable files from HintsColumnFamily
> (see http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,429 Removing compacted SSTable files from RSAKeys (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,430 Removing compacted SSTable files from
> RSAKeys.6279746573 (see http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,430 Removing compacted SSTable files from
> RSAKeys.63726561746564 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,431 Removing compacted SSTable files from RSAKeys.6964 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,431 Removing compacted SSTable files from
> RSAKeys.6b65796e616d65 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,432 Removing compacted SSTable files from
> RSAKeys.6f776e6572 (see http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,432 Removing compacted SSTable files from
> RSAKeys.75706461746564 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,433 Removing compacted SSTable files from
> RSAKeysIndexBytesType (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,433 Removing compacted SSTable files from Volatile (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,434 Removing compacted SSTable files from
> UsersIndexAsciiType (see http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,434 Removing compacted SSTable files from
> UsersIndexBooleanType (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,435 Removing compacted SSTable files from
> RolesMembersOfcdb6ab3cdeeb5c2262ccbc4b388f18eff78b7483 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,436 Removing compacted SSTable files from
> RolesMembersOfcdb6ab3cdeeb5c2262ccbc4b388f18eff78b7483.63726561746564 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,436 Removing compacted SSTable files from
> RolesMembersOfcdb6ab3cdeeb5c2262ccbc4b388f18eff78b7483.6964 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,437 Removing compacted SSTable files from Users (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,437 Removing compacted SSTable files from
> Users.63726561746564 (see http://wiki.apache.org/cassandra/MemtableSSTable
> )
> DEBUG 10:28:26,438 Removing compacted SSTable files from Users.656d61696c
> (see http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,438 Removing compacted SSTable files from
> Users.66756c6c6e616d65 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,439 Removing compacted SSTable files from Users.6964 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,439 Removing compacted SSTable files from
> Users.69735f61646d696e (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,440 Removing compacted SSTable files from
> Users.70617373776f7264 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,441 Removing compacted SSTable files from
> Users.75706461746564 (see http://wiki.apache.org/cassandra/MemtableSSTable
> )
> DEBUG 10:28:26,441 Removing compacted SSTable files from
> Users.757365726e616d65 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,446 Removing compacted SSTable files from
> RolesOf4daf582c37b411e1b5df001e68e87fec (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,447 Removing compacted SSTable files from
> RolesOf4daf582c37b411e1b5df001e68e87fec.63726561746564 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,448 Removing compacted SSTable files from
> RolesOf4daf582c37b411e1b5df001e68e87fec.63726561746f72 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,448 Removing compacted SSTable files from
> RolesOf4daf582c37b411e1b5df001e68e87fec.6465736372697074696f6e (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,449 Removing compacted SSTable files from
> RolesOf4daf582c37b411e1b5df001e68e87fec.6964 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,450 Removing compacted SSTable files from
> RolesOf4daf582c37b411e1b5df001e68e87fec.6e616d65 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,450 Removing compacted SSTable files from
> RolesOf4daf582c37b411e1b5df001e68e87fec.706172656e74 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,451 Removing compacted SSTable files from
> RolesOf4daf582c37b411e1b5df001e68e87fec.75706461746564 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,451 Removing compacted SSTable files from
> RolesOf4daf582c37b411e1b5df001e68e87fecIndexUTF8Type (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,452 Removing compacted SSTable files from UserSessions (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,452 Removing compacted SSTable files from
> UserSessions.6279746573 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,453 Removing compacted SSTable files from
> UserSessions.636c6f736564 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,453 Removing compacted SSTable files from
> UserSessions.63726561746564 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,454 Removing compacted SSTable files from UserSessions.6964
> (see http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,454 Removing compacted SSTable files from
> UserSessions.7075626c69736865645f73657276696365 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,455 Removing compacted SSTable files from
> UserSessions.75706461746564 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,455 Removing compacted SSTable files from
> UserSessions.75736572 (see
> http://wiki.apache.org/cassandra/MemtableSSTable)
> DEBUG 10:28:26,456 opening keyspace services
> DEBUG 10:28:26,457 Configured datacenter replicas are dc-galeria:2
> DEBUG 10:28:26,458 Initializing services.PublishedServices
> DEBUG 10:28:26,459 Starting CFS PublishedServices
> INFO 10:28:26,460 reading saved cache
> /var/lib/cassandra/saved_caches/services-PublishedServices-KeyCache
> DEBUG 10:28:26,472 completed reading (12 ms; 1 keys) saved cache
> /var/lib/cassandra/saved_caches/services-PublishedServices-KeyCache
> DEBUG 10:28:26,473 Creating IntervalNode from []
> DEBUG 10:28:26,473 KeyCache capacity for PublishedServices is 200000
> DEBUG 10:28:26,474 Initializing services.ServicesIndexAsciiType
> DEBUG 10:28:26,475 Starting CFS ServicesIndexAsciiType
> DEBUG 10:28:26,476 Creating IntervalNode from []
> DEBUG 10:28:26,477 KeyCache capacity for ServicesIndexAsciiType is 200000
> DEBUG 10:28:26,478 Initializing services.PublishedServicesIndexTimeUUIDType
> DEBUG 10:28:26,480 Starting CFS PublishedServicesIndexTimeUUIDType
> DEBUG 10:28:26,482 Creating IntervalNode from []
> DEBUG 10:28:26,483 KeyCache capacity for
> PublishedServicesIndexTimeUUIDType is 200000
> DEBUG 10:28:26,484 Initializing services.Services
> DEBUG 10:28:26,486 Starting CFS Services
> DEBUG 10:28:26,488 Creating IntervalNode from []
> DEBUG 10:28:26,488 KeyCache capacity for Services is 200000
> DEBUG 10:28:26,488 Initializing services.DomainsIndexAsciiType
> DEBUG 10:28:26,489 Starting CFS DomainsIndexAsciiType
> DEBUG 10:28:26,490 Creating IntervalNode from []
> DEBUG 10:28:26,491 KeyCache capacity for DomainsIndexAsciiType is 200000
> DEBUG 10:28:26,491 Initializing services.Domains
> DEBUG 10:28:26,492 Starting CFS Domains
> DEBUG 10:28:26,493 Creating IntervalNode from []
> DEBUG 10:28:26,493 KeyCache capacity for Domains is 200000
> DEBUG 10:28:26,493 Initializing services.PublishedServicesIndexAsciiType
> DEBUG 10:28:26,494 Starting CFS PublishedServicesIndexAsciiType
> DEBUG 10:28:26,495 Creating IntervalNode from []
> DEBUG 10:28:26,495 KeyCache capacity for PublishedServicesIndexAsciiType
> is 200000
> DEBUG 10:28:26,496 opening keyspace system
> DEBUG 10:28:26,497 opening keyspace tabaserver
> DEBUG 10:28:26,497 Configured datacenter replicas are dc-galeria:2
> DEBUG 10:28:26,498 Initializing tabaserver.RSAKeys
> DEBUG 10:28:26,498 Starting CFS RSAKeys
> DEBUG 10:28:26,499 Creating IntervalNode from []
> DEBUG 10:28:26,500 KeyCache capacity for RSAKeys is 200000
> DEBUG 10:28:26,500 Initializing tabaserver.RSAKeysIndexBytesType
> DEBUG 10:28:26,501 Starting CFS RSAKeysIndexBytesType
> DEBUG 10:28:26,501 Creating IntervalNode from []
> DEBUG 10:28:26,502 KeyCache capacity for RSAKeysIndexBytesType is 200000
> DEBUG 10:28:26,503 Initializing tabaserver.Volatile
> DEBUG 10:28:26,504 Starting CFS Volatile
> DEBUG 10:28:26,504 Creating IntervalNode from []
> DEBUG 10:28:26,505 KeyCache capacity for Volatile is 200000
> DEBUG 10:28:26,505 opening keyspace users
> DEBUG 10:28:26,506 Configured datacenter replicas are dc-galeria:2
> DEBUG 10:28:26,507 Initializing users.UsersIndexAsciiType
> DEBUG 10:28:26,507 Starting CFS UsersIndexAsciiType
> DEBUG 10:28:26,508 Creating IntervalNode from []
> DEBUG 10:28:26,509 KeyCache capacity for UsersIndexAsciiType is 200000
> DEBUG 10:28:26,509 Initializing users.UsersIndexBooleanType
> DEBUG 10:28:26,510 Starting CFS UsersIndexBooleanType
> DEBUG 10:28:26,511 Creating IntervalNode from []
> DEBUG 10:28:26,512 KeyCache capacity for UsersIndexBooleanType is 200000
> DEBUG 10:28:26,512 Initializing
> users.RolesMembersOfcdb6ab3cdeeb5c2262ccbc4b388f18eff78b7483
> DEBUG 10:28:26,513 Starting CFS
> RolesMembersOfcdb6ab3cdeeb5c2262ccbc4b388f18eff78b7483
> DEBUG 10:28:26,514 Creating IntervalNode from []
> DEBUG 10:28:26,514 KeyCache capacity for
> RolesMembersOfcdb6ab3cdeeb5c2262ccbc4b388f18eff78b7483 is 200000
> DEBUG 10:28:26,515 Initializing users.Users
> DEBUG 10:28:26,516 Starting CFS Users
> DEBUG 10:28:26,517 Creating IntervalNode from []
> DEBUG 10:28:26,517 KeyCache capacity for Users is 200000
> DEBUG 10:28:26,518 Initializing
> users.RolesOf4daf582c37b411e1b5df001e68e87fec
> DEBUG 10:28:26,518 Starting CFS RolesOf4daf582c37b411e1b5df001e68e87fec
> DEBUG 10:28:26,520 Creating IntervalNode from []
> DEBUG 10:28:26,520 KeyCache capacity for
> RolesOf4daf582c37b411e1b5df001e68e87fec is 200000
> DEBUG 10:28:26,520 Initializing
> users.RolesOf4daf582c37b411e1b5df001e68e87fecIndexUTF8Type
> DEBUG 10:28:26,521 Starting CFS
> RolesOf4daf582c37b411e1b5df001e68e87fecIndexUTF8Type
> DEBUG 10:28:26,522 Creating IntervalNode from []
> DEBUG 10:28:26,523 KeyCache capacity for
> RolesOf4daf582c37b411e1b5df001e68e87fecIndexUTF8Type is 200000
> DEBUG 10:28:26,523 Initializing users.UserSessions
> DEBUG 10:28:26,524 Starting CFS UserSessions
> DEBUG 10:28:26,525 Creating IntervalNode from []
> DEBUG 10:28:26,526 KeyCache capacity for UserSessions is 200000
> INFO 10:28:26,556 Creating new commitlog segment
> /var/lib/cassandra/commitlog/CommitLog-1325852906556.log
> INFO 10:28:26,564 Replaying
> /var/lib/cassandra/commitlog/CommitLog-1325761687379.log,
> /var/lib/cassandra/commitlog/CommitLog-1325850082581.log
> DEBUG 10:28:26,622 Replaying
> /var/lib/cassandra/commitlog/CommitLog-1325761687379.log starting at 0
> DEBUG 10:28:26,627 Reading mutation at 0
> DEBUG 10:28:26,695 replaying mutation for system.6275696c64:
> {ColumnFamily(Versions [version:false:5@0,])}
> DEBUG 10:28:26,743 Reading mutation at 91
> DEBUG 10:28:26,744 replaying mutation for system.63716c:
> {ColumnFamily(Versions [version:false:5@0,])}
> DEBUG 10:28:26,744 Reading mutation at 180
> DEBUG 10:28:26,745 replaying mutation for system.746872696674:
> {ColumnFamily(Versions [version:false:7@0,])}
> DEBUG 10:28:26,745 Reading mutation at 274
> DEBUG 10:28:26,746 replaying mutation for system.4c:
> {ColumnFamily(LocationInfo [47656e65726174696f6e:false:4@1325761741006000
> ,])}
> DEBUG 10:28:26,747 Reading mutation at 363
> DEBUG 10:28:26,747 replaying mutation for system.426f6f747374726170:
> {ColumnFamily(LocationInfo [42:false:1@1325761746849,])}
> DEBUG 10:28:26,747 Reading mutation at 448
> DEBUG 10:28:26,748 replaying mutation for system.4c:
> {ColumnFamily(LocationInfo [546f6b656e:false:16@1325761746852,])}
> DEBUG 10:28:26,748 Reading mutation at 544
> DEBUG 10:28:26,749 applying mutation of row 6275696c64
> DEBUG 10:28:26,749 applying mutation of row 746872696674
> DEBUG 10:28:26,749 applying mutation of row 63716c
> DEBUG 10:28:26,752 1 regions now allocated in
> org.apache.cassandra.utils.SlabAllocator@387b1641
> DEBUG 10:28:26,753 replaying mutation for
> tabaserver.636f6e6e656374696f6e73: {ColumnFamily(UserSessions
> [92db925c379711e182c2001e68e87fec:true:4@1325765994283058,])}
> DEBUG 10:28:26,754 applying mutation of row 636f6e6e656374696f6e73
> ERROR 10:28:26,754 Attempting to mutate non-existant column family 1015
> DEBUG 10:28:26,754 Reading mutation at 1472
> DEBUG 10:28:26,755 replaying mutation for
> tabaserver.636f6e6e656374696f6e73: {ColumnFamily(UserSessions
> [98b1a892379711e1bb3a001e68e87fec:true:4@1325766003942334,])}
> DEBUG 10:28:26,755 Reading mutation at 2400
> DEBUG 10:28:26,755 applying mutation of row 636f6e6e656374696f6e73
> DEBUG 10:28:26,755 replaying mutation for
> tabaserver.636f6e6e656374696f6e73: {ColumnFamily(UserSessions
> [bc7b80fe379711e1b2ec001e68e87fec:true:4@1325766063974128,])}
> ERROR 10:28:26,755 Attempting to mutate non-existant column family 1015
> DEBUG 10:28:26,756 Reading mutation at 3328
> DEBUG 10:28:26,756 applying mutation of row 636f6e6e656374696f6e73
> ERROR 10:28:26,756 Attempting to mutate non-existant column family 1015
> DEBUG 10:28:26,757 replaying mutation for
> tabaserver.636f6e6e656374696f6e73: {ColumnFamily(UserSessions
> [c0ee46bc379711e1af98001e68e87fec:true:4@1325766071444847,])}
> DEBUG 10:28:26,757 Reading mutation at 4256
> DEBUG 10:28:26,757 applying mutation of row 636f6e6e656374696f6e73
> DEBUG 10:28:26,758 replaying mutation for
> tabaserver.636f6e6e656374696f6e73: {ColumnFamily(UserSessions
> [99240760379811e18222001e68e87fec:true:4@1325766434192871,])}
> ERROR 10:28:26,758 Attempting to mutate non-existant column family 1015
> DEBUG 10:28:26,758 Reading mutation at 5184
> DEBUG 10:28:26,758 applying mutation of row 636f6e6e656374696f6e73
> ERROR 10:28:26,759 Attempting to mutate non-existant column family 1015
> DEBUG 10:28:26,759 replaying mutation for
> tabaserver.636f6e6e656374696f6e73: {ColumnFamily(UserSessions
> [47f1a580379a11e1aaa6001e68e87fec:true:4@1325767156959180,])}
> DEBUG 10:28:26,760 applying mutation of row 636f6e6e656374696f6e73
> ERROR 10:28:26,761 Attempting to mutate non-existant column family 1015
> DEBUG 10:28:26,761 Reading mutation at 6112
> INFO 10:28:26,762 Finished reading
> /var/lib/cassandra/commitlog/CommitLog-1325761687379.log
>
> java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.apache.commons.daemon.support.DaemonLoader.load(DaemonLoader.java:160)
> Caused by: java.lang.IndexOutOfBoundsException
> at java.nio.Buffer.checkIndex(Buffer.java:514)
> at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:121)
> at
> org.apache.cassandra.db.marshal.TimeUUIDType.compareTimestampBytes(TimeUUIDType.java:76)
> at
> org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:65)
> at
> org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:37)
> at
> java.util.concurrent.ConcurrentSkipListMap$ComparableUsingComparator.compareTo(ConcurrentSkipListMap.java:606)
> at
> java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:685)
> at
> java.util.concurrent.ConcurrentSkipListMap.doPut(ConcurrentSkipListMap.java:864)
>
> at
> java.util.concurrent.ConcurrentSkipListMap.putIfAbsent(ConcurrentSkipListMap.java:1893)
> at
> org.apache.cassandra.db.ThreadSafeSortedColumns.addColumn(ThreadSafeSortedColumns.java:88)
> at
> org.apache.cassandra.db.AbstractColumnContainer.addColumn(AbstractColumnContainer.java:129)
> at
> org.apache.cassandra.db.AbstractColumnContainer.addColumn(AbstractColumnContainer.java:124)
> at
> org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:148)
> at
> org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:139)
> at
> org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:132)
> at
> org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:401)
> at
> org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:285)
> at
> org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:172)
> at
> org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:196)
> at
> org.apache.cassandra.service.AbstractCassandraDaemon.init(AbstractCassandraDaemon.java:238)
> ... 5 more
> Cannot load daemon
> Service exit with a return value of 3
>
> 2012/1/4 aaron morton <aa...@thelastpickle.com>
>
>> If you have the time turn logging up to DEBUG and start again, it will
>> log where it failed. Put the logs aside incase there is a bug there.
>>
>>
>> To get things running again: Move the commit log segment out of the
>> directory and try the restart. Then run a repair from the node.
>>
>> Have you made any recent schema changes ?
>>
>> Hope that helps.
>>
>> -----------------
>> Aaron Morton
>> Freelance Developer
>> @aaronmorton
>> http://www.thelastpickle.com
>>
>> On 5/01/2012, at 5:09 AM, Carlo Pires wrote:
>>
>> Hi,
>>
>> I can't start a node of my cluster. Could someone help me to catch the
>> problem?
>>
>> Using: debian with cassandra 1.0.6.
>>
>> root@carlo-laptop:/etc/cassandra# cat /var/log/cassandra/output.log
>> INFO 13:46:00,596 JVM vendor/version: Java HotSpot(TM) 64-Bit Server
>> VM/1.6.0_26
>> INFO 13:46:00,600 Heap size: 1052770304/1052770304
>> INFO 13:46:00,601 Classpath:
>> /usr/share/cassandra/lib/antlr-3.2.jar:/usr/share/cassandra/lib/avro-1.4.0-fixes.jar:/usr/share/cassandra/lib/avro-1.4.0-sources-fixes.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.2.jar:/usr/share/cassandra/lib/commons-lang-2.4.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.2.jar:/usr/share/cassandra/lib/guava-r08.jar:/usr/share/cassandra/lib/high-scale-lib-1.1.2.jar:/usr/share/cassandra/lib/jackson-core-asl-1.4.0.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.4.0.jar:/usr/share/cassandra/lib/jamm-0.2.5.jar:/usr/share/cassandra/lib/jline-0.9.94.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0.6.jar:/usr/share/cassandra/lib/log4j-1.2.16.jar:/usr/share/cassandra/lib/servlet-api-2.5-20081211.jar:/usr/share/cassandra/lib/slf4j-api-1.6.1.jar:/usr/share/cassandra/lib/slf4j-log4j12-1.6.1.jar:/usr/share/cassandra/lib/snakeyaml-1.6.jar:/usr/share/cassandra/lib/snappy-java-1.0.4.1.jar:/usr/share/cassandra/apache-cassandra-1.0.6.jar:/usr/share/cassandra/apache-cassandra-thrift-1.0.6.jar:/usr/share/cassandra/apache-cassandra.jar:/usr/share/java/jna.jar:/etc/cassandra:/usr/share/java/commons-daemon.jar:/usr/share/cassandra/lib/jamm-0.2.5.jar
>> INFO 13:46:00,617 Unable to link C library. Native methods will be
>> disabled.
>> INFO 13:46:00,627 Loading settings from
>> file:/etc/cassandra/cassandra.yaml
>> INFO 13:46:00,767 DiskAccessMode 'auto' determined to be mmap,
>> indexAccessMode is mmap
>> INFO 13:46:00,783 Global memtable threshold is enabled at 334MB
>> INFO 13:46:01,086 Opening /var/lib/cassandra/data/system/Versions-hc-5
>> (247 bytes)
>> INFO 13:46:01,125 Opening /var/lib/cassandra/data/system/Schema-hc-394
>> (1307316 bytes)
>> INFO 13:46:01,125 Opening /var/lib/cassandra/data/system/Schema-hc-396
>> (14421 bytes)
>> INFO 13:46:01,145 Opening
>> /var/lib/cassandra/data/system/Migrations-hc-394 (2285452 bytes)
>> INFO 13:46:01,148 Opening
>> /var/lib/cassandra/data/system/Migrations-hc-396 (18582 bytes)
>> INFO 13:46:01,159 Opening
>> /var/lib/cassandra/data/system/LocationInfo-hc-13 (415 bytes)
>> INFO 13:46:01,162 Opening
>> /var/lib/cassandra/data/system/LocationInfo-hc-15 (163 bytes)
>> INFO 13:46:01,162 Opening
>> /var/lib/cassandra/data/system/LocationInfo-hc-14 (80 bytes)
>> INFO 13:46:01,175 Opening
>> /var/lib/cassandra/data/system/HintsColumnFamily-hc-7 (13566 bytes)
>> INFO 13:46:01,183 Opening
>> /var/lib/cassandra/data/system/HintsColumnFamily-hc-6 (1019 bytes)
>> INFO 13:46:01,227 Loading schema version
>> 5c583e90-3631-11e1-0000-b1d70f5561fa
>> INFO 13:46:01,572 Creating new commitlog segment
>> /var/lib/cassandra/commitlog/CommitLog-1325691961572.log
>> INFO 13:46:01,586 Replaying
>> /var/lib/cassandra/commitlog/CommitLog-1325586865178.log,
>> /var/lib/cassandra/commitlog/CommitLog-1325625102454.log,
>> /var/lib/cassandra/commitlog/CommitLog-1325674574711.log,
>> /var/lib/cassandra/commitlog/CommitLog-1325676430281.log,
>> /var/lib/cassandra/commitlog/CommitLog-1325676440840.log,
>> /var/lib/cassandra/commitlog/CommitLog-1325676472468.log,
>> /var/lib/cassandra/commitlog/CommitLog-1325690114212.log,
>> /var/lib/cassandra/commitlog/CommitLog-1325691142058.log,
>> /var/lib/cassandra/commitlog/CommitLog-1325691453774.log,
>> /var/lib/cassandra/commitlog/CommitLog-1325691528668.log
>> INFO 13:46:01,657 Finished reading
>> /var/lib/cassandra/commitlog/CommitLog-1325586865178.log
>> java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at
>> org.apache.commons.daemon.support.DaemonLoader.load(DaemonLoader.java:160)
>> Caused by: java.lang.IllegalArgumentException
>> at java.nio.Buffer.limit(Buffer.java:249)
>> at
>> org.apache.cassandra.db.marshal.AbstractCompositeType.getBytes(AbstractCompositeType.java:57)
>> at
>> org.apache.cassandra.db.marshal.AbstractCompositeType.getWithShortLength(AbstractCompositeType.java:66)
>> at
>> org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:82)
>> at
>> org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:37)
>> at
>> java.util.concurrent.ConcurrentSkipListMap$ComparableUsingComparator.compareTo(ConcurrentSkipListMap.java:606)
>> at
>> java.util.concurrent.ConcurrentSkipListMap.doPut(ConcurrentSkipListMap.java:878)
>> at
>> java.util.concurrent.ConcurrentSkipListMap.putIfAbsent(ConcurrentSkipListMap.java:1893)
>> at
>> org.apache.cassandra.db.ThreadSafeSortedColumns.addColumn(ThreadSafeSortedColumns.java:88)
>> at
>> org.apache.cassandra.db.AbstractColumnContainer.addColumn(AbstractColumnContainer.java:129)
>> at
>> org.apache.cassandra.db.AbstractColumnContainer.addColumn(AbstractColumnContainer.java:124)
>> at
>> org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:148)
>> at
>> org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:139)
>> at
>> org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:132)
>> at
>> org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:401)
>> at
>> org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:285)
>> at
>> org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:172)
>> at
>> org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:196)
>> at
>> org.apache.cassandra.service.AbstractCassandraDaemon.init(AbstractCassandraDaemon.java:238)
>> ... 5 more
>> Cannot load daemon
>> Service exit with a return value of 3
>>
>>
>>
>
>
> --
> Carlo Pires
> 62 8209-1444 TIM
> 62 3251-1383
> Skype: carlopires
>
Re: Cannot start cassandra node anymore
Posted by Carlo Pires <ca...@gmail.com>.
It happened again. As I could understand, it is trying to write in a CF I
dropped. But others nodes are running fine. I found out if I stop a running
node I can't start it again (I get the same error).
Can't I delete CFs on the fly in cassandra? Is this a bug?
root@carlo-laptop:/var/log/cassandra# cat output.log
INFO 10:28:24,928 JVM vendor/version: Java HotSpot(TM) 64-Bit Server
VM/1.6.0_26
INFO 10:28:24,932 Heap size: 1052770304/1052770304
INFO 10:28:24,933 Classpath:
/usr/share/cassandra/lib/antlr-3.2.jar:/usr/share/cassandra/lib/avro-1.4.0-fixes.jar:/usr/share/cassandra/lib/avro-1.4.0-sources-fixes.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.2.jar:/usr/share/cassandra/lib/commons-lang-2.4.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.2.jar:/usr/share/cassandra/lib/guava-r08.jar:/usr/share/cassandra/lib/high-scale-lib-1.1.2.jar:/usr/share/cassandra/lib/jackson-core-asl-1.4.0.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.4.0.jar:/usr/share/cassandra/lib/jamm-0.2.5.jar:/usr/share/cassandra/lib/jline-0.9.94.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0.6.jar:/usr/share/cassandra/lib/log4j-1.2.16.jar:/usr/share/cassandra/lib/servlet-api-2.5-20081211.jar:/usr/share/cassandra/lib/slf4j-api-1.6.1.jar:/usr/share/cassandra/lib/slf4j-log4j12-1.6.1.jar:/usr/share/cassandra/lib/snakeyaml-1.6.jar:/usr/share/cassandra/lib/snappy-java-1.0.4.1.jar:/usr/share/cassandra/apache-cassandra-1.0.6.jar:/usr/share/cassandra/apache-cassandra-thrift-1.0.6.jar:/usr/share/cassandra/apache-cassandra.jar:/usr/share/java/jna.jar:/etc/cassandra:/usr/share/java/commons-daemon.jar:/usr/share/cassandra/lib/jamm-0.2.5.jar
INFO 10:28:24,955 Unable to link C library. Native methods will be
disabled.
INFO 10:28:25,002 Loading settings from file:/etc/cassandra/cassandra.yaml
DEBUG 10:28:25,158 Syncing log with a period of 10000
INFO 10:28:25,158 DiskAccessMode 'auto' determined to be mmap,
indexAccessMode is mmap
INFO 10:28:25,196 Global memtable threshold is enabled at 334MB
DEBUG 10:28:25,220 loaded network topology /192.168.2.2:
[Ljava.lang.String;@208a0544, /192.168.2.254:[Ljava.lang.String;@455fc40c
DEBUG 10:28:25,504 setting auto_bootstrap to true
DEBUG 10:28:25,612 Adding
org.apache.cassandra.config.CFMetaData@38aa233f[cfId=0,ksName=system,cfName=LocationInfo,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=persistent
metadata for the local
node,rowCacheSize=0.0,keyCacheSize=0.01,readRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.BytesType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=0,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@29f01a29,mergeShardsChance=0.0,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:25,614 Adding
org.apache.cassandra.config.CFMetaData@54c01e99[cfId=1,ksName=system,cfName=HintsColumnFamily,cfType=Super,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=org.apache.cassandra.db.marshal.BytesType,comment=hinted
handoff
data,rowCacheSize=0.0,keyCacheSize=0.01,readRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.BytesType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=0,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@29f01a29,mergeShardsChance=0.0,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:25,615 Adding
org.apache.cassandra.config.CFMetaData@7ed75415[cfId=2,ksName=system,cfName=Migrations,cfType=Standard,comparator=org.apache.cassandra.db.marshal.TimeUUIDType,subcolumncomparator=<null>,comment=individual
schema
mutations,rowCacheSize=0.0,keyCacheSize=0.01,readRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.BytesType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=0,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@29f01a29,mergeShardsChance=0.0,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:25,616 Adding
org.apache.cassandra.config.CFMetaData@5c001eb0[cfId=3,ksName=system,cfName=Schema,cfType=Standard,comparator=org.apache.cassandra.db.marshal.UTF8Type,subcolumncomparator=<null>,comment=current
state of the
schema,rowCacheSize=0.0,keyCacheSize=0.01,readRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.BytesType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=0,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@29f01a29,mergeShardsChance=0.0,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:25,617 Adding
org.apache.cassandra.config.CFMetaData@bdee400[cfId=5,ksName=system,cfName=IndexInfo,cfType=Standard,comparator=org.apache.cassandra.db.marshal.UTF8Type,subcolumncomparator=<null>,comment=indexes
that have been
completed,rowCacheSize=0.0,keyCacheSize=0.01,readRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.BytesType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=0,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@29f01a29,mergeShardsChance=0.0,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:25,617 Adding
org.apache.cassandra.config.CFMetaData@564ac216[cfId=6,ksName=system,cfName=NodeIdInfo,cfType=Standard,comparator=org.apache.cassandra.db.marshal.TimeUUIDType,subcolumncomparator=<null>,comment=nodeId
and their
metadata,rowCacheSize=0.0,keyCacheSize=0.01,readRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.BytesType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=0,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@29f01a29,mergeShardsChance=0.0,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:25,622 Adding
org.apache.cassandra.config.CFMetaData@7c9e67a[cfId=7,ksName=system,cfName=Versions,cfType=Standard,comparator=org.apache.cassandra.db.marshal.UTF8Type,subcolumncomparator=<null>,comment=server
version
information,rowCacheSize=0.0,keyCacheSize=0.01,readRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.UTF8Type,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=0,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@29f01a29,mergeShardsChance=0.0,keyAlias=java.nio.HeapByteBuffer[pos=0
lim=9 cap=9],column_metadata={java.nio.HeapByteBuffer[pos=0 lim=7
cap=7]=ColumnDefinition{name=76657273696f6e,
validator=org.apache.cassandra.db.marshal.UTF8Type, index_type=null,
index_name='null'}},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:25,639 Removing compacted SSTable files from NodeIdInfo (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:25,642 Removing compacted SSTable files from Versions (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:25,656 Removing compacted SSTable files from
Versions.76657273696f6e (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:25,658 Removing compacted SSTable files from IndexInfo (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:25,660 Removing compacted SSTable files from Schema (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:25,662 Removing compacted SSTable files from Migrations (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:25,664 Removing compacted SSTable files from LocationInfo (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:25,666 Removing compacted SSTable files from HintsColumnFamily
(see http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:25,674 Initializing system.NodeIdInfo
DEBUG 10:28:25,683 Starting CFS NodeIdInfo
DEBUG 10:28:25,726 Creating IntervalNode from []
DEBUG 10:28:25,727 KeyCache capacity for NodeIdInfo is 1
DEBUG 10:28:25,730 Initializing system.Versions
DEBUG 10:28:25,733 Starting CFS Versions
INFO 10:28:25,737 Opening /var/lib/cassandra/data/system/Versions-hc-2
(247 bytes)
INFO 10:28:25,738 Opening /var/lib/cassandra/data/system/Versions-hc-1
(247 bytes)
DEBUG 10:28:25,739 Load metadata for
/var/lib/cassandra/data/system/Versions-hc-2
DEBUG 10:28:25,739 Load metadata for
/var/lib/cassandra/data/system/Versions-hc-1
DEBUG 10:28:25,817 INDEX LOAD TIME for
/var/lib/cassandra/data/system/Versions-hc-2: 80 ms.
DEBUG 10:28:25,819 key cache contains 0/0 keys
DEBUG 10:28:25,826 INDEX LOAD TIME for
/var/lib/cassandra/data/system/Versions-hc-1: 89 ms.
DEBUG 10:28:25,827 key cache contains 0/0 keys
DEBUG 10:28:25,834 Creating IntervalNode from
[Interval(DecoratedKey(93220794208128599841715671226150005828,
746872696674), DecoratedKey(135285944860343992175601105924967452217,
63716c)), Interval(DecoratedKey(93220794208128599841715671226150005828,
746872696674), DecoratedKey(135285944860343992175601105924967452217,
63716c))]
DEBUG 10:28:25,839 adding /var/lib/cassandra/data/system/Versions-hc-2 to
list of files tracked for system.Versions
DEBUG 10:28:25,840 adding /var/lib/cassandra/data/system/Versions-hc-1 to
list of files tracked for system.Versions
DEBUG 10:28:25,841 KeyCache capacity for Versions is 2
DEBUG 10:28:25,842 Initializing system.IndexInfo
DEBUG 10:28:25,847 Starting CFS IndexInfo
DEBUG 10:28:25,850 Creating IntervalNode from []
DEBUG 10:28:25,850 KeyCache capacity for IndexInfo is 1
DEBUG 10:28:25,851 Initializing system.Schema
DEBUG 10:28:25,853 Starting CFS Schema
INFO 10:28:25,856 Opening /var/lib/cassandra/data/system/Schema-hc-205
(816910 bytes)
DEBUG 10:28:25,856 Load metadata for
/var/lib/cassandra/data/system/Schema-hc-205
DEBUG 10:28:25,884 INDEX LOAD TIME for
/var/lib/cassandra/data/system/Schema-hc-205: 29 ms.
DEBUG 10:28:25,885 key cache contains 0/0 keys
DEBUG 10:28:25,886 Creating IntervalNode from
[Interval(DecoratedKey(343351170242274426530944996757406206,
34656464646637302d333762342d313165312d303030302d623164373066353536316264),
DecoratedKey(169873932720083470673001179314947116137,
35646535326464302d333666612d313165312d303030302d636632643263616235316662))]
DEBUG 10:28:25,887 adding /var/lib/cassandra/data/system/Schema-hc-205 to
list of files tracked for system.Schema
DEBUG 10:28:25,888 KeyCache capacity for Schema is 1
DEBUG 10:28:25,889 Initializing system.Migrations
DEBUG 10:28:25,894 Starting CFS Migrations
INFO 10:28:25,900 Opening /var/lib/cassandra/data/system/Migrations-hc-205
(1328917 bytes)
DEBUG 10:28:25,900 Load metadata for
/var/lib/cassandra/data/system/Migrations-hc-205
DEBUG 10:28:25,903 INDEX LOAD TIME for
/var/lib/cassandra/data/system/Migrations-hc-205: 3 ms.
DEBUG 10:28:25,904 key cache contains 0/0 keys
DEBUG 10:28:25,904 Creating IntervalNode from
[Interval(DecoratedKey(159559397954378837828954138596956659794,
4d6967726174696f6e73204b6579),
DecoratedKey(159559397954378837828954138596956659794,
4d6967726174696f6e73204b6579))]
DEBUG 10:28:25,905 adding /var/lib/cassandra/data/system/Migrations-hc-205
to list of files tracked for system.Migrations
DEBUG 10:28:25,905 KeyCache capacity for Migrations is 1
DEBUG 10:28:25,906 Initializing system.LocationInfo
DEBUG 10:28:25,908 Starting CFS LocationInfo
INFO 10:28:25,911 Opening /var/lib/cassandra/data/system/LocationInfo-hc-9
(415 bytes)
INFO 10:28:25,911 Opening
/var/lib/cassandra/data/system/LocationInfo-hc-10 (163 bytes)
DEBUG 10:28:25,912 Load metadata for
/var/lib/cassandra/data/system/LocationInfo-hc-9
DEBUG 10:28:25,912 Load metadata for
/var/lib/cassandra/data/system/LocationInfo-hc-10
DEBUG 10:28:25,927 INDEX LOAD TIME for
/var/lib/cassandra/data/system/LocationInfo-hc-9: 16 ms.
DEBUG 10:28:25,928 key cache contains 0/0 keys
DEBUG 10:28:25,932 INDEX LOAD TIME for
/var/lib/cassandra/data/system/LocationInfo-hc-10: 21 ms.
DEBUG 10:28:25,933 key cache contains 0/0 keys
DEBUG 10:28:25,935 Creating IntervalNode from
[Interval(DecoratedKey(57348442436860668951429860183380413967, 52696e67),
DecoratedKey(136380791207214638541884810421800860241, 426f6f747374726170)),
Interval(DecoratedKey(61078635599166706937511052402724559481, 4c),
DecoratedKey(136380791207214638541884810421800860241, 426f6f747374726170))]
DEBUG 10:28:25,936 adding /var/lib/cassandra/data/system/LocationInfo-hc-9
to list of files tracked for system.LocationInfo
DEBUG 10:28:25,937 adding /var/lib/cassandra/data/system/LocationInfo-hc-10
to list of files tracked for system.LocationInfo
DEBUG 10:28:25,938 KeyCache capacity for LocationInfo is 2
DEBUG 10:28:25,938 Initializing system.HintsColumnFamily
DEBUG 10:28:25,940 Starting CFS HintsColumnFamily
DEBUG 10:28:25,942 Creating IntervalNode from []
DEBUG 10:28:25,942 KeyCache capacity for HintsColumnFamily is 1
DEBUG 10:28:25,950 collectTimeOrderedData
DEBUG 10:28:26,008 collectTimeOrderedData
INFO 10:28:26,034 Loading schema version
d1c4fc80-37bd-11e1-0000-b1d70f5561bd
DEBUG 10:28:26,039 collectAllData
DEBUG 10:28:26,064 collecting 0 of 2147483647:
Avro/Schema:false:2725@1325782420552
DEBUG 10:28:26,065 collecting 1 of 2147483647:
services:false:3494@1325782420552
DEBUG 10:28:26,065 collecting 2 of 2147483647:
tabaserver:false:1460@1325782420552
DEBUG 10:28:26,066 collecting 3 of 2147483647:
users:false:4011@1325782420552
DEBUG 10:28:26,385 Adding org.apache.cassandra.config.CFMetaData@535c97e4
[cfId=1008,ksName=services,cfName=PublishedServices,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.TimeUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@63f8247d,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
lim=7 cap=7]=ColumnDefinition{name=63726561746564,
validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=6
cap=6]=ColumnDefinition{name=646f6d61696e,
validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=2
cap=2]=ColumnDefinition{name=6964,
validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=10
cap=10]=ColumnDefinition{name=69735f656e61626c6564,
validator=org.apache.cassandra.db.marshal.BooleanType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
cap=7]=ColumnDefinition{name=73657276696365,
validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
index_name='null'}},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:26,386 Adding org.apache.cassandra.config.CFMetaData@54a6af6e
[cfId=1005,ksName=services,cfName=ServicesIndexAsciiType,cfType=Standard,comparator=org.apache.cassandra.db.marshal.AsciiType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.TimeUUIDType,keyValidator=org.apache.cassandra.db.marshal.AsciiType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@b478a2d,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:26,392 Adding org.apache.cassandra.config.CFMetaData@26c1186f
[cfId=1009,ksName=services,cfName=PublishedServicesIndexTimeUUIDType,cfType=Standard,comparator=org.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db.marshal.TimeUUIDType,org.apache.cassandra.db.marshal.TimeUUIDType),subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.TimeUUIDType,keyValidator=org.apache.cassandra.db.marshal.AsciiType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@1d34263a,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:26,393 Adding org.apache.cassandra.config.CFMetaData@4ab9b8d0
[cfId=1006,ksName=services,cfName=Services,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.TimeUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@67148603,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
lim=7 cap=7]=ColumnDefinition{name=63726561746564,
validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=2
cap=2]=ColumnDefinition{name=6964,
validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=4
cap=4]=ColumnDefinition{name=6e616d65,
validator=org.apache.cassandra.db.marshal.UTF8Type, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=5
cap=5]=ColumnDefinition{name=6f776e6572,
validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
cap=7]=ColumnDefinition{name=75706461746564,
validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
index_name='null'}},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:26,393 Adding org.apache.cassandra.config.CFMetaData@746a63d3
[cfId=1003,ksName=services,cfName=DomainsIndexAsciiType,cfType=Standard,comparator=org.apache.cassandra.db.marshal.AsciiType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.TimeUUIDType,keyValidator=org.apache.cassandra.db.marshal.AsciiType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@74bfed5a,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:26,394 Adding org.apache.cassandra.config.CFMetaData@6477eb97
[cfId=1004,ksName=services,cfName=Domains,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.TimeUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@7d0c3a08,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
lim=7 cap=7]=ColumnDefinition{name=63726561746564,
validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=8
cap=8]=ColumnDefinition{name=686f73746e616d65,
validator=org.apache.cassandra.db.marshal.AsciiType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=2
cap=2]=ColumnDefinition{name=6964,
validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=5
cap=5]=ColumnDefinition{name=6f776e6572,
validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
cap=7]=ColumnDefinition{name=75706461746564,
validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
index_name='null'}},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:26,395 Adding org.apache.cassandra.config.CFMetaData@2db6235b
[cfId=1007,ksName=services,cfName=PublishedServicesIndexAsciiType,cfType=Standard,comparator=org.apache.cassandra.db.marshal.AsciiType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.TimeUUIDType,keyValidator=org.apache.cassandra.db.marshal.AsciiType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@10cb42cf,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:26,396 Adding org.apache.cassandra.config.CFMetaData@108f2ca6
[cfId=1014,ksName=tabaserver,cfName=RSAKeys,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.TimeUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@27bc4ec8,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
lim=5 cap=5]=ColumnDefinition{name=6279746573,
validator=org.apache.cassandra.db.marshal.BytesType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
cap=7]=ColumnDefinition{name=63726561746564,
validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=2
cap=2]=ColumnDefinition{name=6964,
validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
cap=7]=ColumnDefinition{name=6b65796e616d65,
validator=org.apache.cassandra.db.marshal.BytesType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=5
cap=5]=ColumnDefinition{name=6f776e6572,
validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
cap=7]=ColumnDefinition{name=75706461746564,
validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
index_name='null'}},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:26,396 Adding org.apache.cassandra.config.CFMetaData@3bd840d9
[cfId=1013,ksName=tabaserver,cfName=RSAKeysIndexBytesType,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.TimeUUIDType,keyValidator=org.apache.cassandra.db.marshal.AsciiType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@72898540,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:26,397 Adding org.apache.cassandra.config.CFMetaData@228b677f
[cfId=1016,ksName=tabaserver,cfName=Volatile,cfType=Standard,comparator=org.apache.cassandra.db.marshal.TimeUUIDType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.AsciiType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@6e37d490,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:26,397 Adding org.apache.cassandra.config.CFMetaData@13647278
[cfId=1000,ksName=users,cfName=UsersIndexAsciiType,cfType=Standard,comparator=org.apache.cassandra.db.marshal.AsciiType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.TimeUUIDType,keyValidator=org.apache.cassandra.db.marshal.AsciiType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@27972e3a,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:26,398 Adding org.apache.cassandra.config.CFMetaData@4f7cd15d
[cfId=1002,ksName=users,cfName=UsersIndexBooleanType,cfType=Standard,comparator=org.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db.marshal.BooleanType,org.apache.cassandra.db.marshal.TimeUUIDType),subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.TimeUUIDType,keyValidator=org.apache.cassandra.db.marshal.AsciiType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@b955970,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:26,398 Adding org.apache.cassandra.config.CFMetaData@7a22ce00
[cfId=1012,ksName=users,cfName=RolesMembersOfcdb6ab3cdeeb5c2262ccbc4b388f18eff78b7483,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.TimeUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@302a0a5,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
lim=7 cap=7]=ColumnDefinition{name=63726561746564,
validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=2
cap=2]=ColumnDefinition{name=6964,
validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
index_name='null'}},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:26,399 Adding org.apache.cassandra.config.CFMetaData@2180b22e
[cfId=1001,ksName=users,cfName=Users,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.TimeUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@831fb31,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
lim=7 cap=7]=ColumnDefinition{name=63726561746564,
validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=5
cap=5]=ColumnDefinition{name=656d61696c,
validator=org.apache.cassandra.db.marshal.AsciiType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=8
cap=8]=ColumnDefinition{name=66756c6c6e616d65,
validator=org.apache.cassandra.db.marshal.UTF8Type, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=2
cap=2]=ColumnDefinition{name=6964,
validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=8
cap=8]=ColumnDefinition{name=69735f61646d696e,
validator=org.apache.cassandra.db.marshal.BooleanType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=8
cap=8]=ColumnDefinition{name=70617373776f7264,
validator=org.apache.cassandra.db.marshal.BytesType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
cap=7]=ColumnDefinition{name=75706461746564,
validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=8
cap=8]=ColumnDefinition{name=757365726e616d65,
validator=org.apache.cassandra.db.marshal.AsciiType, index_type=null,
index_name='null'}},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:26,400 Adding org.apache.cassandra.config.CFMetaData@962522b
[cfId=1011,ksName=users,cfName=RolesOf4daf582c37b411e1b5df001e68e87fec,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.TimeUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@160089dd,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
lim=7 cap=7]=ColumnDefinition{name=63726561746564,
validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
cap=7]=ColumnDefinition{name=63726561746f72,
validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=11
cap=11]=ColumnDefinition{name=6465736372697074696f6e,
validator=org.apache.cassandra.db.marshal.UTF8Type, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=2
cap=2]=ColumnDefinition{name=6964,
validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=4
cap=4]=ColumnDefinition{name=6e616d65,
validator=org.apache.cassandra.db.marshal.UTF8Type, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=6
cap=6]=ColumnDefinition{name=706172656e74,
validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
cap=7]=ColumnDefinition{name=75706461746564,
validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
index_name='null'}},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:26,401 Adding org.apache.cassandra.config.CFMetaData@7d5b1773
[cfId=1010,ksName=users,cfName=RolesOf4daf582c37b411e1b5df001e68e87fecIndexUTF8Type,cfType=Standard,comparator=org.apache.cassandra.db.marshal.UTF8Type,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.TimeUUIDType,keyValidator=org.apache.cassandra.db.marshal.AsciiType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@6760bf50,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:26,402 Adding org.apache.cassandra.config.CFMetaData@b05236
[cfId=1015,ksName=users,cfName=UserSessions,cfType=Standard,comparator=org.apache.cassandra.db.marshal.BytesType,subcolumncomparator=<null>,comment=,rowCacheSize=0.0,keyCacheSize=200000.0,readRepairChance=1.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.TimeUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=14400,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.SerializingCacheProvider@37e55794,mergeShardsChance=0.1,keyAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
lim=5 cap=5]=ColumnDefinition{name=6279746573,
validator=org.apache.cassandra.db.marshal.BytesType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=6
cap=6]=ColumnDefinition{name=636c6f736564,
validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
cap=7]=ColumnDefinition{name=63726561746564,
validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=2
cap=2]=ColumnDefinition{name=6964,
validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=17
cap=17]=ColumnDefinition{name=7075626c69736865645f73657276696365,
validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=7
cap=7]=ColumnDefinition{name=75706461746564,
validator=org.apache.cassandra.db.marshal.DateType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=4
cap=4]=ColumnDefinition{name=75736572,
validator=org.apache.cassandra.db.marshal.TimeUUIDType, index_type=null,
index_name='null'}},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
to cfIdMap
DEBUG 10:28:26,404 Removing compacted SSTable files from PublishedServices
(see http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,405 Removing compacted SSTable files from
PublishedServices.63726561746564 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,406 Removing compacted SSTable files from
PublishedServices.646f6d61696e (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,406 Removing compacted SSTable files from
PublishedServices.6964 (see http://wiki.apache.org/cassandra/MemtableSSTable
)
DEBUG 10:28:26,407 Removing compacted SSTable files from
PublishedServices.69735f656e61626c6564 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,407 Removing compacted SSTable files from
PublishedServices.73657276696365 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,408 Removing compacted SSTable files from
ServicesIndexAsciiType (see http://wiki.apache.org/cassandra/MemtableSSTable
)
DEBUG 10:28:26,408 Removing compacted SSTable files from
PublishedServicesIndexTimeUUIDType (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,409 Removing compacted SSTable files from Services (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,409 Removing compacted SSTable files from
Services.63726561746564 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,410 Removing compacted SSTable files from Services.6964 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,410 Removing compacted SSTable files from Services.6e616d65
(see http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,411 Removing compacted SSTable files from
Services.6f776e6572 (see http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,411 Removing compacted SSTable files from
Services.75706461746564 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,412 Removing compacted SSTable files from
DomainsIndexAsciiType (see http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,412 Removing compacted SSTable files from Domains (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,413 Removing compacted SSTable files from
Domains.63726561746564 (see http://wiki.apache.org/cassandra/MemtableSSTable
)
DEBUG 10:28:26,413 Removing compacted SSTable files from
Domains.686f73746e616d65 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,414 Removing compacted SSTable files from Domains.6964 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,414 Removing compacted SSTable files from Domains.6f776e6572
(see http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,415 Removing compacted SSTable files from
Domains.75706461746564 (see http://wiki.apache.org/cassandra/MemtableSSTable
)
DEBUG 10:28:26,415 Removing compacted SSTable files from
PublishedServicesIndexAsciiType (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,416 Removing compacted SSTable files from NodeIdInfo (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,417 Removing compacted SSTable files from Versions (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,419 Removing compacted SSTable files from
Versions.76657273696f6e (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,421 Removing compacted SSTable files from IndexInfo (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,422 Removing compacted SSTable files from Schema (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,424 Removing compacted SSTable files from Migrations (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,426 Removing compacted SSTable files from LocationInfo (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,428 Removing compacted SSTable files from HintsColumnFamily
(see http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,429 Removing compacted SSTable files from RSAKeys (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,430 Removing compacted SSTable files from RSAKeys.6279746573
(see http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,430 Removing compacted SSTable files from
RSAKeys.63726561746564 (see http://wiki.apache.org/cassandra/MemtableSSTable
)
DEBUG 10:28:26,431 Removing compacted SSTable files from RSAKeys.6964 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,431 Removing compacted SSTable files from
RSAKeys.6b65796e616d65 (see http://wiki.apache.org/cassandra/MemtableSSTable
)
DEBUG 10:28:26,432 Removing compacted SSTable files from RSAKeys.6f776e6572
(see http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,432 Removing compacted SSTable files from
RSAKeys.75706461746564 (see http://wiki.apache.org/cassandra/MemtableSSTable
)
DEBUG 10:28:26,433 Removing compacted SSTable files from
RSAKeysIndexBytesType (see http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,433 Removing compacted SSTable files from Volatile (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,434 Removing compacted SSTable files from
UsersIndexAsciiType (see http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,434 Removing compacted SSTable files from
UsersIndexBooleanType (see http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,435 Removing compacted SSTable files from
RolesMembersOfcdb6ab3cdeeb5c2262ccbc4b388f18eff78b7483 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,436 Removing compacted SSTable files from
RolesMembersOfcdb6ab3cdeeb5c2262ccbc4b388f18eff78b7483.63726561746564 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,436 Removing compacted SSTable files from
RolesMembersOfcdb6ab3cdeeb5c2262ccbc4b388f18eff78b7483.6964 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,437 Removing compacted SSTable files from Users (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,437 Removing compacted SSTable files from
Users.63726561746564 (see http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,438 Removing compacted SSTable files from Users.656d61696c
(see http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,438 Removing compacted SSTable files from
Users.66756c6c6e616d65 (see http://wiki.apache.org/cassandra/MemtableSSTable
)
DEBUG 10:28:26,439 Removing compacted SSTable files from Users.6964 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,439 Removing compacted SSTable files from
Users.69735f61646d696e (see http://wiki.apache.org/cassandra/MemtableSSTable
)
DEBUG 10:28:26,440 Removing compacted SSTable files from
Users.70617373776f7264 (see http://wiki.apache.org/cassandra/MemtableSSTable
)
DEBUG 10:28:26,441 Removing compacted SSTable files from
Users.75706461746564 (see http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,441 Removing compacted SSTable files from
Users.757365726e616d65 (see http://wiki.apache.org/cassandra/MemtableSSTable
)
DEBUG 10:28:26,446 Removing compacted SSTable files from
RolesOf4daf582c37b411e1b5df001e68e87fec (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,447 Removing compacted SSTable files from
RolesOf4daf582c37b411e1b5df001e68e87fec.63726561746564 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,448 Removing compacted SSTable files from
RolesOf4daf582c37b411e1b5df001e68e87fec.63726561746f72 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,448 Removing compacted SSTable files from
RolesOf4daf582c37b411e1b5df001e68e87fec.6465736372697074696f6e (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,449 Removing compacted SSTable files from
RolesOf4daf582c37b411e1b5df001e68e87fec.6964 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,450 Removing compacted SSTable files from
RolesOf4daf582c37b411e1b5df001e68e87fec.6e616d65 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,450 Removing compacted SSTable files from
RolesOf4daf582c37b411e1b5df001e68e87fec.706172656e74 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,451 Removing compacted SSTable files from
RolesOf4daf582c37b411e1b5df001e68e87fec.75706461746564 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,451 Removing compacted SSTable files from
RolesOf4daf582c37b411e1b5df001e68e87fecIndexUTF8Type (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,452 Removing compacted SSTable files from UserSessions (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,452 Removing compacted SSTable files from
UserSessions.6279746573 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,453 Removing compacted SSTable files from
UserSessions.636c6f736564 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,453 Removing compacted SSTable files from
UserSessions.63726561746564 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,454 Removing compacted SSTable files from UserSessions.6964
(see http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,454 Removing compacted SSTable files from
UserSessions.7075626c69736865645f73657276696365 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,455 Removing compacted SSTable files from
UserSessions.75706461746564 (see
http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,455 Removing compacted SSTable files from
UserSessions.75736572 (see http://wiki.apache.org/cassandra/MemtableSSTable)
DEBUG 10:28:26,456 opening keyspace services
DEBUG 10:28:26,457 Configured datacenter replicas are dc-galeria:2
DEBUG 10:28:26,458 Initializing services.PublishedServices
DEBUG 10:28:26,459 Starting CFS PublishedServices
INFO 10:28:26,460 reading saved cache
/var/lib/cassandra/saved_caches/services-PublishedServices-KeyCache
DEBUG 10:28:26,472 completed reading (12 ms; 1 keys) saved cache
/var/lib/cassandra/saved_caches/services-PublishedServices-KeyCache
DEBUG 10:28:26,473 Creating IntervalNode from []
DEBUG 10:28:26,473 KeyCache capacity for PublishedServices is 200000
DEBUG 10:28:26,474 Initializing services.ServicesIndexAsciiType
DEBUG 10:28:26,475 Starting CFS ServicesIndexAsciiType
DEBUG 10:28:26,476 Creating IntervalNode from []
DEBUG 10:28:26,477 KeyCache capacity for ServicesIndexAsciiType is 200000
DEBUG 10:28:26,478 Initializing services.PublishedServicesIndexTimeUUIDType
DEBUG 10:28:26,480 Starting CFS PublishedServicesIndexTimeUUIDType
DEBUG 10:28:26,482 Creating IntervalNode from []
DEBUG 10:28:26,483 KeyCache capacity for PublishedServicesIndexTimeUUIDType
is 200000
DEBUG 10:28:26,484 Initializing services.Services
DEBUG 10:28:26,486 Starting CFS Services
DEBUG 10:28:26,488 Creating IntervalNode from []
DEBUG 10:28:26,488 KeyCache capacity for Services is 200000
DEBUG 10:28:26,488 Initializing services.DomainsIndexAsciiType
DEBUG 10:28:26,489 Starting CFS DomainsIndexAsciiType
DEBUG 10:28:26,490 Creating IntervalNode from []
DEBUG 10:28:26,491 KeyCache capacity for DomainsIndexAsciiType is 200000
DEBUG 10:28:26,491 Initializing services.Domains
DEBUG 10:28:26,492 Starting CFS Domains
DEBUG 10:28:26,493 Creating IntervalNode from []
DEBUG 10:28:26,493 KeyCache capacity for Domains is 200000
DEBUG 10:28:26,493 Initializing services.PublishedServicesIndexAsciiType
DEBUG 10:28:26,494 Starting CFS PublishedServicesIndexAsciiType
DEBUG 10:28:26,495 Creating IntervalNode from []
DEBUG 10:28:26,495 KeyCache capacity for PublishedServicesIndexAsciiType is
200000
DEBUG 10:28:26,496 opening keyspace system
DEBUG 10:28:26,497 opening keyspace tabaserver
DEBUG 10:28:26,497 Configured datacenter replicas are dc-galeria:2
DEBUG 10:28:26,498 Initializing tabaserver.RSAKeys
DEBUG 10:28:26,498 Starting CFS RSAKeys
DEBUG 10:28:26,499 Creating IntervalNode from []
DEBUG 10:28:26,500 KeyCache capacity for RSAKeys is 200000
DEBUG 10:28:26,500 Initializing tabaserver.RSAKeysIndexBytesType
DEBUG 10:28:26,501 Starting CFS RSAKeysIndexBytesType
DEBUG 10:28:26,501 Creating IntervalNode from []
DEBUG 10:28:26,502 KeyCache capacity for RSAKeysIndexBytesType is 200000
DEBUG 10:28:26,503 Initializing tabaserver.Volatile
DEBUG 10:28:26,504 Starting CFS Volatile
DEBUG 10:28:26,504 Creating IntervalNode from []
DEBUG 10:28:26,505 KeyCache capacity for Volatile is 200000
DEBUG 10:28:26,505 opening keyspace users
DEBUG 10:28:26,506 Configured datacenter replicas are dc-galeria:2
DEBUG 10:28:26,507 Initializing users.UsersIndexAsciiType
DEBUG 10:28:26,507 Starting CFS UsersIndexAsciiType
DEBUG 10:28:26,508 Creating IntervalNode from []
DEBUG 10:28:26,509 KeyCache capacity for UsersIndexAsciiType is 200000
DEBUG 10:28:26,509 Initializing users.UsersIndexBooleanType
DEBUG 10:28:26,510 Starting CFS UsersIndexBooleanType
DEBUG 10:28:26,511 Creating IntervalNode from []
DEBUG 10:28:26,512 KeyCache capacity for UsersIndexBooleanType is 200000
DEBUG 10:28:26,512 Initializing
users.RolesMembersOfcdb6ab3cdeeb5c2262ccbc4b388f18eff78b7483
DEBUG 10:28:26,513 Starting CFS
RolesMembersOfcdb6ab3cdeeb5c2262ccbc4b388f18eff78b7483
DEBUG 10:28:26,514 Creating IntervalNode from []
DEBUG 10:28:26,514 KeyCache capacity for
RolesMembersOfcdb6ab3cdeeb5c2262ccbc4b388f18eff78b7483 is 200000
DEBUG 10:28:26,515 Initializing users.Users
DEBUG 10:28:26,516 Starting CFS Users
DEBUG 10:28:26,517 Creating IntervalNode from []
DEBUG 10:28:26,517 KeyCache capacity for Users is 200000
DEBUG 10:28:26,518 Initializing
users.RolesOf4daf582c37b411e1b5df001e68e87fec
DEBUG 10:28:26,518 Starting CFS RolesOf4daf582c37b411e1b5df001e68e87fec
DEBUG 10:28:26,520 Creating IntervalNode from []
DEBUG 10:28:26,520 KeyCache capacity for
RolesOf4daf582c37b411e1b5df001e68e87fec is 200000
DEBUG 10:28:26,520 Initializing
users.RolesOf4daf582c37b411e1b5df001e68e87fecIndexUTF8Type
DEBUG 10:28:26,521 Starting CFS
RolesOf4daf582c37b411e1b5df001e68e87fecIndexUTF8Type
DEBUG 10:28:26,522 Creating IntervalNode from []
DEBUG 10:28:26,523 KeyCache capacity for
RolesOf4daf582c37b411e1b5df001e68e87fecIndexUTF8Type is 200000
DEBUG 10:28:26,523 Initializing users.UserSessions
DEBUG 10:28:26,524 Starting CFS UserSessions
DEBUG 10:28:26,525 Creating IntervalNode from []
DEBUG 10:28:26,526 KeyCache capacity for UserSessions is 200000
INFO 10:28:26,556 Creating new commitlog segment
/var/lib/cassandra/commitlog/CommitLog-1325852906556.log
INFO 10:28:26,564 Replaying
/var/lib/cassandra/commitlog/CommitLog-1325761687379.log,
/var/lib/cassandra/commitlog/CommitLog-1325850082581.log
DEBUG 10:28:26,622 Replaying
/var/lib/cassandra/commitlog/CommitLog-1325761687379.log starting at 0
DEBUG 10:28:26,627 Reading mutation at 0
DEBUG 10:28:26,695 replaying mutation for system.6275696c64:
{ColumnFamily(Versions [version:false:5@0,])}
DEBUG 10:28:26,743 Reading mutation at 91
DEBUG 10:28:26,744 replaying mutation for system.63716c:
{ColumnFamily(Versions [version:false:5@0,])}
DEBUG 10:28:26,744 Reading mutation at 180
DEBUG 10:28:26,745 replaying mutation for system.746872696674:
{ColumnFamily(Versions [version:false:7@0,])}
DEBUG 10:28:26,745 Reading mutation at 274
DEBUG 10:28:26,746 replaying mutation for system.4c:
{ColumnFamily(LocationInfo [47656e65726174696f6e:false:4@1325761741006000
,])}
DEBUG 10:28:26,747 Reading mutation at 363
DEBUG 10:28:26,747 replaying mutation for system.426f6f747374726170:
{ColumnFamily(LocationInfo [42:false:1@1325761746849,])}
DEBUG 10:28:26,747 Reading mutation at 448
DEBUG 10:28:26,748 replaying mutation for system.4c:
{ColumnFamily(LocationInfo [546f6b656e:false:16@1325761746852,])}
DEBUG 10:28:26,748 Reading mutation at 544
DEBUG 10:28:26,749 applying mutation of row 6275696c64
DEBUG 10:28:26,749 applying mutation of row 746872696674
DEBUG 10:28:26,749 applying mutation of row 63716c
DEBUG 10:28:26,752 1 regions now allocated in
org.apache.cassandra.utils.SlabAllocator@387b1641
DEBUG 10:28:26,753 replaying mutation for
tabaserver.636f6e6e656374696f6e73: {ColumnFamily(UserSessions
[92db925c379711e182c2001e68e87fec:true:4@1325765994283058,])}
DEBUG 10:28:26,754 applying mutation of row 636f6e6e656374696f6e73
ERROR 10:28:26,754 Attempting to mutate non-existant column family 1015
DEBUG 10:28:26,754 Reading mutation at 1472
DEBUG 10:28:26,755 replaying mutation for
tabaserver.636f6e6e656374696f6e73: {ColumnFamily(UserSessions
[98b1a892379711e1bb3a001e68e87fec:true:4@1325766003942334,])}
DEBUG 10:28:26,755 Reading mutation at 2400
DEBUG 10:28:26,755 applying mutation of row 636f6e6e656374696f6e73
DEBUG 10:28:26,755 replaying mutation for
tabaserver.636f6e6e656374696f6e73: {ColumnFamily(UserSessions
[bc7b80fe379711e1b2ec001e68e87fec:true:4@1325766063974128,])}
ERROR 10:28:26,755 Attempting to mutate non-existant column family 1015
DEBUG 10:28:26,756 Reading mutation at 3328
DEBUG 10:28:26,756 applying mutation of row 636f6e6e656374696f6e73
ERROR 10:28:26,756 Attempting to mutate non-existant column family 1015
DEBUG 10:28:26,757 replaying mutation for
tabaserver.636f6e6e656374696f6e73: {ColumnFamily(UserSessions
[c0ee46bc379711e1af98001e68e87fec:true:4@1325766071444847,])}
DEBUG 10:28:26,757 Reading mutation at 4256
DEBUG 10:28:26,757 applying mutation of row 636f6e6e656374696f6e73
DEBUG 10:28:26,758 replaying mutation for
tabaserver.636f6e6e656374696f6e73: {ColumnFamily(UserSessions
[99240760379811e18222001e68e87fec:true:4@1325766434192871,])}
ERROR 10:28:26,758 Attempting to mutate non-existant column family 1015
DEBUG 10:28:26,758 Reading mutation at 5184
DEBUG 10:28:26,758 applying mutation of row 636f6e6e656374696f6e73
ERROR 10:28:26,759 Attempting to mutate non-existant column family 1015
DEBUG 10:28:26,759 replaying mutation for
tabaserver.636f6e6e656374696f6e73: {ColumnFamily(UserSessions
[47f1a580379a11e1aaa6001e68e87fec:true:4@1325767156959180,])}
DEBUG 10:28:26,760 applying mutation of row 636f6e6e656374696f6e73
ERROR 10:28:26,761 Attempting to mutate non-existant column family 1015
DEBUG 10:28:26,761 Reading mutation at 6112
INFO 10:28:26,762 Finished reading
/var/lib/cassandra/commitlog/CommitLog-1325761687379.log
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.commons.daemon.support.DaemonLoader.load(DaemonLoader.java:160)
Caused by: java.lang.IndexOutOfBoundsException
at java.nio.Buffer.checkIndex(Buffer.java:514)
at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:121)
at
org.apache.cassandra.db.marshal.TimeUUIDType.compareTimestampBytes(TimeUUIDType.java:76)
at
org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:65)
at
org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:37)
at
java.util.concurrent.ConcurrentSkipListMap$ComparableUsingComparator.compareTo(ConcurrentSkipListMap.java:606)
at
java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:685)
at
java.util.concurrent.ConcurrentSkipListMap.doPut(ConcurrentSkipListMap.java:864)
at
java.util.concurrent.ConcurrentSkipListMap.putIfAbsent(ConcurrentSkipListMap.java:1893)
at
org.apache.cassandra.db.ThreadSafeSortedColumns.addColumn(ThreadSafeSortedColumns.java:88)
at
org.apache.cassandra.db.AbstractColumnContainer.addColumn(AbstractColumnContainer.java:129)
at
org.apache.cassandra.db.AbstractColumnContainer.addColumn(AbstractColumnContainer.java:124)
at
org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:148)
at
org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:139)
at
org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:132)
at
org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:401)
at
org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:285)
at
org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:172)
at
org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:196)
at
org.apache.cassandra.service.AbstractCassandraDaemon.init(AbstractCassandraDaemon.java:238)
... 5 more
Cannot load daemon
Service exit with a return value of 3
2012/1/4 aaron morton <aa...@thelastpickle.com>
> If you have the time turn logging up to DEBUG and start again, it will log
> where it failed. Put the logs aside incase there is a bug there.
>
>
> To get things running again: Move the commit log segment out of the
> directory and try the restart. Then run a repair from the node.
>
> Have you made any recent schema changes ?
>
> Hope that helps.
>
> -----------------
> Aaron Morton
> Freelance Developer
> @aaronmorton
> http://www.thelastpickle.com
>
> On 5/01/2012, at 5:09 AM, Carlo Pires wrote:
>
> Hi,
>
> I can't start a node of my cluster. Could someone help me to catch the
> problem?
>
> Using: debian with cassandra 1.0.6.
>
> root@carlo-laptop:/etc/cassandra# cat /var/log/cassandra/output.log
> INFO 13:46:00,596 JVM vendor/version: Java HotSpot(TM) 64-Bit Server
> VM/1.6.0_26
> INFO 13:46:00,600 Heap size: 1052770304/1052770304
> INFO 13:46:00,601 Classpath:
> /usr/share/cassandra/lib/antlr-3.2.jar:/usr/share/cassandra/lib/avro-1.4.0-fixes.jar:/usr/share/cassandra/lib/avro-1.4.0-sources-fixes.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.2.jar:/usr/share/cassandra/lib/commons-lang-2.4.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.2.jar:/usr/share/cassandra/lib/guava-r08.jar:/usr/share/cassandra/lib/high-scale-lib-1.1.2.jar:/usr/share/cassandra/lib/jackson-core-asl-1.4.0.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.4.0.jar:/usr/share/cassandra/lib/jamm-0.2.5.jar:/usr/share/cassandra/lib/jline-0.9.94.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0.6.jar:/usr/share/cassandra/lib/log4j-1.2.16.jar:/usr/share/cassandra/lib/servlet-api-2.5-20081211.jar:/usr/share/cassandra/lib/slf4j-api-1.6.1.jar:/usr/share/cassandra/lib/slf4j-log4j12-1.6.1.jar:/usr/share/cassandra/lib/snakeyaml-1.6.jar:/usr/share/cassandra/lib/snappy-java-1.0.4.1.jar:/usr/share/cassandra/apache-cassandra-1.0.6.jar:/usr/share/cassandra/apache-cassandra-thrift-1.0.6.jar:/usr/share/cassandra/apache-cassandra.jar:/usr/share/java/jna.jar:/etc/cassandra:/usr/share/java/commons-daemon.jar:/usr/share/cassandra/lib/jamm-0.2.5.jar
> INFO 13:46:00,617 Unable to link C library. Native methods will be
> disabled.
> INFO 13:46:00,627 Loading settings from file:/etc/cassandra/cassandra.yaml
> INFO 13:46:00,767 DiskAccessMode 'auto' determined to be mmap,
> indexAccessMode is mmap
> INFO 13:46:00,783 Global memtable threshold is enabled at 334MB
> INFO 13:46:01,086 Opening /var/lib/cassandra/data/system/Versions-hc-5
> (247 bytes)
> INFO 13:46:01,125 Opening /var/lib/cassandra/data/system/Schema-hc-394
> (1307316 bytes)
> INFO 13:46:01,125 Opening /var/lib/cassandra/data/system/Schema-hc-396
> (14421 bytes)
> INFO 13:46:01,145 Opening
> /var/lib/cassandra/data/system/Migrations-hc-394 (2285452 bytes)
> INFO 13:46:01,148 Opening
> /var/lib/cassandra/data/system/Migrations-hc-396 (18582 bytes)
> INFO 13:46:01,159 Opening
> /var/lib/cassandra/data/system/LocationInfo-hc-13 (415 bytes)
> INFO 13:46:01,162 Opening
> /var/lib/cassandra/data/system/LocationInfo-hc-15 (163 bytes)
> INFO 13:46:01,162 Opening
> /var/lib/cassandra/data/system/LocationInfo-hc-14 (80 bytes)
> INFO 13:46:01,175 Opening
> /var/lib/cassandra/data/system/HintsColumnFamily-hc-7 (13566 bytes)
> INFO 13:46:01,183 Opening
> /var/lib/cassandra/data/system/HintsColumnFamily-hc-6 (1019 bytes)
> INFO 13:46:01,227 Loading schema version
> 5c583e90-3631-11e1-0000-b1d70f5561fa
> INFO 13:46:01,572 Creating new commitlog segment
> /var/lib/cassandra/commitlog/CommitLog-1325691961572.log
> INFO 13:46:01,586 Replaying
> /var/lib/cassandra/commitlog/CommitLog-1325586865178.log,
> /var/lib/cassandra/commitlog/CommitLog-1325625102454.log,
> /var/lib/cassandra/commitlog/CommitLog-1325674574711.log,
> /var/lib/cassandra/commitlog/CommitLog-1325676430281.log,
> /var/lib/cassandra/commitlog/CommitLog-1325676440840.log,
> /var/lib/cassandra/commitlog/CommitLog-1325676472468.log,
> /var/lib/cassandra/commitlog/CommitLog-1325690114212.log,
> /var/lib/cassandra/commitlog/CommitLog-1325691142058.log,
> /var/lib/cassandra/commitlog/CommitLog-1325691453774.log,
> /var/lib/cassandra/commitlog/CommitLog-1325691528668.log
> INFO 13:46:01,657 Finished reading
> /var/lib/cassandra/commitlog/CommitLog-1325586865178.log
> java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.apache.commons.daemon.support.DaemonLoader.load(DaemonLoader.java:160)
> Caused by: java.lang.IllegalArgumentException
> at java.nio.Buffer.limit(Buffer.java:249)
> at
> org.apache.cassandra.db.marshal.AbstractCompositeType.getBytes(AbstractCompositeType.java:57)
> at
> org.apache.cassandra.db.marshal.AbstractCompositeType.getWithShortLength(AbstractCompositeType.java:66)
> at
> org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:82)
> at
> org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:37)
> at
> java.util.concurrent.ConcurrentSkipListMap$ComparableUsingComparator.compareTo(ConcurrentSkipListMap.java:606)
> at
> java.util.concurrent.ConcurrentSkipListMap.doPut(ConcurrentSkipListMap.java:878)
> at
> java.util.concurrent.ConcurrentSkipListMap.putIfAbsent(ConcurrentSkipListMap.java:1893)
> at
> org.apache.cassandra.db.ThreadSafeSortedColumns.addColumn(ThreadSafeSortedColumns.java:88)
> at
> org.apache.cassandra.db.AbstractColumnContainer.addColumn(AbstractColumnContainer.java:129)
> at
> org.apache.cassandra.db.AbstractColumnContainer.addColumn(AbstractColumnContainer.java:124)
> at
> org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:148)
> at
> org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:139)
> at
> org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:132)
> at
> org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:401)
> at
> org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:285)
> at
> org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:172)
> at
> org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:196)
> at
> org.apache.cassandra.service.AbstractCassandraDaemon.init(AbstractCassandraDaemon.java:238)
> ... 5 more
> Cannot load daemon
> Service exit with a return value of 3
>
>
>
--
Carlo Pires
62 8209-1444 TIM
62 3251-1383
Skype: carlopires
Re: Cannot start cassandra node anymore
Posted by aaron morton <aa...@thelastpickle.com>.
If you have the time turn logging up to DEBUG and start again, it will log where it failed. Put the logs aside incase there is a bug there.
To get things running again: Move the commit log segment out of the directory and try the restart. Then run a repair from the node.
Have you made any recent schema changes ?
Hope that helps.
-----------------
Aaron Morton
Freelance Developer
@aaronmorton
http://www.thelastpickle.com
On 5/01/2012, at 5:09 AM, Carlo Pires wrote:
> Hi,
>
> I can't start a node of my cluster. Could someone help me to catch the problem?
>
> Using: debian with cassandra 1.0.6.
>
> root@carlo-laptop:/etc/cassandra# cat /var/log/cassandra/output.log
> INFO 13:46:00,596 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.6.0_26
> INFO 13:46:00,600 Heap size: 1052770304/1052770304
> INFO 13:46:00,601 Classpath: /usr/share/cassandra/lib/antlr-3.2.jar:/usr/share/cassandra/lib/avro-1.4.0-fixes.jar:/usr/share/cassandra/lib/avro-1.4.0-sources-fixes.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.2.jar:/usr/share/cassandra/lib/commons-lang-2.4.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.2.jar:/usr/share/cassandra/lib/guava-r08.jar:/usr/share/cassandra/lib/high-scale-lib-1.1.2.jar:/usr/share/cassandra/lib/jackson-core-asl-1.4.0.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.4.0.jar:/usr/share/cassandra/lib/jamm-0.2.5.jar:/usr/share/cassandra/lib/jline-0.9.94.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0.6.jar:/usr/share/cassandra/lib/log4j-1.2.16.jar:/usr/share/cassandra/lib/servlet-api-2.5-20081211.jar:/usr/share/cassandra/lib/slf4j-api-1.6.1.jar:/usr/share/cassandra/lib/slf4j-log4j12-1.6.1.jar:/usr/share/cassandra/lib/snakeyaml-1.6.jar:/usr/share/cassandra/lib/snappy-java-1.0.4.1.jar:/usr/share/cassandra/apache-cassandra-1.0.6.jar:/usr/share/cassandra/apache-cassandra-thrift-1.0.6.jar:/usr/share/cassandra/apache-cassandra.jar:/usr/share/java/jna.jar:/etc/cassandra:/usr/share/java/commons-daemon.jar:/usr/share/cassandra/lib/jamm-0.2.5.jar
> INFO 13:46:00,617 Unable to link C library. Native methods will be disabled.
> INFO 13:46:00,627 Loading settings from file:/etc/cassandra/cassandra.yaml
> INFO 13:46:00,767 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
> INFO 13:46:00,783 Global memtable threshold is enabled at 334MB
> INFO 13:46:01,086 Opening /var/lib/cassandra/data/system/Versions-hc-5 (247 bytes)
> INFO 13:46:01,125 Opening /var/lib/cassandra/data/system/Schema-hc-394 (1307316 bytes)
> INFO 13:46:01,125 Opening /var/lib/cassandra/data/system/Schema-hc-396 (14421 bytes)
> INFO 13:46:01,145 Opening /var/lib/cassandra/data/system/Migrations-hc-394 (2285452 bytes)
> INFO 13:46:01,148 Opening /var/lib/cassandra/data/system/Migrations-hc-396 (18582 bytes)
> INFO 13:46:01,159 Opening /var/lib/cassandra/data/system/LocationInfo-hc-13 (415 bytes)
> INFO 13:46:01,162 Opening /var/lib/cassandra/data/system/LocationInfo-hc-15 (163 bytes)
> INFO 13:46:01,162 Opening /var/lib/cassandra/data/system/LocationInfo-hc-14 (80 bytes)
> INFO 13:46:01,175 Opening /var/lib/cassandra/data/system/HintsColumnFamily-hc-7 (13566 bytes)
> INFO 13:46:01,183 Opening /var/lib/cassandra/data/system/HintsColumnFamily-hc-6 (1019 bytes)
> INFO 13:46:01,227 Loading schema version 5c583e90-3631-11e1-0000-b1d70f5561fa
> INFO 13:46:01,572 Creating new commitlog segment /var/lib/cassandra/commitlog/CommitLog-1325691961572.log
> INFO 13:46:01,586 Replaying /var/lib/cassandra/commitlog/CommitLog-1325586865178.log, /var/lib/cassandra/commitlog/CommitLog-1325625102454.log, /var/lib/cassandra/commitlog/CommitLog-1325674574711.log, /var/lib/cassandra/commitlog/CommitLog-1325676430281.log, /var/lib/cassandra/commitlog/CommitLog-1325676440840.log, /var/lib/cassandra/commitlog/CommitLog-1325676472468.log, /var/lib/cassandra/commitlog/CommitLog-1325690114212.log, /var/lib/cassandra/commitlog/CommitLog-1325691142058.log, /var/lib/cassandra/commitlog/CommitLog-1325691453774.log, /var/lib/cassandra/commitlog/CommitLog-1325691528668.log
> INFO 13:46:01,657 Finished reading /var/lib/cassandra/commitlog/CommitLog-1325586865178.log
> java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.commons.daemon.support.DaemonLoader.load(DaemonLoader.java:160)
> Caused by: java.lang.IllegalArgumentException
> at java.nio.Buffer.limit(Buffer.java:249)
> at org.apache.cassandra.db.marshal.AbstractCompositeType.getBytes(AbstractCompositeType.java:57)
> at org.apache.cassandra.db.marshal.AbstractCompositeType.getWithShortLength(AbstractCompositeType.java:66)
> at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:82)
> at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:37)
> at java.util.concurrent.ConcurrentSkipListMap$ComparableUsingComparator.compareTo(ConcurrentSkipListMap.java:606)
> at java.util.concurrent.ConcurrentSkipListMap.doPut(ConcurrentSkipListMap.java:878)
> at java.util.concurrent.ConcurrentSkipListMap.putIfAbsent(ConcurrentSkipListMap.java:1893)
> at org.apache.cassandra.db.ThreadSafeSortedColumns.addColumn(ThreadSafeSortedColumns.java:88)
> at org.apache.cassandra.db.AbstractColumnContainer.addColumn(AbstractColumnContainer.java:129)
> at org.apache.cassandra.db.AbstractColumnContainer.addColumn(AbstractColumnContainer.java:124)
> at org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:148)
> at org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:139)
> at org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:132)
> at org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:401)
> at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:285)
> at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:172)
> at org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:196)
> at org.apache.cassandra.service.AbstractCassandraDaemon.init(AbstractCassandraDaemon.java:238)
> ... 5 more
> Cannot load daemon
> Service exit with a return value of 3
>