You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by B R <so...@gmail.com> on 2011/04/06 17:20:45 UTC
0.7.4 - Cassandra Nodes Do Not Start
Hi guys,
We are running a 2 node Cassandra cluster which has suddenly started giving
errors and the nodes do not start. I am pasting the start-up logs below. Any
help would be great. Thanks.
Error Log 1
[root@idata1_34 bin]# ./cassandra &
[1] 16945
[root@idata1_34 bin]# INFO 20:33:16,550 Logging initialized
INFO 20:33:16,566 Heap size: 2011168768/2011168768
INFO 20:33:16,568 JNA not found. Native methods will be disabled.
INFO 20:33:16,579 Loading settings from
file:/opt/servers/apache-cassandra-0.7.4/conf/cassandra.yaml
DEBUG 20:33:16,700 Syncing log with a period of 10000
INFO 20:33:16,700 DiskAccessMode 'auto' determined to be mmap,
indexAccessMode is mmap
DEBUG 20:33:16,772 setting auto_bootstrap to true
DEBUG 20:33:16,814 Initializing system.IndexInfo
DEBUG 20:33:16,822 Starting CFS IndexInfo
INFO 20:33:16,838 Opening /data/cassandra/data/system/IndexInfo-f-2
DEBUG 20:33:16,838 Load statistics for
/data/cassandra/data/system/IndexInfo-f-2
DEBUG 20:33:16,856 INDEX LOAD TIME for
/data/cassandra/data/system/IndexInfo-f-2: 17 ms.
DEBUG 20:33:16,858 key cache contains 0/0 keys
DEBUG 20:33:16,861 adding /data/cassandra/data/system/IndexInfo-f-2 to list
of files tracked for system.IndexInfo
DEBUG 20:33:16,862 key cache capacity for IndexInfo is 1
DEBUG 20:33:16,862 row cache capacity for IndexInfo is 0
DEBUG 20:33:16,866 Initializing system.Schema
DEBUG 20:33:16,868 Starting CFS Schema
INFO 20:33:16,870 Opening /data/cassandra/data/system/Schema-f-12
DEBUG 20:33:16,870 Load statistics for
/data/cassandra/data/system/Schema-f-12
DEBUG 20:33:16,872 INDEX LOAD TIME for
/data/cassandra/data/system/Schema-f-12: 2 ms.
DEBUG 20:33:16,872 key cache contains 0/0 keys
INFO 20:33:16,872 Opening /data/cassandra/data/system/Schema-f-11
DEBUG 20:33:16,872 Load statistics for
/data/cassandra/data/system/Schema-f-11
DEBUG 20:33:16,874 INDEX LOAD TIME for
/data/cassandra/data/system/Schema-f-11: 2 ms.
DEBUG 20:33:16,874 key cache contains 0/0 keys
DEBUG 20:33:16,874 adding /data/cassandra/data/system/Schema-f-12 to list of
files tracked for system.Schema
DEBUG 20:33:16,875 adding /data/cassandra/data/system/Schema-f-11 to list of
files tracked for system.Schema
DEBUG 20:33:16,875 key cache capacity for Schema is 2
DEBUG 20:33:16,876 row cache capacity for Schema is 0
DEBUG 20:33:16,876 Initializing system.Migrations
DEBUG 20:33:16,878 Starting CFS Migrations
INFO 20:33:16,879 Opening /data/cassandra/data/system/Migrations-f-12
DEBUG 20:33:16,880 Load statistics for
/data/cassandra/data/system/Migrations-f-12
DEBUG 20:33:16,881 INDEX LOAD TIME for
/data/cassandra/data/system/Migrations-f-12: 2 ms.
DEBUG 20:33:16,881 key cache contains 0/0 keys
INFO 20:33:16,881 Opening /data/cassandra/data/system/Migrations-f-11
DEBUG 20:33:16,882 Load statistics for
/data/cassandra/data/system/Migrations-f-11
DEBUG 20:33:16,883 INDEX LOAD TIME for
/data/cassandra/data/system/Migrations-f-11: 2 ms.
DEBUG 20:33:16,883 key cache contains 0/0 keys
DEBUG 20:33:16,883 adding /data/cassandra/data/system/Migrations-f-12 to
list of files tracked for system.Migrations
DEBUG 20:33:16,884 adding /data/cassandra/data/system/Migrations-f-11 to
list of files tracked for system.Migrations
DEBUG 20:33:16,884 key cache capacity for Migrations is 2
DEBUG 20:33:16,885 row cache capacity for Migrations is 0
DEBUG 20:33:16,885 Initializing system.LocationInfo
DEBUG 20:33:16,886 Starting CFS LocationInfo
INFO 20:33:16,887 reading saved cache
/data/cassandra/saved_caches/system-LocationInfo-KeyCache
DEBUG 20:33:16,888 completed reading (1 ms; 1 keys) saved cache
/data/cassandra/saved_caches/system-LocationInfo-KeyCache
INFO 20:33:16,891 Opening /data/cassandra/data/system/LocationInfo-f-14
DEBUG 20:33:16,891 Load statistics for
/data/cassandra/data/system/LocationInfo-f-14
DEBUG 20:33:16,895 INDEX LOAD TIME for
/data/cassandra/data/system/LocationInfo-f-14: 4 ms.
DEBUG 20:33:16,895 key cache contains 1/1 keys
INFO 20:33:16,896 Opening /data/cassandra/data/system/LocationInfo-f-16
DEBUG 20:33:16,897 Load statistics for
/data/cassandra/data/system/LocationInfo-f-16
DEBUG 20:33:16,899 INDEX LOAD TIME for
/data/cassandra/data/system/LocationInfo-f-16: 3 ms.
DEBUG 20:33:16,899 key cache contains 2/2 keys
INFO 20:33:16,900 Opening /data/cassandra/data/system/LocationInfo-f-15
DEBUG 20:33:16,900 Load statistics for
/data/cassandra/data/system/LocationInfo-f-15
DEBUG 20:33:16,903 INDEX LOAD TIME for
/data/cassandra/data/system/LocationInfo-f-15: 3 ms.
DEBUG 20:33:16,903 key cache contains 3/3 keys
DEBUG 20:33:16,903 adding /data/cassandra/data/system/LocationInfo-f-14 to
list of files tracked for system.LocationInfo
DEBUG 20:33:16,904 adding /data/cassandra/data/system/LocationInfo-f-16 to
list of files tracked for system.LocationInfo
DEBUG 20:33:16,905 adding /data/cassandra/data/system/LocationInfo-f-15 to
list of files tracked for system.LocationInfo
DEBUG 20:33:16,905 row cache capacity for LocationInfo is 0
DEBUG 20:33:16,906 Initializing system.HintsColumnFamily
DEBUG 20:33:16,907 Starting CFS HintsColumnFamily
DEBUG 20:33:16,909 key cache capacity for HintsColumnFamily is 1
DEBUG 20:33:16,909 row cache capacity for HintsColumnFamily is 0
INFO 20:33:16,945 Loading schema version
63345865-561d-11e0-9643-b78766e55908
DEBUG 20:33:16,950 collecting 0 of 2147483647:
Avro/Schema:false:2042@1300974503953
DEBUG 20:33:16,950 collecting 1 of 2147483647:
Keyspace1:false:1654@1300974503953
DEBUG 20:33:17,172 opening keyspace Keyspace1
DEBUG 20:33:17,173 Initializing Keyspace1.Indexed1
DEBUG 20:33:17,174 Starting CFS Indexed1
DEBUG 20:33:17,174 key cache capacity for Indexed1 is 200000
DEBUG 20:33:17,175 row cache capacity for Indexed1 is 0
DEBUG 20:33:17,178 Starting CFS Indexed1.birthdate_idx
DEBUG 20:33:17,179 key cache capacity for Indexed1.birthdate_idx is 200000
DEBUG 20:33:17,179 row cache capacity for Indexed1.birthdate_idx is 0
DEBUG 20:33:17,180 Initializing Keyspace1.Super1
DEBUG 20:33:17,181 Starting CFS Super1
DEBUG 20:33:17,181 key cache capacity for Super1 is 200000
DEBUG 20:33:17,182 row cache capacity for Super1 is 0
DEBUG 20:33:17,182 Initializing Keyspace1.Standard2
DEBUG 20:33:17,182 Starting CFS Standard2
DEBUG 20:33:17,183 key cache capacity for Standard2 is 100
DEBUG 20:33:17,183 row cache capacity for Standard2 is 0
DEBUG 20:33:17,184 Initializing Keyspace1.Standard1
DEBUG 20:33:17,184 Starting CFS Standard1
DEBUG 20:33:17,185 key cache capacity for Standard1 is 10000
DEBUG 20:33:17,185 row cache capacity for Standard1 is 1000
DEBUG 20:33:17,185 Initializing Keyspace1.Super2
DEBUG 20:33:17,186 Starting CFS Super2
DEBUG 20:33:17,187 key cache capacity for Super2 is 50
DEBUG 20:33:17,187 row cache capacity for Super2 is 10000
DEBUG 20:33:17,187 Initializing Keyspace1.Super3
DEBUG 20:33:17,188 Starting CFS Super3
DEBUG 20:33:17,188 key cache capacity for Super3 is 200000
DEBUG 20:33:17,189 row cache capacity for Super3 is 0
DEBUG 20:33:17,189 Initializing Keyspace1.StandardByUUID1
DEBUG 20:33:17,189 Starting CFS StandardByUUID1
DEBUG 20:33:17,190 key cache capacity for StandardByUUID1 is 200000
DEBUG 20:33:17,190 row cache capacity for StandardByUUID1 is 0
DEBUG 20:33:17,191 opening keyspace system
INFO 20:33:17,202 Creating new commitlog segment
/data/cassandra/commitlog/CommitLog-1302102197202.log
INFO 20:33:17,212 Replaying
/data/cassandra/commitlog/CommitLog-1302101944726.log
DEBUG 20:33:17,212 Replaying
/data/cassandra/commitlog/CommitLog-1302101944726.log starting at 444
INFO 20:33:17,212 Finished reading
/data/cassandra/commitlog/CommitLog-1302101944726.log
DEBUG 20:33:17,213 Finished waiting on mutations from recovery
INFO 20:33:17,213 Log replay complete
INFO 20:33:17,240 Cassandra version: 0.7.4
INFO 20:33:17,241 Thrift API version: 19.4.0
INFO 20:33:17,241 Loading persisted ring state
DEBUG 20:33:17,242 collecting 0 of 2147483647:
3a68db5dd35cd1fd15737d92a2166815:false:4@1300888831435
DEBUG 20:33:17,242 clearing cached endpoints
DEBUG 20:33:17,242 clearing cached endpoints
DEBUG 20:33:17,243 Estimating compactions for Standard2
DEBUG 20:33:17,244 Estimating compactions for Standard1
DEBUG 20:33:17,245 Estimating compactions for Super1
DEBUG 20:33:17,245 Estimating compactions for StandardByUUID1
DEBUG 20:33:17,245 Estimating compactions for Super3
DEBUG 20:33:17,245 Estimating compactions for Super2
DEBUG 20:33:17,245 Estimating compactions for Indexed1
DEBUG 20:33:17,245 Estimating compactions for LocationInfo
DEBUG 20:33:17,246 Estimating compactions for HintsColumnFamily
DEBUG 20:33:17,246 Estimating compactions for Migrations
DEBUG 20:33:17,246 Estimating compactions for Schema
DEBUG 20:33:17,246 Estimating compactions for IndexInfo
DEBUG 20:33:17,246 Checking to see if compaction of Standard2 would be
useful
DEBUG 20:33:17,247 Checking to see if compaction of Standard1 would be
useful
DEBUG 20:33:17,247 Checking to see if compaction of Super1 would be useful
DEBUG 20:33:17,247 Checking to see if compaction of StandardByUUID1 would be
useful
DEBUG 20:33:17,247 Checking to see if compaction of Super3 would be useful
DEBUG 20:33:17,247 Checking to see if compaction of Super2 would be useful
DEBUG 20:33:17,247 Checking to see if compaction of Indexed1 would be useful
DEBUG 20:33:17,248 Checking to see if compaction of LocationInfo would be
useful
DEBUG 20:33:17,248 Checking to see if compaction of HintsColumnFamily would
be useful
DEBUG 20:33:17,248 Checking to see if compaction of Migrations would be
useful
DEBUG 20:33:17,248 Checking to see if compaction of Schema would be useful
DEBUG 20:33:17,248 Checking to see if compaction of IndexInfo would be
useful
INFO 20:33:17,250 Starting up server gossip
DEBUG 20:33:17,253 applying mutation of row 4c
INFO 20:33:17,256 Enqueuing flush of Memtable-LocationInfo@1189111555(29
bytes, 1 operations)
INFO 20:33:17,257 Writing Memtable-LocationInfo@1189111555(29 bytes, 1
operations)
INFO 20:33:17,340 Completed flushing
/data/cassandra/data/system/LocationInfo-f-17-Data.db (80 bytes)
DEBUG 20:33:17,341 adding /data/cassandra/data/system/LocationInfo-f-17 to
list of files tracked for system.LocationInfo
DEBUG 20:33:17,342 key cache capacity for LocationInfo is 5
DEBUG 20:33:17,343 discard completed log segments for
CommitLogContext(file='/data/cassandra/commitlog/CommitLog-1302102197202.log',
position=148), column family 0.
DEBUG 20:33:17,343 Marking replay position 148 on commit log
CommitLogSegment(/data/cassandra/commitlog/CommitLog-1302102197202.log)
DEBUG 20:33:17,360 Announcing my schema is
63345865-561d-11e0-9643-b78766e55908
DEBUG 20:33:17,362 attempting to connect to /192.168.0.29
DEBUG 20:33:17,363 Checking to see if compaction of LocationInfo would be
useful
DEBUG 20:33:17,367 Created HHOM instance, registered MBean.
INFO 20:33:17,371 Using saved token 61078635599166706937511052402724559481
DEBUG 20:33:17,372 applying mutation of row 426f6f747374726170
DEBUG 20:33:17,372 Setting token to 61078635599166706937511052402724559481
DEBUG 20:33:17,373 applying mutation of row 4c
INFO 20:33:17,373 Enqueuing flush of Memtable-LocationInfo@1047055737(53
bytes, 2 operations)
INFO 20:33:17,374 Writing Memtable-LocationInfo@1047055737(53 bytes, 2
operations)
INFO 20:33:17,420 Compacting
[SSTableReader(path='/data/cassandra/data/system/LocationInfo-f-14-Data.db'),SSTableReader(path='/data/cassandra/data/system/LocationInfo-f-15-Data.db'),SSTableReader(path='/data/cassandra/data/system/LocationInfo-f-16-Data.db'),SSTableReader(path='/data/cassandra/data/system/LocationInfo-f-17-Data.db')]
DEBUG 20:33:17,423 index size for bloom filter calc for file :
/data/cassandra/data/system/LocationInfo-f-14-Data.db : 256
DEBUG 20:33:17,423 index size for bloom filter calc for file :
/data/cassandra/data/system/LocationInfo-f-15-Data.db : 512
DEBUG 20:33:17,423 index size for bloom filter calc for file :
/data/cassandra/data/system/LocationInfo-f-16-Data.db : 768
DEBUG 20:33:17,423 index size for bloom filter calc for file :
/data/cassandra/data/system/LocationInfo-f-17-Data.db : 1024
DEBUG 20:33:17,423 Expected bloom filter size : 1024
ERROR 20:33:17,440 Fatal exception in thread Thread[Thread-3,5,main]
java.io.IOError: java.io.EOFException
at
org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:73)
Caused by: java.io.EOFException
at java.io.DataInputStream.readInt(DataInputStream.java:375)
at
org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:61)
INFO 20:33:17,451 Completed flushing
/data/cassandra/data/system/LocationInfo-f-18-Data.db (163 bytes)
DEBUG 20:33:17,451 adding /data/cassandra/data/system/LocationInfo-f-18 to
list of files tracked for system.LocationInfo
DEBUG 20:33:17,452 key cache capacity for LocationInfo is 6
DEBUG 20:33:17,452 discard completed log segments for
CommitLogContext(file='/data/cassandra/commitlog/CommitLog-1302102197202.log',
position=444), column family 0.
DEBUG 20:33:17,453 Marking replay position 444 on commit log
CommitLogSegment(/data/cassandra/commitlog/CommitLog-1302102197202.log)
DEBUG 20:33:17,453 clearing cached endpoints
DEBUG 20:33:17,454 clearing cached endpoints
DEBUG 20:33:17,456 Normal
DEBUG 20:33:17,457 Will try to load mx4j now, if it's in the classpath
INFO 20:33:17,458 Will not load MX4J, mx4j-tools.jar is not in the
classpath
[1]+ Exit 1 ./cassandra
[root@idata1_34 bin]#
Error Log 2
[root@idata2_29 bin]# ./cassandra &
[1] 22267
[root@idata2_29 bin]# INFO 20:32:47,295 Logging initialized
INFO 20:32:47,349 Heap size: 1622147072/1623195648
INFO 20:32:47,352 JNA not found. Native methods will be disabled.
INFO 20:32:47,367 Loading settings from
file:/opt/servers/apache-cassandra-0.7.4/conf/cassandra.yaml
DEBUG 20:32:47,617 Syncing log with a period of 10000
INFO 20:32:47,618 DiskAccessMode 'auto' determined to be mmap,
indexAccessMode is mmap
DEBUG 20:32:47,731 setting auto_bootstrap to false
DEBUG 20:32:47,785 Deleting LocationInfo-f-22-Data.db
DEBUG 20:32:47,785 Deleting LocationInfo-f-22-Filter.db
DEBUG 20:32:47,786 Deleting LocationInfo-f-22-Index.db
DEBUG 20:32:47,786 Deleting LocationInfo-f-22-Statistics.db
INFO 20:32:47,787 Deleted /data/cassandra/data/system/LocationInfo-f-22
DEBUG 20:32:47,787 Deleting LocationInfo-f-23-Data.db
DEBUG 20:32:47,788 Deleting LocationInfo-f-23-Filter.db
DEBUG 20:32:47,788 Deleting LocationInfo-f-23-Index.db
DEBUG 20:32:47,789 Deleting LocationInfo-f-23-Statistics.db
INFO 20:32:47,793 Deleted /data/cassandra/data/system/LocationInfo-f-23
DEBUG 20:32:47,793 Deleting LocationInfo-f-21-Data.db
DEBUG 20:32:47,794 Deleting LocationInfo-f-21-Filter.db
DEBUG 20:32:47,794 Deleting LocationInfo-f-21-Index.db
DEBUG 20:32:47,795 Deleting LocationInfo-f-21-Statistics.db
INFO 20:32:47,795 Deleted /data/cassandra/data/system/LocationInfo-f-21
DEBUG 20:32:47,816 Initializing system.IndexInfo
DEBUG 20:32:47,829 Starting CFS IndexInfo
INFO 20:32:47,851 reading saved cache
/data/cassandra/saved_caches/system-IndexInfo-KeyCache
DEBUG 20:32:47,854 completed reading (6 ms; 1 keys) saved cache
/data/cassandra/saved_caches/system-IndexInfo-KeyCache
INFO 20:32:47,862 Opening /data/cassandra/data/system/IndexInfo-f-1
DEBUG 20:32:47,863 Load statistics for
/data/cassandra/data/system/IndexInfo-f-1
DEBUG 20:32:47,898 INDEX LOAD TIME for
/data/cassandra/data/system/IndexInfo-f-1: 36 ms.
DEBUG 20:32:47,899 key cache contains 1/1 keys
DEBUG 20:32:47,905 adding /data/cassandra/data/system/IndexInfo-f-1 to list
of files tracked for system.IndexInfo
DEBUG 20:32:47,906 row cache capacity for IndexInfo is 0
DEBUG 20:32:47,911 Initializing system.Schema
DEBUG 20:32:47,916 Starting CFS Schema
INFO 20:32:47,918 reading saved cache
/data/cassandra/saved_caches/system-Schema-KeyCache
DEBUG 20:32:47,942 completed reading (13 ms; 1 keys) saved cache
/data/cassandra/saved_caches/system-Schema-KeyCache
INFO 20:32:47,945 Opening /data/cassandra/data/system/Schema-f-9
DEBUG 20:32:47,945 Load statistics for
/data/cassandra/data/system/Schema-f-9
DEBUG 20:32:47,950 INDEX LOAD TIME for
/data/cassandra/data/system/Schema-f-9: 5 ms.
DEBUG 20:32:47,951 key cache contains 1/1 keys
INFO 20:32:47,951 Opening /data/cassandra/data/system/Schema-f-10
DEBUG 20:32:47,951 Load statistics for
/data/cassandra/data/system/Schema-f-10
DEBUG 20:32:47,955 INDEX LOAD TIME for
/data/cassandra/data/system/Schema-f-10: 4 ms.
DEBUG 20:32:47,955 key cache contains 2/2 keys
DEBUG 20:32:47,956 adding /data/cassandra/data/system/Schema-f-9 to list of
files tracked for system.Schema
DEBUG 20:32:47,957 adding /data/cassandra/data/system/Schema-f-10 to list of
files tracked for system.Schema
DEBUG 20:32:47,958 row cache capacity for Schema is 0
DEBUG 20:32:47,958 Initializing system.Migrations
DEBUG 20:32:47,961 Starting CFS Migrations
INFO 20:32:47,962 reading saved cache
/data/cassandra/saved_caches/system-Migrations-KeyCache
DEBUG 20:32:47,963 completed reading (1 ms; 1 keys) saved cache
/data/cassandra/saved_caches/system-Migrations-KeyCache
INFO 20:32:47,965 Opening /data/cassandra/data/system/Migrations-f-9
DEBUG 20:32:47,966 Load statistics for
/data/cassandra/data/system/Migrations-f-9
DEBUG 20:32:47,970 INDEX LOAD TIME for
/data/cassandra/data/system/Migrations-f-9: 5 ms.
DEBUG 20:32:47,970 key cache contains 1/1 keys
INFO 20:32:47,971 Opening /data/cassandra/data/system/Migrations-f-10
DEBUG 20:32:47,971 Load statistics for
/data/cassandra/data/system/Migrations-f-10
DEBUG 20:32:47,975 INDEX LOAD TIME for
/data/cassandra/data/system/Migrations-f-10: 4 ms.
DEBUG 20:32:47,975 key cache contains 2/2 keys
DEBUG 20:32:47,976 adding /data/cassandra/data/system/Migrations-f-9 to list
of files tracked for system.Migrations
DEBUG 20:32:47,976 adding /data/cassandra/data/system/Migrations-f-10 to
list of files tracked for system.Migrations
DEBUG 20:32:47,977 row cache capacity for Migrations is 0
DEBUG 20:32:47,978 Initializing system.LocationInfo
DEBUG 20:32:47,981 Starting CFS LocationInfo
INFO 20:32:47,982 reading saved cache
/data/cassandra/saved_caches/system-LocationInfo-KeyCache
DEBUG 20:32:47,983 completed reading (0 ms; 1 keys) saved cache
/data/cassandra/saved_caches/system-LocationInfo-KeyCache
INFO 20:32:47,985 Opening /data/cassandra/data/system/LocationInfo-f-25
DEBUG 20:32:47,985 Load statistics for
/data/cassandra/data/system/LocationInfo-f-25
DEBUG 20:32:47,990 INDEX LOAD TIME for
/data/cassandra/data/system/LocationInfo-f-25: 5 ms.
DEBUG 20:32:47,990 key cache contains 1/1 keys
DEBUG 20:32:47,991 adding /data/cassandra/data/system/LocationInfo-f-25 to
list of files tracked for system.LocationInfo
DEBUG 20:32:47,991 row cache capacity for LocationInfo is 0
DEBUG 20:32:47,992 Initializing system.HintsColumnFamily
DEBUG 20:32:48,002 Starting CFS HintsColumnFamily
DEBUG 20:32:48,005 key cache capacity for HintsColumnFamily is 1
DEBUG 20:32:48,006 row cache capacity for HintsColumnFamily is 0
INFO 20:32:48,069 Loading schema version
63345865-561d-11e0-9643-b78766e55908
DEBUG 20:32:48,080 collecting 0 of 2147483647:
Avro/Schema:false:2042@1300974503953
DEBUG 20:32:48,081 collecting 1 of 2147483647:
Keyspace1:false:1654@1300974503953
DEBUG 20:32:48,514 opening keyspace Keyspace1
DEBUG 20:32:48,515 Initializing Keyspace1.Indexed1
DEBUG 20:32:48,516 Starting CFS Indexed1
DEBUG 20:32:48,518 key cache capacity for Indexed1 is 200000
DEBUG 20:32:48,518 row cache capacity for Indexed1 is 0
DEBUG 20:32:48,524 Starting CFS Indexed1.birthdate_idx
DEBUG 20:32:48,526 key cache capacity for Indexed1.birthdate_idx is 200000
DEBUG 20:32:48,526 row cache capacity for Indexed1.birthdate_idx is 0
DEBUG 20:32:48,528 Initializing Keyspace1.Super1
DEBUG 20:32:48,529 Starting CFS Super1
DEBUG 20:32:48,530 key cache capacity for Super1 is 200000
DEBUG 20:32:48,531 row cache capacity for Super1 is 0
DEBUG 20:32:48,532 Initializing Keyspace1.Standard2
DEBUG 20:32:48,533 Starting CFS Standard2
DEBUG 20:32:48,534 key cache capacity for Standard2 is 100
DEBUG 20:32:48,535 row cache capacity for Standard2 is 0
DEBUG 20:32:48,535 Initializing Keyspace1.Standard1
DEBUG 20:32:48,537 Starting CFS Standard1
DEBUG 20:32:48,538 key cache capacity for Standard1 is 10000
DEBUG 20:32:48,539 row cache capacity for Standard1 is 1000
DEBUG 20:32:48,540 Initializing Keyspace1.Super2
DEBUG 20:32:48,541 Starting CFS Super2
DEBUG 20:32:48,542 key cache capacity for Super2 is 50
DEBUG 20:32:48,543 row cache capacity for Super2 is 10000
DEBUG 20:32:48,544 Initializing Keyspace1.Super3
DEBUG 20:32:48,545 Starting CFS Super3
DEBUG 20:32:48,546 key cache capacity for Super3 is 200000
DEBUG 20:32:48,547 row cache capacity for Super3 is 0
DEBUG 20:32:48,548 Initializing Keyspace1.StandardByUUID1
DEBUG 20:32:48,549 Starting CFS StandardByUUID1
DEBUG 20:32:48,550 key cache capacity for StandardByUUID1 is 200000
DEBUG 20:32:48,550 row cache capacity for StandardByUUID1 is 0
DEBUG 20:32:48,552 opening keyspace system
INFO 20:32:48,571 Creating new commitlog segment
/data/cassandra/commitlog/CommitLog-1302102168571.log
INFO 20:32:48,587 Replaying
/data/cassandra/commitlog/CommitLog-1302101192234.log
DEBUG 20:32:48,588 Replaying
/data/cassandra/commitlog/CommitLog-1302101192234.log starting at 444
INFO 20:32:48,588 Finished reading
/data/cassandra/commitlog/CommitLog-1302101192234.log
DEBUG 20:32:48,588 Finished waiting on mutations from recovery
INFO 20:32:48,589 Log replay complete
DEBUG 20:32:48,625 Estimating compactions for Standard2
DEBUG 20:32:48,627 Estimating compactions for Standard1
DEBUG 20:32:48,628 Estimating compactions for Super1
DEBUG 20:32:48,628 Estimating compactions for StandardByUUID1
DEBUG 20:32:48,629 Estimating compactions for Super3
DEBUG 20:32:48,629 Estimating compactions for Super2
DEBUG 20:32:48,630 Estimating compactions for Indexed1
DEBUG 20:32:48,630 Estimating compactions for LocationInfo
DEBUG 20:32:48,631 Estimating compactions for HintsColumnFamily
DEBUG 20:32:48,631 Estimating compactions for Migrations
DEBUG 20:32:48,632 Estimating compactions for Schema
DEBUG 20:32:48,633 Estimating compactions for IndexInfo
DEBUG 20:32:48,633 Checking to see if compaction of Standard2 would be
useful
DEBUG 20:32:48,634 Checking to see if compaction of Standard1 would be
useful
DEBUG 20:32:48,634 Checking to see if compaction of Super1 would be useful
DEBUG 20:32:48,635 Checking to see if compaction of StandardByUUID1 would be
useful
DEBUG 20:32:48,635 Checking to see if compaction of Super3 would be useful
DEBUG 20:32:48,636 Checking to see if compaction of Super2 would be useful
DEBUG 20:32:48,636 Checking to see if compaction of Indexed1 would be useful
DEBUG 20:32:48,637 Checking to see if compaction of LocationInfo would be
useful
DEBUG 20:32:48,638 Checking to see if compaction of HintsColumnFamily would
be useful
DEBUG 20:32:48,638 Checking to see if compaction of Migrations would be
useful
DEBUG 20:32:48,639 Checking to see if compaction of Schema would be useful
INFO 20:32:48,639 Cassandra version: 0.7.4
DEBUG 20:32:48,640 Checking to see if compaction of IndexInfo would be
useful
INFO 20:32:48,640 Thrift API version: 19.4.0
INFO 20:32:48,640 Loading persisted ring state
DEBUG 20:32:48,642 collecting 0 of 2147483647:
2df3513c4b75e110e9b34b357e45da79:false:4@1300975154438
DEBUG 20:32:48,649 clearing cached endpoints
DEBUG 20:32:48,649 clearing cached endpoints
INFO 20:32:48,662 Starting up server gossip
DEBUG 20:32:48,667 applying mutation of row 4c
INFO 20:32:48,671 Enqueuing flush of Memtable-LocationInfo@1891789590(29
bytes, 1 operations)
INFO 20:32:48,673 Writing Memtable-LocationInfo@1891789590(29 bytes, 1
operations)
INFO 20:32:48,779 Completed flushing
/data/cassandra/data/system/LocationInfo-f-26-Data.db (80 bytes)
DEBUG 20:32:48,780 adding /data/cassandra/data/system/LocationInfo-f-26 to
list of files tracked for system.LocationInfo
DEBUG 20:32:48,780 key cache capacity for LocationInfo is 2
DEBUG 20:32:48,781 Checking to see if compaction of LocationInfo would be
useful
DEBUG 20:32:48,782 discard completed log segments for
CommitLogContext(file='/data/cassandra/commitlog/CommitLog-1302102168571.log',
position=148), column family 0.
DEBUG 20:32:48,783 Marking replay position 148 on commit log
CommitLogSegment(/data/cassandra/commitlog/CommitLog-1302102168571.log)
DEBUG 20:32:48,802 attempting to connect to /127.0.0.1
DEBUG 20:32:48,805 Announcing my schema is
63345865-561d-11e0-9643-b78766e55908
DEBUG 20:32:48,833 Created HHOM instance, registered MBean.
INFO 20:32:48,836 Using saved token 77639671910148606135069464717342173205
DEBUG 20:32:48,836 applying mutation of row 426f6f747374726170
DEBUG 20:32:48,837 Setting token to 77639671910148606135069464717342173205
DEBUG 20:32:48,838 applying mutation of row 4c
INFO 20:32:48,839 Enqueuing flush of Memtable-LocationInfo@1266620481(53
bytes, 2 operations)
INFO 20:32:48,846 Writing Memtable-LocationInfo@1266620481(53 bytes, 2
operations)
ERROR 20:32:48,910 Fatal exception in thread Thread[Thread-3,5,main]
java.io.IOError: java.io.EOFException
at
org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:73)
Caused by: java.io.EOFException
at java.io.DataInputStream.readInt(DataInputStream.java:375)
at
org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:61)
INFO 20:32:48,971 Completed flushing
/data/cassandra/data/system/LocationInfo-f-27-Data.db (163 bytes)
DEBUG 20:32:48,972 adding /data/cassandra/data/system/LocationInfo-f-27 to
list of files tracked for system.LocationInfo
DEBUG 20:32:48,973 key cache capacity for LocationInfo is 3
DEBUG 20:32:48,974 discard completed log segments for
CommitLogContext(file='/data/cassandra/commitlog/CommitLog-1302102168571.log',
position=444), column family 0.
DEBUG 20:32:48,975 Marking replay position 444 on commit log
CommitLogSegment(/data/cassandra/commitlog/CommitLog-1302102168571.log)
DEBUG 20:32:48,976 clearing cached endpoints
DEBUG 20:32:48,976 clearing cached endpoints
DEBUG 20:32:48,980 Normal
DEBUG 20:32:48,982 Will try to load mx4j now, if it's in the classpath
DEBUG 20:32:48,983 Checking to see if compaction of LocationInfo would be
useful
INFO 20:32:48,984 Will not load MX4J, mx4j-tools.jar is not in the
classpath
[1]+ Exit 1 ./cassandra
[root@idata2_29 bin]#
Re: 0.7.4 - Cassandra Nodes Do Not Start
Posted by Sasha Dolgy <sd...@gmail.com>.
apparently ... it occurs in mine too ... it doesn't appear to cause
harm to anything ...
On Wed, Apr 6, 2011 at 7:24 PM, mcasandra <mo...@gmail.com> wrote:
> I see this error in the logs posted. Is this normal?
>
> java.io.IOError: java.io.EOFException
> at
> org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:73)
> Caused by: java.io.EOFException
> at java.io.DataInputStream.readInt(DataInputStream.java:375)
> at
> org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:61)
Re: 0.7.4 - Cassandra Nodes Do Not Start
Posted by mcasandra <mo...@gmail.com>.
I see this error in the logs posted. Is this normal?
java.io.IOError: java.io.EOFException
at
org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:73)
Caused by: java.io.EOFException
at java.io.DataInputStream.readInt(DataInputStream.java:375)
at
org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:61)
--
View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/0-7-4-Cassandra-Nodes-Do-Not-Start-tp6246431p6246900.html
Sent from the cassandra-user@incubator.apache.org mailing list archive at Nabble.com.
Re: 0.7.4 - Cassandra Nodes Do Not Start
Posted by Jonathan Ellis <jb...@gmail.com>.
Nothing looks suspicious there. Try casandra -f, no &
On Wed, Apr 6, 2011 at 10:20 AM, B R <so...@gmail.com> wrote:
> Hi guys,
>
> We are running a 2 node Cassandra cluster which has suddenly started giving
> errors and the nodes do not start. I am pasting the start-up logs below. Any
> help would be great. Thanks.
>
> Error Log 1
>
> [root@idata1_34 bin]# ./cassandra &
> [1] 16945
> [root@idata1_34 bin]# INFO 20:33:16,550 Logging initialized
> INFO 20:33:16,566 Heap size: 2011168768/2011168768
> INFO 20:33:16,568 JNA not found. Native methods will be disabled.
> INFO 20:33:16,579 Loading settings from
> file:/opt/servers/apache-cassandra-0.7.4/conf/cassandra.yaml
> DEBUG 20:33:16,700 Syncing log with a period of 10000
> INFO 20:33:16,700 DiskAccessMode 'auto' determined to be mmap,
> indexAccessMode is mmap
> DEBUG 20:33:16,772 setting auto_bootstrap to true
> DEBUG 20:33:16,814 Initializing system.IndexInfo
> DEBUG 20:33:16,822 Starting CFS IndexInfo
> INFO 20:33:16,838 Opening /data/cassandra/data/system/IndexInfo-f-2
> DEBUG 20:33:16,838 Load statistics for
> /data/cassandra/data/system/IndexInfo-f-2
> DEBUG 20:33:16,856 INDEX LOAD TIME for
> /data/cassandra/data/system/IndexInfo-f-2: 17 ms.
> DEBUG 20:33:16,858 key cache contains 0/0 keys
> DEBUG 20:33:16,861 adding /data/cassandra/data/system/IndexInfo-f-2 to list
> of files tracked for system.IndexInfo
> DEBUG 20:33:16,862 key cache capacity for IndexInfo is 1
> DEBUG 20:33:16,862 row cache capacity for IndexInfo is 0
> DEBUG 20:33:16,866 Initializing system.Schema
> DEBUG 20:33:16,868 Starting CFS Schema
> INFO 20:33:16,870 Opening /data/cassandra/data/system/Schema-f-12
> DEBUG 20:33:16,870 Load statistics for
> /data/cassandra/data/system/Schema-f-12
> DEBUG 20:33:16,872 INDEX LOAD TIME for
> /data/cassandra/data/system/Schema-f-12: 2 ms.
> DEBUG 20:33:16,872 key cache contains 0/0 keys
> INFO 20:33:16,872 Opening /data/cassandra/data/system/Schema-f-11
> DEBUG 20:33:16,872 Load statistics for
> /data/cassandra/data/system/Schema-f-11
> DEBUG 20:33:16,874 INDEX LOAD TIME for
> /data/cassandra/data/system/Schema-f-11: 2 ms.
> DEBUG 20:33:16,874 key cache contains 0/0 keys
> DEBUG 20:33:16,874 adding /data/cassandra/data/system/Schema-f-12 to list of
> files tracked for system.Schema
> DEBUG 20:33:16,875 adding /data/cassandra/data/system/Schema-f-11 to list of
> files tracked for system.Schema
> DEBUG 20:33:16,875 key cache capacity for Schema is 2
> DEBUG 20:33:16,876 row cache capacity for Schema is 0
> DEBUG 20:33:16,876 Initializing system.Migrations
> DEBUG 20:33:16,878 Starting CFS Migrations
> INFO 20:33:16,879 Opening /data/cassandra/data/system/Migrations-f-12
> DEBUG 20:33:16,880 Load statistics for
> /data/cassandra/data/system/Migrations-f-12
> DEBUG 20:33:16,881 INDEX LOAD TIME for
> /data/cassandra/data/system/Migrations-f-12: 2 ms.
> DEBUG 20:33:16,881 key cache contains 0/0 keys
> INFO 20:33:16,881 Opening /data/cassandra/data/system/Migrations-f-11
> DEBUG 20:33:16,882 Load statistics for
> /data/cassandra/data/system/Migrations-f-11
> DEBUG 20:33:16,883 INDEX LOAD TIME for
> /data/cassandra/data/system/Migrations-f-11: 2 ms.
> DEBUG 20:33:16,883 key cache contains 0/0 keys
> DEBUG 20:33:16,883 adding /data/cassandra/data/system/Migrations-f-12 to
> list of files tracked for system.Migrations
> DEBUG 20:33:16,884 adding /data/cassandra/data/system/Migrations-f-11 to
> list of files tracked for system.Migrations
> DEBUG 20:33:16,884 key cache capacity for Migrations is 2
> DEBUG 20:33:16,885 row cache capacity for Migrations is 0
> DEBUG 20:33:16,885 Initializing system.LocationInfo
> DEBUG 20:33:16,886 Starting CFS LocationInfo
> INFO 20:33:16,887 reading saved cache
> /data/cassandra/saved_caches/system-LocationInfo-KeyCache
> DEBUG 20:33:16,888 completed reading (1 ms; 1 keys) saved cache
> /data/cassandra/saved_caches/system-LocationInfo-KeyCache
> INFO 20:33:16,891 Opening /data/cassandra/data/system/LocationInfo-f-14
> DEBUG 20:33:16,891 Load statistics for
> /data/cassandra/data/system/LocationInfo-f-14
> DEBUG 20:33:16,895 INDEX LOAD TIME for
> /data/cassandra/data/system/LocationInfo-f-14: 4 ms.
> DEBUG 20:33:16,895 key cache contains 1/1 keys
> INFO 20:33:16,896 Opening /data/cassandra/data/system/LocationInfo-f-16
> DEBUG 20:33:16,897 Load statistics for
> /data/cassandra/data/system/LocationInfo-f-16
> DEBUG 20:33:16,899 INDEX LOAD TIME for
> /data/cassandra/data/system/LocationInfo-f-16: 3 ms.
> DEBUG 20:33:16,899 key cache contains 2/2 keys
> INFO 20:33:16,900 Opening /data/cassandra/data/system/LocationInfo-f-15
> DEBUG 20:33:16,900 Load statistics for
> /data/cassandra/data/system/LocationInfo-f-15
> DEBUG 20:33:16,903 INDEX LOAD TIME for
> /data/cassandra/data/system/LocationInfo-f-15: 3 ms.
> DEBUG 20:33:16,903 key cache contains 3/3 keys
> DEBUG 20:33:16,903 adding /data/cassandra/data/system/LocationInfo-f-14 to
> list of files tracked for system.LocationInfo
> DEBUG 20:33:16,904 adding /data/cassandra/data/system/LocationInfo-f-16 to
> list of files tracked for system.LocationInfo
> DEBUG 20:33:16,905 adding /data/cassandra/data/system/LocationInfo-f-15 to
> list of files tracked for system.LocationInfo
> DEBUG 20:33:16,905 row cache capacity for LocationInfo is 0
> DEBUG 20:33:16,906 Initializing system.HintsColumnFamily
> DEBUG 20:33:16,907 Starting CFS HintsColumnFamily
> DEBUG 20:33:16,909 key cache capacity for HintsColumnFamily is 1
> DEBUG 20:33:16,909 row cache capacity for HintsColumnFamily is 0
> INFO 20:33:16,945 Loading schema version
> 63345865-561d-11e0-9643-b78766e55908
> DEBUG 20:33:16,950 collecting 0 of 2147483647:
> Avro/Schema:false:2042@1300974503953
> DEBUG 20:33:16,950 collecting 1 of 2147483647:
> Keyspace1:false:1654@1300974503953
> DEBUG 20:33:17,172 opening keyspace Keyspace1
> DEBUG 20:33:17,173 Initializing Keyspace1.Indexed1
> DEBUG 20:33:17,174 Starting CFS Indexed1
> DEBUG 20:33:17,174 key cache capacity for Indexed1 is 200000
> DEBUG 20:33:17,175 row cache capacity for Indexed1 is 0
> DEBUG 20:33:17,178 Starting CFS Indexed1.birthdate_idx
> DEBUG 20:33:17,179 key cache capacity for Indexed1.birthdate_idx is 200000
> DEBUG 20:33:17,179 row cache capacity for Indexed1.birthdate_idx is 0
> DEBUG 20:33:17,180 Initializing Keyspace1.Super1
> DEBUG 20:33:17,181 Starting CFS Super1
> DEBUG 20:33:17,181 key cache capacity for Super1 is 200000
> DEBUG 20:33:17,182 row cache capacity for Super1 is 0
> DEBUG 20:33:17,182 Initializing Keyspace1.Standard2
> DEBUG 20:33:17,182 Starting CFS Standard2
> DEBUG 20:33:17,183 key cache capacity for Standard2 is 100
> DEBUG 20:33:17,183 row cache capacity for Standard2 is 0
> DEBUG 20:33:17,184 Initializing Keyspace1.Standard1
> DEBUG 20:33:17,184 Starting CFS Standard1
> DEBUG 20:33:17,185 key cache capacity for Standard1 is 10000
> DEBUG 20:33:17,185 row cache capacity for Standard1 is 1000
> DEBUG 20:33:17,185 Initializing Keyspace1.Super2
> DEBUG 20:33:17,186 Starting CFS Super2
> DEBUG 20:33:17,187 key cache capacity for Super2 is 50
> DEBUG 20:33:17,187 row cache capacity for Super2 is 10000
> DEBUG 20:33:17,187 Initializing Keyspace1.Super3
> DEBUG 20:33:17,188 Starting CFS Super3
> DEBUG 20:33:17,188 key cache capacity for Super3 is 200000
> DEBUG 20:33:17,189 row cache capacity for Super3 is 0
> DEBUG 20:33:17,189 Initializing Keyspace1.StandardByUUID1
> DEBUG 20:33:17,189 Starting CFS StandardByUUID1
> DEBUG 20:33:17,190 key cache capacity for StandardByUUID1 is 200000
> DEBUG 20:33:17,190 row cache capacity for StandardByUUID1 is 0
> DEBUG 20:33:17,191 opening keyspace system
> INFO 20:33:17,202 Creating new commitlog segment
> /data/cassandra/commitlog/CommitLog-1302102197202.log
> INFO 20:33:17,212 Replaying
> /data/cassandra/commitlog/CommitLog-1302101944726.log
> DEBUG 20:33:17,212 Replaying
> /data/cassandra/commitlog/CommitLog-1302101944726.log starting at 444
> INFO 20:33:17,212 Finished reading
> /data/cassandra/commitlog/CommitLog-1302101944726.log
> DEBUG 20:33:17,213 Finished waiting on mutations from recovery
> INFO 20:33:17,213 Log replay complete
> INFO 20:33:17,240 Cassandra version: 0.7.4
> INFO 20:33:17,241 Thrift API version: 19.4.0
> INFO 20:33:17,241 Loading persisted ring state
> DEBUG 20:33:17,242 collecting 0 of 2147483647:
> 3a68db5dd35cd1fd15737d92a2166815:false:4@1300888831435
> DEBUG 20:33:17,242 clearing cached endpoints
> DEBUG 20:33:17,242 clearing cached endpoints
> DEBUG 20:33:17,243 Estimating compactions for Standard2
> DEBUG 20:33:17,244 Estimating compactions for Standard1
> DEBUG 20:33:17,245 Estimating compactions for Super1
> DEBUG 20:33:17,245 Estimating compactions for StandardByUUID1
> DEBUG 20:33:17,245 Estimating compactions for Super3
> DEBUG 20:33:17,245 Estimating compactions for Super2
> DEBUG 20:33:17,245 Estimating compactions for Indexed1
> DEBUG 20:33:17,245 Estimating compactions for LocationInfo
> DEBUG 20:33:17,246 Estimating compactions for HintsColumnFamily
> DEBUG 20:33:17,246 Estimating compactions for Migrations
> DEBUG 20:33:17,246 Estimating compactions for Schema
> DEBUG 20:33:17,246 Estimating compactions for IndexInfo
> DEBUG 20:33:17,246 Checking to see if compaction of Standard2 would be
> useful
> DEBUG 20:33:17,247 Checking to see if compaction of Standard1 would be
> useful
> DEBUG 20:33:17,247 Checking to see if compaction of Super1 would be useful
> DEBUG 20:33:17,247 Checking to see if compaction of StandardByUUID1 would be
> useful
> DEBUG 20:33:17,247 Checking to see if compaction of Super3 would be useful
> DEBUG 20:33:17,247 Checking to see if compaction of Super2 would be useful
> DEBUG 20:33:17,247 Checking to see if compaction of Indexed1 would be useful
> DEBUG 20:33:17,248 Checking to see if compaction of LocationInfo would be
> useful
> DEBUG 20:33:17,248 Checking to see if compaction of HintsColumnFamily would
> be useful
> DEBUG 20:33:17,248 Checking to see if compaction of Migrations would be
> useful
> DEBUG 20:33:17,248 Checking to see if compaction of Schema would be useful
> DEBUG 20:33:17,248 Checking to see if compaction of IndexInfo would be
> useful
> INFO 20:33:17,250 Starting up server gossip
> DEBUG 20:33:17,253 applying mutation of row 4c
> INFO 20:33:17,256 Enqueuing flush of Memtable-LocationInfo@1189111555(29
> bytes, 1 operations)
> INFO 20:33:17,257 Writing Memtable-LocationInfo@1189111555(29 bytes, 1
> operations)
> INFO 20:33:17,340 Completed flushing
> /data/cassandra/data/system/LocationInfo-f-17-Data.db (80 bytes)
> DEBUG 20:33:17,341 adding /data/cassandra/data/system/LocationInfo-f-17 to
> list of files tracked for system.LocationInfo
> DEBUG 20:33:17,342 key cache capacity for LocationInfo is 5
> DEBUG 20:33:17,343 discard completed log segments for
> CommitLogContext(file='/data/cassandra/commitlog/CommitLog-1302102197202.log',
> position=148), column family 0.
> DEBUG 20:33:17,343 Marking replay position 148 on commit log
> CommitLogSegment(/data/cassandra/commitlog/CommitLog-1302102197202.log)
> DEBUG 20:33:17,360 Announcing my schema is
> 63345865-561d-11e0-9643-b78766e55908
> DEBUG 20:33:17,362 attempting to connect to /192.168.0.29
> DEBUG 20:33:17,363 Checking to see if compaction of LocationInfo would be
> useful
> DEBUG 20:33:17,367 Created HHOM instance, registered MBean.
> INFO 20:33:17,371 Using saved token 61078635599166706937511052402724559481
> DEBUG 20:33:17,372 applying mutation of row 426f6f747374726170
> DEBUG 20:33:17,372 Setting token to 61078635599166706937511052402724559481
> DEBUG 20:33:17,373 applying mutation of row 4c
> INFO 20:33:17,373 Enqueuing flush of Memtable-LocationInfo@1047055737(53
> bytes, 2 operations)
> INFO 20:33:17,374 Writing Memtable-LocationInfo@1047055737(53 bytes, 2
> operations)
> INFO 20:33:17,420 Compacting
> [SSTableReader(path='/data/cassandra/data/system/LocationInfo-f-14-Data.db'),SSTableReader(path='/data/cassandra/data/system/LocationInfo-f-15-Data.db'),SSTableReader(path='/data/cassandra/data/system/LocationInfo-f-16-Data.db'),SSTableReader(path='/data/cassandra/data/system/LocationInfo-f-17-Data.db')]
> DEBUG 20:33:17,423 index size for bloom filter calc for file :
> /data/cassandra/data/system/LocationInfo-f-14-Data.db : 256
> DEBUG 20:33:17,423 index size for bloom filter calc for file :
> /data/cassandra/data/system/LocationInfo-f-15-Data.db : 512
> DEBUG 20:33:17,423 index size for bloom filter calc for file :
> /data/cassandra/data/system/LocationInfo-f-16-Data.db : 768
> DEBUG 20:33:17,423 index size for bloom filter calc for file :
> /data/cassandra/data/system/LocationInfo-f-17-Data.db : 1024
> DEBUG 20:33:17,423 Expected bloom filter size : 1024
> ERROR 20:33:17,440 Fatal exception in thread Thread[Thread-3,5,main]
> java.io.IOError: java.io.EOFException
> at
> org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:73)
> Caused by: java.io.EOFException
> at java.io.DataInputStream.readInt(DataInputStream.java:375)
> at
> org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:61)
> INFO 20:33:17,451 Completed flushing
> /data/cassandra/data/system/LocationInfo-f-18-Data.db (163 bytes)
> DEBUG 20:33:17,451 adding /data/cassandra/data/system/LocationInfo-f-18 to
> list of files tracked for system.LocationInfo
> DEBUG 20:33:17,452 key cache capacity for LocationInfo is 6
> DEBUG 20:33:17,452 discard completed log segments for
> CommitLogContext(file='/data/cassandra/commitlog/CommitLog-1302102197202.log',
> position=444), column family 0.
> DEBUG 20:33:17,453 Marking replay position 444 on commit log
> CommitLogSegment(/data/cassandra/commitlog/CommitLog-1302102197202.log)
> DEBUG 20:33:17,453 clearing cached endpoints
> DEBUG 20:33:17,454 clearing cached endpoints
> DEBUG 20:33:17,456 Normal
> DEBUG 20:33:17,457 Will try to load mx4j now, if it's in the classpath
> INFO 20:33:17,458 Will not load MX4J, mx4j-tools.jar is not in the
> classpath
>
> [1]+ Exit 1 ./cassandra
> [root@idata1_34 bin]#
>
>
>
>
>
> Error Log 2
>
> [root@idata2_29 bin]# ./cassandra &
> [1] 22267
> [root@idata2_29 bin]# INFO 20:32:47,295 Logging initialized
> INFO 20:32:47,349 Heap size: 1622147072/1623195648
> INFO 20:32:47,352 JNA not found. Native methods will be disabled.
> INFO 20:32:47,367 Loading settings from
> file:/opt/servers/apache-cassandra-0.7.4/conf/cassandra.yaml
> DEBUG 20:32:47,617 Syncing log with a period of 10000
> INFO 20:32:47,618 DiskAccessMode 'auto' determined to be mmap,
> indexAccessMode is mmap
> DEBUG 20:32:47,731 setting auto_bootstrap to false
> DEBUG 20:32:47,785 Deleting LocationInfo-f-22-Data.db
> DEBUG 20:32:47,785 Deleting LocationInfo-f-22-Filter.db
> DEBUG 20:32:47,786 Deleting LocationInfo-f-22-Index.db
> DEBUG 20:32:47,786 Deleting LocationInfo-f-22-Statistics.db
> INFO 20:32:47,787 Deleted /data/cassandra/data/system/LocationInfo-f-22
> DEBUG 20:32:47,787 Deleting LocationInfo-f-23-Data.db
> DEBUG 20:32:47,788 Deleting LocationInfo-f-23-Filter.db
> DEBUG 20:32:47,788 Deleting LocationInfo-f-23-Index.db
> DEBUG 20:32:47,789 Deleting LocationInfo-f-23-Statistics.db
> INFO 20:32:47,793 Deleted /data/cassandra/data/system/LocationInfo-f-23
> DEBUG 20:32:47,793 Deleting LocationInfo-f-21-Data.db
> DEBUG 20:32:47,794 Deleting LocationInfo-f-21-Filter.db
> DEBUG 20:32:47,794 Deleting LocationInfo-f-21-Index.db
> DEBUG 20:32:47,795 Deleting LocationInfo-f-21-Statistics.db
> INFO 20:32:47,795 Deleted /data/cassandra/data/system/LocationInfo-f-21
> DEBUG 20:32:47,816 Initializing system.IndexInfo
> DEBUG 20:32:47,829 Starting CFS IndexInfo
> INFO 20:32:47,851 reading saved cache
> /data/cassandra/saved_caches/system-IndexInfo-KeyCache
> DEBUG 20:32:47,854 completed reading (6 ms; 1 keys) saved cache
> /data/cassandra/saved_caches/system-IndexInfo-KeyCache
> INFO 20:32:47,862 Opening /data/cassandra/data/system/IndexInfo-f-1
> DEBUG 20:32:47,863 Load statistics for
> /data/cassandra/data/system/IndexInfo-f-1
> DEBUG 20:32:47,898 INDEX LOAD TIME for
> /data/cassandra/data/system/IndexInfo-f-1: 36 ms.
> DEBUG 20:32:47,899 key cache contains 1/1 keys
> DEBUG 20:32:47,905 adding /data/cassandra/data/system/IndexInfo-f-1 to list
> of files tracked for system.IndexInfo
> DEBUG 20:32:47,906 row cache capacity for IndexInfo is 0
> DEBUG 20:32:47,911 Initializing system.Schema
> DEBUG 20:32:47,916 Starting CFS Schema
> INFO 20:32:47,918 reading saved cache
> /data/cassandra/saved_caches/system-Schema-KeyCache
> DEBUG 20:32:47,942 completed reading (13 ms; 1 keys) saved cache
> /data/cassandra/saved_caches/system-Schema-KeyCache
> INFO 20:32:47,945 Opening /data/cassandra/data/system/Schema-f-9
> DEBUG 20:32:47,945 Load statistics for
> /data/cassandra/data/system/Schema-f-9
> DEBUG 20:32:47,950 INDEX LOAD TIME for
> /data/cassandra/data/system/Schema-f-9: 5 ms.
> DEBUG 20:32:47,951 key cache contains 1/1 keys
> INFO 20:32:47,951 Opening /data/cassandra/data/system/Schema-f-10
> DEBUG 20:32:47,951 Load statistics for
> /data/cassandra/data/system/Schema-f-10
> DEBUG 20:32:47,955 INDEX LOAD TIME for
> /data/cassandra/data/system/Schema-f-10: 4 ms.
> DEBUG 20:32:47,955 key cache contains 2/2 keys
> DEBUG 20:32:47,956 adding /data/cassandra/data/system/Schema-f-9 to list of
> files tracked for system.Schema
> DEBUG 20:32:47,957 adding /data/cassandra/data/system/Schema-f-10 to list of
> files tracked for system.Schema
> DEBUG 20:32:47,958 row cache capacity for Schema is 0
> DEBUG 20:32:47,958 Initializing system.Migrations
> DEBUG 20:32:47,961 Starting CFS Migrations
> INFO 20:32:47,962 reading saved cache
> /data/cassandra/saved_caches/system-Migrations-KeyCache
> DEBUG 20:32:47,963 completed reading (1 ms; 1 keys) saved cache
> /data/cassandra/saved_caches/system-Migrations-KeyCache
> INFO 20:32:47,965 Opening /data/cassandra/data/system/Migrations-f-9
> DEBUG 20:32:47,966 Load statistics for
> /data/cassandra/data/system/Migrations-f-9
> DEBUG 20:32:47,970 INDEX LOAD TIME for
> /data/cassandra/data/system/Migrations-f-9: 5 ms.
> DEBUG 20:32:47,970 key cache contains 1/1 keys
> INFO 20:32:47,971 Opening /data/cassandra/data/system/Migrations-f-10
> DEBUG 20:32:47,971 Load statistics for
> /data/cassandra/data/system/Migrations-f-10
> DEBUG 20:32:47,975 INDEX LOAD TIME for
> /data/cassandra/data/system/Migrations-f-10: 4 ms.
> DEBUG 20:32:47,975 key cache contains 2/2 keys
> DEBUG 20:32:47,976 adding /data/cassandra/data/system/Migrations-f-9 to list
> of files tracked for system.Migrations
> DEBUG 20:32:47,976 adding /data/cassandra/data/system/Migrations-f-10 to
> list of files tracked for system.Migrations
> DEBUG 20:32:47,977 row cache capacity for Migrations is 0
> DEBUG 20:32:47,978 Initializing system.LocationInfo
> DEBUG 20:32:47,981 Starting CFS LocationInfo
> INFO 20:32:47,982 reading saved cache
> /data/cassandra/saved_caches/system-LocationInfo-KeyCache
> DEBUG 20:32:47,983 completed reading (0 ms; 1 keys) saved cache
> /data/cassandra/saved_caches/system-LocationInfo-KeyCache
> INFO 20:32:47,985 Opening /data/cassandra/data/system/LocationInfo-f-25
> DEBUG 20:32:47,985 Load statistics for
> /data/cassandra/data/system/LocationInfo-f-25
> DEBUG 20:32:47,990 INDEX LOAD TIME for
> /data/cassandra/data/system/LocationInfo-f-25: 5 ms.
> DEBUG 20:32:47,990 key cache contains 1/1 keys
> DEBUG 20:32:47,991 adding /data/cassandra/data/system/LocationInfo-f-25 to
> list of files tracked for system.LocationInfo
> DEBUG 20:32:47,991 row cache capacity for LocationInfo is 0
> DEBUG 20:32:47,992 Initializing system.HintsColumnFamily
> DEBUG 20:32:48,002 Starting CFS HintsColumnFamily
> DEBUG 20:32:48,005 key cache capacity for HintsColumnFamily is 1
> DEBUG 20:32:48,006 row cache capacity for HintsColumnFamily is 0
> INFO 20:32:48,069 Loading schema version
> 63345865-561d-11e0-9643-b78766e55908
> DEBUG 20:32:48,080 collecting 0 of 2147483647:
> Avro/Schema:false:2042@1300974503953
> DEBUG 20:32:48,081 collecting 1 of 2147483647:
> Keyspace1:false:1654@1300974503953
> DEBUG 20:32:48,514 opening keyspace Keyspace1
> DEBUG 20:32:48,515 Initializing Keyspace1.Indexed1
> DEBUG 20:32:48,516 Starting CFS Indexed1
> DEBUG 20:32:48,518 key cache capacity for Indexed1 is 200000
> DEBUG 20:32:48,518 row cache capacity for Indexed1 is 0
> DEBUG 20:32:48,524 Starting CFS Indexed1.birthdate_idx
> DEBUG 20:32:48,526 key cache capacity for Indexed1.birthdate_idx is 200000
> DEBUG 20:32:48,526 row cache capacity for Indexed1.birthdate_idx is 0
> DEBUG 20:32:48,528 Initializing Keyspace1.Super1
> DEBUG 20:32:48,529 Starting CFS Super1
> DEBUG 20:32:48,530 key cache capacity for Super1 is 200000
> DEBUG 20:32:48,531 row cache capacity for Super1 is 0
> DEBUG 20:32:48,532 Initializing Keyspace1.Standard2
> DEBUG 20:32:48,533 Starting CFS Standard2
> DEBUG 20:32:48,534 key cache capacity for Standard2 is 100
> DEBUG 20:32:48,535 row cache capacity for Standard2 is 0
> DEBUG 20:32:48,535 Initializing Keyspace1.Standard1
> DEBUG 20:32:48,537 Starting CFS Standard1
> DEBUG 20:32:48,538 key cache capacity for Standard1 is 10000
> DEBUG 20:32:48,539 row cache capacity for Standard1 is 1000
> DEBUG 20:32:48,540 Initializing Keyspace1.Super2
> DEBUG 20:32:48,541 Starting CFS Super2
> DEBUG 20:32:48,542 key cache capacity for Super2 is 50
> DEBUG 20:32:48,543 row cache capacity for Super2 is 10000
> DEBUG 20:32:48,544 Initializing Keyspace1.Super3
> DEBUG 20:32:48,545 Starting CFS Super3
> DEBUG 20:32:48,546 key cache capacity for Super3 is 200000
> DEBUG 20:32:48,547 row cache capacity for Super3 is 0
> DEBUG 20:32:48,548 Initializing Keyspace1.StandardByUUID1
> DEBUG 20:32:48,549 Starting CFS StandardByUUID1
> DEBUG 20:32:48,550 key cache capacity for StandardByUUID1 is 200000
> DEBUG 20:32:48,550 row cache capacity for StandardByUUID1 is 0
> DEBUG 20:32:48,552 opening keyspace system
> INFO 20:32:48,571 Creating new commitlog segment
> /data/cassandra/commitlog/CommitLog-1302102168571.log
> INFO 20:32:48,587 Replaying
> /data/cassandra/commitlog/CommitLog-1302101192234.log
> DEBUG 20:32:48,588 Replaying
> /data/cassandra/commitlog/CommitLog-1302101192234.log starting at 444
> INFO 20:32:48,588 Finished reading
> /data/cassandra/commitlog/CommitLog-1302101192234.log
> DEBUG 20:32:48,588 Finished waiting on mutations from recovery
> INFO 20:32:48,589 Log replay complete
> DEBUG 20:32:48,625 Estimating compactions for Standard2
> DEBUG 20:32:48,627 Estimating compactions for Standard1
> DEBUG 20:32:48,628 Estimating compactions for Super1
> DEBUG 20:32:48,628 Estimating compactions for StandardByUUID1
> DEBUG 20:32:48,629 Estimating compactions for Super3
> DEBUG 20:32:48,629 Estimating compactions for Super2
> DEBUG 20:32:48,630 Estimating compactions for Indexed1
> DEBUG 20:32:48,630 Estimating compactions for LocationInfo
> DEBUG 20:32:48,631 Estimating compactions for HintsColumnFamily
> DEBUG 20:32:48,631 Estimating compactions for Migrations
> DEBUG 20:32:48,632 Estimating compactions for Schema
> DEBUG 20:32:48,633 Estimating compactions for IndexInfo
> DEBUG 20:32:48,633 Checking to see if compaction of Standard2 would be
> useful
> DEBUG 20:32:48,634 Checking to see if compaction of Standard1 would be
> useful
> DEBUG 20:32:48,634 Checking to see if compaction of Super1 would be useful
> DEBUG 20:32:48,635 Checking to see if compaction of StandardByUUID1 would be
> useful
> DEBUG 20:32:48,635 Checking to see if compaction of Super3 would be useful
> DEBUG 20:32:48,636 Checking to see if compaction of Super2 would be useful
> DEBUG 20:32:48,636 Checking to see if compaction of Indexed1 would be useful
> DEBUG 20:32:48,637 Checking to see if compaction of LocationInfo would be
> useful
> DEBUG 20:32:48,638 Checking to see if compaction of HintsColumnFamily would
> be useful
> DEBUG 20:32:48,638 Checking to see if compaction of Migrations would be
> useful
> DEBUG 20:32:48,639 Checking to see if compaction of Schema would be useful
> INFO 20:32:48,639 Cassandra version: 0.7.4
> DEBUG 20:32:48,640 Checking to see if compaction of IndexInfo would be
> useful
> INFO 20:32:48,640 Thrift API version: 19.4.0
> INFO 20:32:48,640 Loading persisted ring state
> DEBUG 20:32:48,642 collecting 0 of 2147483647:
> 2df3513c4b75e110e9b34b357e45da79:false:4@1300975154438
> DEBUG 20:32:48,649 clearing cached endpoints
> DEBUG 20:32:48,649 clearing cached endpoints
> INFO 20:32:48,662 Starting up server gossip
> DEBUG 20:32:48,667 applying mutation of row 4c
> INFO 20:32:48,671 Enqueuing flush of Memtable-LocationInfo@1891789590(29
> bytes, 1 operations)
> INFO 20:32:48,673 Writing Memtable-LocationInfo@1891789590(29 bytes, 1
> operations)
> INFO 20:32:48,779 Completed flushing
> /data/cassandra/data/system/LocationInfo-f-26-Data.db (80 bytes)
> DEBUG 20:32:48,780 adding /data/cassandra/data/system/LocationInfo-f-26 to
> list of files tracked for system.LocationInfo
> DEBUG 20:32:48,780 key cache capacity for LocationInfo is 2
> DEBUG 20:32:48,781 Checking to see if compaction of LocationInfo would be
> useful
> DEBUG 20:32:48,782 discard completed log segments for
> CommitLogContext(file='/data/cassandra/commitlog/CommitLog-1302102168571.log',
> position=148), column family 0.
> DEBUG 20:32:48,783 Marking replay position 148 on commit log
> CommitLogSegment(/data/cassandra/commitlog/CommitLog-1302102168571.log)
> DEBUG 20:32:48,802 attempting to connect to /127.0.0.1
> DEBUG 20:32:48,805 Announcing my schema is
> 63345865-561d-11e0-9643-b78766e55908
> DEBUG 20:32:48,833 Created HHOM instance, registered MBean.
> INFO 20:32:48,836 Using saved token 77639671910148606135069464717342173205
> DEBUG 20:32:48,836 applying mutation of row 426f6f747374726170
> DEBUG 20:32:48,837 Setting token to 77639671910148606135069464717342173205
> DEBUG 20:32:48,838 applying mutation of row 4c
> INFO 20:32:48,839 Enqueuing flush of Memtable-LocationInfo@1266620481(53
> bytes, 2 operations)
> INFO 20:32:48,846 Writing Memtable-LocationInfo@1266620481(53 bytes, 2
> operations)
> ERROR 20:32:48,910 Fatal exception in thread Thread[Thread-3,5,main]
> java.io.IOError: java.io.EOFException
> at
> org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:73)
> Caused by: java.io.EOFException
> at java.io.DataInputStream.readInt(DataInputStream.java:375)
> at
> org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:61)
> INFO 20:32:48,971 Completed flushing
> /data/cassandra/data/system/LocationInfo-f-27-Data.db (163 bytes)
> DEBUG 20:32:48,972 adding /data/cassandra/data/system/LocationInfo-f-27 to
> list of files tracked for system.LocationInfo
> DEBUG 20:32:48,973 key cache capacity for LocationInfo is 3
> DEBUG 20:32:48,974 discard completed log segments for
> CommitLogContext(file='/data/cassandra/commitlog/CommitLog-1302102168571.log',
> position=444), column family 0.
> DEBUG 20:32:48,975 Marking replay position 444 on commit log
> CommitLogSegment(/data/cassandra/commitlog/CommitLog-1302102168571.log)
> DEBUG 20:32:48,976 clearing cached endpoints
> DEBUG 20:32:48,976 clearing cached endpoints
> DEBUG 20:32:48,980 Normal
> DEBUG 20:32:48,982 Will try to load mx4j now, if it's in the classpath
> DEBUG 20:32:48,983 Checking to see if compaction of LocationInfo would be
> useful
> INFO 20:32:48,984 Will not load MX4J, mx4j-tools.jar is not in the
> classpath
>
> [1]+ Exit 1 ./cassandra
> [root@idata2_29 bin]#
>
>
>
--
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of DataStax, the source for professional Cassandra support
http://www.datastax.com