You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jonathan Ellis (JIRA)" <ji...@apache.org> on 2014/05/02 04:14:15 UTC
[jira] [Updated] (CASSANDRA-7135) Better checks and error messages
for data and log dirs on startup
[ https://issues.apache.org/jira/browse/CASSANDRA-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-7135:
--------------------------------------
Labels: lhf (was: )
> Better checks and error messages for data and log dirs on startup
> -----------------------------------------------------------------
>
> Key: CASSANDRA-7135
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7135
> Project: Cassandra
> Issue Type: Improvement
> Components: Core
> Reporter: Tyler Hobbs
> Labels: lhf
> Fix For: 2.0.8
>
>
> We used to have checks to make sure the data and logging dirs existed and had good permissions on startup. In 2.0, it seems that's not the case any more. If {{/var/lib/cassandra}} and {{/var/log/cassandra}} don't exist, you'll get a startup log like this:
> {noformat}
> ~/cassandra $ bin/cassandra -f
> log4j:ERROR setFile(null,true) call failed.
> java.io.FileNotFoundException: /var/log/cassandra/system.log (No such file or directory)
> at java.io.FileOutputStream.open(Native Method)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:221)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:142)
> at org.apache.log4j.FileAppender.setFile(FileAppender.java:294)
> at org.apache.log4j.RollingFileAppender.setFile(RollingFileAppender.java:207)
> at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:165)
> at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)
> at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172)
> at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104)
> at org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:809)
> at org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:735)
> at org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:615)
> at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:502)
> at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:395)
> at org.apache.log4j.PropertyWatchdog.doOnChange(PropertyConfigurator.java:922)
> at org.apache.log4j.helpers.FileWatchdog.checkAndConfigure(FileWatchdog.java:89)
> at org.apache.log4j.helpers.FileWatchdog.<init>(FileWatchdog.java:58)
> at org.apache.log4j.PropertyWatchdog.<init>(PropertyConfigurator.java:914)
> at org.apache.log4j.PropertyConfigurator.configureAndWatch(PropertyConfigurator.java:461)
> at org.apache.cassandra.service.CassandraDaemon.initLog4j(CassandraDaemon.java:133)
> at org.apache.cassandra.service.CassandraDaemon.<clinit>(CassandraDaemon.java:81)
> INFO 18:10:23,635 Logging initialized
> INFO 18:10:23,670 Loading settings from file:/home/thobbs/cassandra/conf/cassandra.yaml
> INFO 18:10:24,061 Data files directories: [/var/lib/cassandra/data]
> INFO 18:10:24,062 Commit log directory: /var/lib/cassandra/commitlog
> INFO 18:10:24,062 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
> INFO 18:10:24,062 disk_failure_policy is stop
> INFO 18:10:24,062 commit_failure_policy is stop
> INFO 18:10:24,066 Global memtable threshold is enabled at 981MB
> INFO 18:10:24,186 Not using multi-threaded compaction
> INFO 18:10:24,393 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.7.0_40
> INFO 18:10:24,393 Heap size: 4116709376/4116709376
> INFO 18:10:24,393 Code Cache Non-heap memory: init = 2555904(2496K) used = 664064(648K) committed = 2555904(2496K) max = 50331648(49152K)
> INFO 18:10:24,393 Par Eden Space Heap memory: init = 671088640(655360K) used = 107378592(104861K) committed = 671088640(655360K) max = 671088640(655360K)
> INFO 18:10:24,393 Par Survivor Space Heap memory: init = 83886080(81920K) used = 0(0K) committed = 83886080(81920K) max = 83886080(81920K)
> INFO 18:10:24,393 CMS Old Gen Heap memory: init = 3361734656(3282944K) used = 0(0K) committed = 3361734656(3282944K) max = 3361734656(3282944K)
> INFO 18:10:24,394 CMS Perm Gen Non-heap memory: init = 21757952(21248K) used = 14180160(13847K) committed = 21757952(21248K) max = 85983232(83968K)
> INFO 18:10:24,394 Classpath: bin/../conf:bin/../build/classes/main:bin/../build/classes/thrift:bin/../lib/antlr-3.2.jar:bin/../lib/commons-cli-1.1.jar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-lang3-3.1.jar:bin/../lib/compress-lzf-0.8.4.jar:bin/../lib/concurrentlinkedhashmap-lru-1.3.jar:bin/../lib/disruptor-3.0.1.jar:bin/../lib/guava-15.0.jar:bin/../lib/high-scale-lib-1.1.2.jar:bin/../lib/jackson-core-asl-1.9.2.jar:bin/../lib/jackson-mapper-asl-1.9.2.jar:bin/../lib/jamm-0.2.5.jar:bin/../lib/jbcrypt-0.3m.jar:bin/../lib/jline-1.0.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift-0.9.1.jar:bin/../lib/log4j-1.2.16.jar:bin/../lib/lz4-1.2.0.jar:bin/../lib/metrics-core-2.2.0.jar:bin/../lib/netty-3.6.6.Final.jar:bin/../lib/reporter-config-2.1.0.jar:bin/../lib/servlet-api-2.5-20081211.jar:bin/../lib/slf4j-api-1.7.2.jar:bin/../lib/slf4j-log4j12-1.7.2.jar:bin/../lib/snakeyaml-1.11.jar:bin/../lib/snappy-java-1.0.5.jar:bin/../lib/snaptree-0.1.jar:bin/../lib/super-csv-2.1.0.jar:bin/../lib/thrift-server-0.3.3.jar:bin/../lib/jamm-0.2.5.jar
> INFO 18:10:24,395 JNA not found. Native methods will be disabled.
> INFO 18:10:24,410 Initializing key cache with capacity of 100 MBs.
> INFO 18:10:24,423 Scheduling key cache save to each 14400 seconds (going to save all keys).
> INFO 18:10:24,424 Initializing row cache with capacity of 0 MBs
> INFO 18:10:24,433 Scheduling row cache save to each 0 seconds (going to save all keys).
> ERROR 18:10:24,461 Failed to create /var/lib/cassandra/data/system/schema_triggers directory
> ERROR 18:10:24,468 Failed to create /var/lib/cassandra/data/system/schema_triggers directory
> ERROR 18:10:24,469 Failed to create /var/lib/cassandra/data/system/schema_triggers directory
> ERROR 18:10:24,469 Failed to create /var/lib/cassandra/data/system/schema_triggers directory
> ERROR 18:10:24,470 Failed to create /var/lib/cassandra/data/system/schema_triggers directory
> ERROR 18:10:24,470 Failed to create /var/lib/cassandra/data/system/compaction_history directory
> ERROR 18:10:24,471 Failed to create /var/lib/cassandra/data/system/compaction_history directory
> ERROR 18:10:24,471 Failed to create /var/lib/cassandra/data/system/compaction_history directory
> ERROR 18:10:24,472 Failed to create /var/lib/cassandra/data/system/compaction_history directory
> ERROR 18:10:24,472 Failed to create /var/lib/cassandra/data/system/compaction_history directory
> ERROR 18:10:24,473 Failed to create /var/lib/cassandra/data/system/compaction_history directory
> ERROR 18:10:24,474 Failed to create /var/lib/cassandra/data/system/compaction_history directory
> ERROR 18:10:24,474 Failed to create /var/lib/cassandra/data/system/compaction_history directory
> ERROR 18:10:24,475 Failed to create /var/lib/cassandra/data/system/batchlog directory
> ERROR 18:10:24,475 Failed to create /var/lib/cassandra/data/system/batchlog directory
> ERROR 18:10:24,476 Failed to create /var/lib/cassandra/data/system/batchlog directory
> ERROR 18:10:24,476 Failed to create /var/lib/cassandra/data/system/batchlog directory
> ERROR 18:10:24,477 Failed to create /var/lib/cassandra/data/system/batchlog directory
> ERROR 18:10:24,477 Failed to create /var/lib/cassandra/data/system/sstable_activity directory
> ERROR 18:10:24,479 Failed to create /var/lib/cassandra/data/system/sstable_activity directory
> ERROR 18:10:24,480 Failed to create /var/lib/cassandra/data/system/sstable_activity directory
> ERROR 18:10:24,480 Failed to create /var/lib/cassandra/data/system/sstable_activity directory
> ERROR 18:10:24,481 Failed to create /var/lib/cassandra/data/system/sstable_activity directory
> ERROR 18:10:24,481 Failed to create /var/lib/cassandra/data/system/sstable_activity directory
> ERROR 18:10:24,482 Failed to create /var/lib/cassandra/data/system/peer_events directory
> ERROR 18:10:24,482 Failed to create /var/lib/cassandra/data/system/peer_events directory
> ERROR 18:10:24,483 Failed to create /var/lib/cassandra/data/system/peer_events directory
> ERROR 18:10:24,484 Failed to create /var/lib/cassandra/data/system/compactions_in_progress directory
> ERROR 18:10:24,484 Failed to create /var/lib/cassandra/data/system/compactions_in_progress directory
> ERROR 18:10:24,485 Failed to create /var/lib/cassandra/data/system/compactions_in_progress directory
> ERROR 18:10:24,485 Failed to create /var/lib/cassandra/data/system/compactions_in_progress directory
> ERROR 18:10:24,486 Failed to create /var/lib/cassandra/data/system/compactions_in_progress directory
> ERROR 18:10:24,486 Failed to create /var/lib/cassandra/data/system/hints directory
> ERROR 18:10:24,487 Failed to create /var/lib/cassandra/data/system/hints directory
> ERROR 18:10:24,488 Failed to create /var/lib/cassandra/data/system/hints directory
> ERROR 18:10:24,488 Failed to create /var/lib/cassandra/data/system/hints directory
> ERROR 18:10:24,489 Failed to create /var/lib/cassandra/data/system/hints directory
> ERROR 18:10:24,489 Failed to create /var/lib/cassandra/data/system/schema_keyspaces directory
> ERROR 18:10:24,490 Failed to create /var/lib/cassandra/data/system/schema_keyspaces directory
> ERROR 18:10:24,490 Failed to create /var/lib/cassandra/data/system/schema_keyspaces directory
> ERROR 18:10:24,491 Failed to create /var/lib/cassandra/data/system/schema_keyspaces directory
> ERROR 18:10:24,491 Failed to create /var/lib/cassandra/data/system/schema_keyspaces directory
> ERROR 18:10:24,492 Failed to create /var/lib/cassandra/data/system/range_xfers directory
> ERROR 18:10:24,492 Failed to create /var/lib/cassandra/data/system/range_xfers directory
> ERROR 18:10:24,493 Failed to create /var/lib/cassandra/data/system/range_xfers directory
> ERROR 18:10:24,494 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,494 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,495 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,495 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,496 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,496 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,497 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,498 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,498 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,499 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,499 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,500 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,500 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,501 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,502 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,502 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,503 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,504 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,504 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,505 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,506 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,506 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,507 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,507 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,508 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,508 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,509 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,510 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,510 Failed to create /var/lib/cassandra/data/system/schema_columnfamilies directory
> ERROR 18:10:24,511 Failed to create /var/lib/cassandra/data/system/NodeIdInfo directory
> ERROR 18:10:24,511 Failed to create /var/lib/cassandra/data/system/NodeIdInfo directory
> ERROR 18:10:24,512 Failed to create /var/lib/cassandra/data/system/NodeIdInfo directory
> ERROR 18:10:24,512 Failed to create /var/lib/cassandra/data/system/NodeIdInfo directory
> ERROR 18:10:24,513 Failed to create /var/lib/cassandra/data/system/paxos directory
> ERROR 18:10:24,513 Failed to create /var/lib/cassandra/data/system/paxos directory
> ERROR 18:10:24,514 Failed to create /var/lib/cassandra/data/system/paxos directory
> ERROR 18:10:24,514 Failed to create /var/lib/cassandra/data/system/paxos directory
> ERROR 18:10:24,515 Failed to create /var/lib/cassandra/data/system/paxos directory
> ERROR 18:10:24,515 Failed to create /var/lib/cassandra/data/system/paxos directory
> ERROR 18:10:24,516 Failed to create /var/lib/cassandra/data/system/paxos directory
> ERROR 18:10:24,516 Failed to create /var/lib/cassandra/data/system/paxos directory
> ERROR 18:10:24,517 Failed to create /var/lib/cassandra/data/system/schema_columns directory
> ERROR 18:10:24,517 Failed to create /var/lib/cassandra/data/system/schema_columns directory
> ERROR 18:10:24,518 Failed to create /var/lib/cassandra/data/system/schema_columns directory
> ERROR 18:10:24,519 Failed to create /var/lib/cassandra/data/system/schema_columns directory
> ERROR 18:10:24,519 Failed to create /var/lib/cassandra/data/system/schema_columns directory
> ERROR 18:10:24,520 Failed to create /var/lib/cassandra/data/system/schema_columns directory
> ERROR 18:10:24,520 Failed to create /var/lib/cassandra/data/system/schema_columns directory
> ERROR 18:10:24,521 Failed to create /var/lib/cassandra/data/system/schema_columns directory
> ERROR 18:10:24,521 Failed to create /var/lib/cassandra/data/system/schema_columns directory
> ERROR 18:10:24,521 Failed to create /var/lib/cassandra/data/system/schema_columns directory
> ERROR 18:10:24,522 Failed to create /var/lib/cassandra/data/system/IndexInfo directory
> ERROR 18:10:24,522 Failed to create /var/lib/cassandra/data/system/IndexInfo directory
> ERROR 18:10:24,522 Failed to create /var/lib/cassandra/data/system/IndexInfo directory
> ERROR 18:10:24,523 Failed to create /var/lib/cassandra/data/system/IndexInfo directory
> ERROR 18:10:24,523 Failed to create /var/lib/cassandra/data/system/peers directory
> ERROR 18:10:24,523 Failed to create /var/lib/cassandra/data/system/peers directory
> ERROR 18:10:24,524 Failed to create /var/lib/cassandra/data/system/peers directory
> ERROR 18:10:24,524 Failed to create /var/lib/cassandra/data/system/peers directory
> ERROR 18:10:24,524 Failed to create /var/lib/cassandra/data/system/peers directory
> ERROR 18:10:24,525 Failed to create /var/lib/cassandra/data/system/peers directory
> ERROR 18:10:24,525 Failed to create /var/lib/cassandra/data/system/peers directory
> ERROR 18:10:24,526 Failed to create /var/lib/cassandra/data/system/peers directory
> ERROR 18:10:24,526 Failed to create /var/lib/cassandra/data/system/peers directory
> ERROR 18:10:24,526 Failed to create /var/lib/cassandra/data/system/peers directory
> ERROR 18:10:24,527 Failed to create /var/lib/cassandra/data/system/local directory
> ERROR 18:10:24,527 Failed to create /var/lib/cassandra/data/system/local directory
> ERROR 18:10:24,527 Failed to create /var/lib/cassandra/data/system/local directory
> ERROR 18:10:24,528 Failed to create /var/lib/cassandra/data/system/local directory
> ERROR 18:10:24,528 Failed to create /var/lib/cassandra/data/system/local directory
> ERROR 18:10:24,528 Failed to create /var/lib/cassandra/data/system/local directory
> ERROR 18:10:24,529 Failed to create /var/lib/cassandra/data/system/local directory
> ERROR 18:10:24,529 Failed to create /var/lib/cassandra/data/system/local directory
> ERROR 18:10:24,530 Failed to create /var/lib/cassandra/data/system/local directory
> ERROR 18:10:24,530 Failed to create /var/lib/cassandra/data/system/local directory
> ERROR 18:10:24,530 Failed to create /var/lib/cassandra/data/system/local directory
> ERROR 18:10:24,531 Failed to create /var/lib/cassandra/data/system/local directory
> ERROR 18:10:24,531 Failed to create /var/lib/cassandra/data/system/local directory
> ERROR 18:10:24,531 Failed to create /var/lib/cassandra/data/system/local directory
> ERROR 18:10:24,532 Failed to create /var/lib/cassandra/data/system/local directory
> ERROR 18:10:24,532 Failed to create /var/lib/cassandra/data/system/local directory
> ERROR 18:10:24,535 Fatal error: java.io.IOException: Failed to mkdirs /var/lib/cassandra/data
> Failed to mkdirs /var/lib/cassandra/data; unable to start server
> {noformat}
> To summarize, we need to:
> * Make sure the directories exist
> ** If not, suggest creating them or editing cassandra.yaml
> * Make sure the directories have good permissions
> ** If not, say what permissions are needed and link to instructions for fixing them
--
This message was sent by Atlassian JIRA
(v6.2#6252)