You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Jay Patel <pa...@gmail.com> on 2014/09/29 03:31:42 UTC

FileNotFoundException during reboot (Cassandra-2.1.1)

Hey there,

We've trying out Cassandra-2.1.1 and facing the below exception frequently,
mainly during the node reboot. File is there with proper permissions (as
below), not sure why C* is not able to find it.

>>>

ERROR [OptionalTasks:1] 2014-09-27 16:00:20,888 CassandraDaemon.java:167 -
Exception in thread Thread[OptionalTasks:1,5,main]
java.lang.RuntimeException: java.io.FileNotFoundException:
/var/lib/cassandra/data/system/hints-2666e20573ef38b390fefecf96e8f0c7/la-12756-Data.db
at
org.apache.cassandra.io.compress.CompressedRandomAccessReader.open(CompressedRandomAccessReader.java:59)
~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
at
org.apache.cassandra.io.sstable.SSTableReader.openDataReader(SSTableReader.java:1881)
~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
at
org.apache.cassandra.io.sstable.SSTableScanner.<init>(SSTableScanner.java:67)
~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
at
org.apache.cassandra.io.sstable.SSTableReader.getScanner(SSTableReader.java:1646)
~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
at
org.apache.cassandra.db.RowIteratorFactory.getIterator(RowIteratorFactory.java:67)
~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
at
org.apache.cassandra.db.ColumnFamilyStore.getSequentialIterator(ColumnFamilyStore.java:1920)
~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
at
org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:2035)
~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
at
org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:1969)
~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
at
org.apache.cassandra.db.HintedHandOffManager.scheduleAllDeliveries(HintedHandOffManager.java:513)
~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
at
org.apache.cassandra.db.HintedHandOffManager.access$000(HintedHandOffManager.java:93)
~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
at
org.apache.cassandra.db.HintedHandOffManager$1.run(HintedHandOffManager.java:174)
~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
at
org.apache.cassandra.concurrent.DebuggableScheduledThreadPoolExecutor$UncomplainingRunnable.run(DebuggableScheduledThreadPoolExecutor.java:75)
~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[na:1.7.0_65]
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
[na:1.7.0_65]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
[na:1.7.0_65]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
[na:1.7.0_65]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_65]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_65]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_65]
Caused by: java.io.FileNotFoundException:
/var/lib/cassandra/data/system/hints-2666e20573ef38b390fefecf96e8f0c7/la-12756-Data.db
at
org.apache.cassandra.io.util.RandomAccessReader.<init>(RandomAccessReader.java:66)
~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
at
org.apache.cassandra.io.compress.CompressedRandomAccessReader.<init>(CompressedRandomAccessReader.java:76)
~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
at
org.apache.cassandra.io.compress.CompressedRandomAccessReader.open(CompressedRandomAccessReader.java:55)
~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
... 18 common frames omitted
^C



$ ll
/var/lib/cassandra/data/system/hints-2666e20573ef38b390fefecf96e8f0c7/la-12756-Data.db
-rw-r--r-- 1 cassandra root 5305 Sep 27 00:57
/var/lib/cassandra/data/system/hints-2666e20573ef38b390fefecf96e8f0c7/la-12756-Data.db

Re: FileNotFoundException during reboot (Cassandra-2.1.1)

Posted by Jared Biel <ja...@bolderthinking.com>.
Maybe you're running out of file descriptors?

On 29 September 2014 01:31, Jay Patel <pa...@gmail.com> wrote:

> Hey there,
>
> We've trying out Cassandra-2.1.1 and facing the below exception
> frequently, mainly during the node reboot. File is there with proper
> permissions (as below), not sure why C* is not able to find it.
>
> >>>
>
> ERROR [OptionalTasks:1] 2014-09-27 16:00:20,888 CassandraDaemon.java:167 -
> Exception in thread Thread[OptionalTasks:1,5,main]
> java.lang.RuntimeException: java.io.FileNotFoundException:
> /var/lib/cassandra/data/system/hints-2666e20573ef38b390fefecf96e8f0c7/la-12756-Data.db
> at
> org.apache.cassandra.io.compress.CompressedRandomAccessReader.open(CompressedRandomAccessReader.java:59)
> ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
> at
> org.apache.cassandra.io.sstable.SSTableReader.openDataReader(SSTableReader.java:1881)
> ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
> at
> org.apache.cassandra.io.sstable.SSTableScanner.<init>(SSTableScanner.java:67)
> ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
> at
> org.apache.cassandra.io.sstable.SSTableReader.getScanner(SSTableReader.java:1646)
> ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
> at
> org.apache.cassandra.db.RowIteratorFactory.getIterator(RowIteratorFactory.java:67)
> ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
> at
> org.apache.cassandra.db.ColumnFamilyStore.getSequentialIterator(ColumnFamilyStore.java:1920)
> ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
> at
> org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:2035)
> ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
> at
> org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:1969)
> ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
> at
> org.apache.cassandra.db.HintedHandOffManager.scheduleAllDeliveries(HintedHandOffManager.java:513)
> ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
> at
> org.apache.cassandra.db.HintedHandOffManager.access$000(HintedHandOffManager.java:93)
> ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
> at
> org.apache.cassandra.db.HintedHandOffManager$1.run(HintedHandOffManager.java:174)
> ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
> at
> org.apache.cassandra.concurrent.DebuggableScheduledThreadPoolExecutor$UncomplainingRunnable.run(DebuggableScheduledThreadPoolExecutor.java:75)
> ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> [na:1.7.0_65]
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
> [na:1.7.0_65]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
> [na:1.7.0_65]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> [na:1.7.0_65]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> [na:1.7.0_65]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> [na:1.7.0_65]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_65]
> Caused by: java.io.FileNotFoundException:
> /var/lib/cassandra/data/system/hints-2666e20573ef38b390fefecf96e8f0c7/la-12756-Data.db
> at
> org.apache.cassandra.io.util.RandomAccessReader.<init>(RandomAccessReader.java:66)
> ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
> at
> org.apache.cassandra.io.compress.CompressedRandomAccessReader.<init>(CompressedRandomAccessReader.java:76)
> ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
> at
> org.apache.cassandra.io.compress.CompressedRandomAccessReader.open(CompressedRandomAccessReader.java:55)
> ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT]
> ... 18 common frames omitted
> ^C
>
>
>
> $ ll
> /var/lib/cassandra/data/system/hints-2666e20573ef38b390fefecf96e8f0c7/la-12756-Data.db
> -rw-r--r-- 1 cassandra root 5305 Sep 27 00:57
> /var/lib/cassandra/data/system/hints-2666e20573ef38b390fefecf96e8f0c7/la-12756-Data.db
>
>
>