You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by 鄢来琼 <la...@gtafe.com> on 2014/08/20 08:13:12 UTC
can not query data from cassandra
HI ALL,
I setup Cassandra on a linux host.
I have insert some data into “mykeyspace.cffex_l23” table.
The following error are raised during query data from “mykeyspace.cffex_l23”.
Could you give me any suggestion to fix it?
According to “top” cmd, I found that most of the memory are used by Cassandra.
Cpu(s): 0.0%us, 0.1%sy, 0.0%ni, 99.9%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 4043660k total, 3281336k used, 762324k free, 42704k buffers
Swap: 0k total, 0k used, 0k free, 741456k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
7583 root 20 0 4437m 2.3g 65m S 0.0 58.7 531:32.23 java
10907 root 15 0 575m 27m 2024 S 0.0 0.7 0:03.07 mongod
The system.log is attached.
INFO [MemoryMeter:1] 2014-08-20 14:00:24,612 Memtable.java (line 481) CFS(Keyspace='mykeyspace', ColumnFamily='cffex_l23') liveRatio is 6.294228546622461 (just-counted was 6.294228546622461). calculation took 2907ms for 279972 cells
ERROR [ReadStage:871] 2014-08-20 14:01:51,197 CassandraDaemon.java (line 199) Exception in thread Thread[ReadStage:871,5,main]
java.lang.RuntimeException: java.lang.RuntimeException: java.io.FileNotFoundException: /opt/apache-cassandra-2.0.9/cassandraData/data/mykeyspace/cffex_l23/mykeyspace-cffex_l23-jb-799-Data.db (No such file or directory)
at org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1931)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: /opt/apache-cassandra-2.0.9/cassandraData/data/mykeyspace/cffex_l23/mykeyspace-cffex_l23-jb-799-Data.db (No such file or directory)
at org.apache.cassandra.io.compress.CompressedRandomAccessReader.open(CompressedRandomAccessReader.java:47)
at org.apache.cassandra.io.util.CompressedPoolingSegmentedFile.createReader(CompressedPoolingSegmentedFile.java:48)
at org.apache.cassandra.io.util.PoolingSegmentedFile.getSegment(PoolingSegmentedFile.java:39)
at org.apache.cassandra.io.sstable.SSTableReader.getFileDataInput(SSTableReader.java:1195)
at org.apache.cassandra.db.columniterator.IndexedSliceReader$IndexedBlockFetcher.getNextBlock(IndexedSliceReader.java:396)
at org.apache.cassandra.db.columniterator.IndexedSliceReader$IndexedBlockFetcher.fetchMoreData(IndexedSliceReader.java:366)
at org.apache.cassandra.db.columniterator.IndexedSliceReader.computeNext(IndexedSliceReader.java:145)
at org.apache.cassandra.db.columniterator.IndexedSliceReader.computeNext(IndexedSliceReader.java:45)
at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
at org.apache.cassandra.db.columniterator.SSTableSliceIterator.hasNext(SSTableSliceIterator.java:82)
at org.apache.cassandra.db.filter.QueryFilter$2.getNext(QueryFilter.java:157)
at org.apache.cassandra.db.filter.QueryFilter$2.hasNext(QueryFilter.java:140)
at org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterator.java:144)
at org.apache.cassandra.utils.MergeIterator$ManyToOne.<init>(MergeIterator.java:87)
at org.apache.cassandra.utils.MergeIterator.get(MergeIterator.java:46)
at org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFilter.java:120)
at org.apache.cassandra.db.filter.QueryFilter.collateOnDiskAtom(QueryFilter.java:80)
at org.apache.cassandra.db.filter.QueryFilter.collateOnDiskAtom(QueryFilter.java:72)
at org.apache.cassandra.db.CollationController.collectAllData(CollationController.java:297)
at org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationController.java:53)
at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1547)
at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1376)
at org.apache.cassandra.db.Keyspace.getRow(Keyspace.java:333)
at org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:65)
at org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:1363)
at org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1927)
... 3 more
Caused by: java.io.FileNotFoundException: /opt/apache-cassandra-2.0.9/cassandraData/data/mykeyspace/cffex_l23/mykeyspace-cffex_l23-jb-799-Data.db (No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
at org.apache.cassandra.io.util.RandomAccessReader.<init>(RandomAccessReader.java:58)
at org.apache.cassandra.io.compress.CompressedRandomAccessReader.<init>(CompressedRandomAccessReader.java:76)
at org.apache.cassandra.io.compress.CompressedRandomAccessReader.open(CompressedRandomAccessReader.java:43)
... 29 more
INFO [MemoryMeter:1] 2014-08-20 14:05:06,310 Memtable.java (line 481) CFS(Keyspace='system', ColumnFamily='sstable_activity') liveRatio is 14.591601139687077 (just-counted was 14.591111111111111). calculation took 6ms for 120 cells
________________________________
Thanks and regards,
深圳市国泰安信息技术有限公司
A3开发部 资深软件工程师 鄢来琼
手机：18620306659
邮箱：laiqiong.yan@gtafe.com
地址：深圳市南山区南头检查站关口二路智恒产业园19栋3楼
http://www.gtafe.com/
[说明: cid:image001.png@01CF5897.E1268DE0]
Re: 答复: can not query data from cassandra
Posted by Mark Reddy <ma...@gmail.com>.
Hi,
It looks like you are running into a known issue:
https://issues.apache.org/jira/browse/CASSANDRA-7780 and its being worked
on here: https://issues.apache.org/jira/browse/CASSANDRA-7145
Mark
On 20 August 2014 09:06, 鄢来琼 <la...@gtafe.com> wrote:
> Is it related to MAX_HEAP_SIZE and HEAP_NEWSIZE?
>
> My system memory size is 4G,but the MAX_HEAP_SIZE and HEAP_NEWSIZE are set
> to 2G and 800M, respectively.
>
>
>
>
> ------------------------------
>
> Thanks and regards,
>
> GTA Data
>
> *Peter.YAN*
>
> E-Mail：laiqiong.yan@gtafe.com
>
> http://www.gtafe.com/
>
> [image: 说明: cid:image001.png@01CF5897.E1268DE0]
>
>
>
>
>
> *发件人:* 鄢来琼 [mailto:laiqiong.yan@gtafe.com]
> *发送时间:* 2014年8月20日 14:13
> *收件人:* user@cassandra.apache.org
> *主题:* can not query data from cassandra
>
>
>
> HI ALL,
>
>
>
> I setup Cassandra on a linux host.
>
> I have insert some data into “mykeyspace.cffex_l23” table.
>
> The following error are raised during query data from
> “mykeyspace.cffex_l23”.
>
> Could you give me any suggestion to fix it?
>
>
>
> According to “top” cmd, I found that most of the memory are used by
> Cassandra.
>
>
>
> *Cpu(s): 0.0%us, 0.1%sy, 0.0%ni, 99.9%id, 0.0%wa, 0.0%hi, 0.0%si,
> 0.0%st*
>
> *Mem: 4043660k total, 3281336k used, 762324k free, 42704k buffers*
>
> *Swap: 0k total, 0k used, 0k free, 741456k cached*
>
>
>
> * PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND*
>
> *7583 root 20 0 4437m 2.3g 65m S 0.0 58.7 531:32.23 java*
>
> *10907 root 15 0 575m 27m 2024 S 0.0 0.7 0:03.07 mongod*
>
>
>
> The system.log is attached.
>
>
>
> INFO [MemoryMeter:1] 2014-08-20 14:00:24,612 Memtable.java (line 481)
> CFS(Keyspace='mykeyspace', ColumnFamily='cffex_l23') liveRatio is
> 6.294228546622461 (just-counted was 6.294228546622461). calculation took
> 2907ms for 279972 cells
>
> ERROR [ReadStage:871] 2014-08-20 14:01:51,197 CassandraDaemon.java (line
> 199) Exception in thread Thread[ReadStage:871,5,main]
>
> java.lang.RuntimeException: java.lang.RuntimeException:
> java.io.FileNotFoundException:
> /opt/apache-cassandra-2.0.9/cassandraData/data/mykeyspace/cffex_l23/mykeyspace-cffex_l23-jb-799-Data.db
> (No such file or directory)
>
> at
> org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1931)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>
> at java.lang.Thread.run(Thread.java:745)
>
> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
> /opt/apache-cassandra-2.0.9/cassandraData/data/mykeyspace/cffex_l23/mykeyspace-cffex_l23-jb-799-Data.db
> (No such file or directory)
>
> at
> org.apache.cassandra.io.compress.CompressedRandomAccessReader.open(CompressedRandomAccessReader.java:47)
>
> at
> org.apache.cassandra.io.util.CompressedPoolingSegmentedFile.createReader(CompressedPoolingSegmentedFile.java:48)
>
> at
> org.apache.cassandra.io.util.PoolingSegmentedFile.getSegment(PoolingSegmentedFile.java:39)
>
> at
> org.apache.cassandra.io.sstable.SSTableReader.getFileDataInput(SSTableReader.java:1195)
>
> at
> org.apache.cassandra.db.columniterator.IndexedSliceReader$IndexedBlockFetcher.getNextBlock(IndexedSliceReader.java:396)
>
> at
> org.apache.cassandra.db.columniterator.IndexedSliceReader$IndexedBlockFetcher.fetchMoreData(IndexedSliceReader.java:366)
>
> at
> org.apache.cassandra.db.columniterator.IndexedSliceReader.computeNext(IndexedSliceReader.java:145)
>
> at
> org.apache.cassandra.db.columniterator.IndexedSliceReader.computeNext(IndexedSliceReader.java:45)
>
> at
> com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
>
> at
> com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
>
> at
> org.apache.cassandra.db.columniterator.SSTableSliceIterator.hasNext(SSTableSliceIterator.java:82)
>
> at
> org.apache.cassandra.db.filter.QueryFilter$2.getNext(QueryFilter.java:157)
>
> at
> org.apache.cassandra.db.filter.QueryFilter$2.hasNext(QueryFilter.java:140)
>
> at
> org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterator.java:144)
>
> at
> org.apache.cassandra.utils.MergeIterator$ManyToOne.<init>(MergeIterator.java:87)
>
> at
> org.apache.cassandra.utils.MergeIterator.get(MergeIterator.java:46)
>
> at
> org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFilter.java:120)
>
> at
> org.apache.cassandra.db.filter.QueryFilter.collateOnDiskAtom(QueryFilter.java:80)
>
> at
> org.apache.cassandra.db.filter.QueryFilter.collateOnDiskAtom(QueryFilter.java:72)
>
> at
> org.apache.cassandra.db.CollationController.collectAllData(CollationController.java:297)
>
> at
> org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationController.java:53)
>
> at
> org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1547)
>
> at
> org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1376)
>
> at org.apache.cassandra.db.Keyspace.getRow(Keyspace.java:333)
>
> at
> org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:65)
>
> at
> org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:1363)
>
> at
> org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1927)
>
> ... 3 more
>
> Caused by: java.io.FileNotFoundException:
> /opt/apache-cassandra-2.0.9/cassandraData/data/mykeyspace/cffex_l23/mykeyspace-cffex_l23-jb-799-Data.db
> (No such file or directory)
>
> at java.io.RandomAccessFile.open(Native Method)
>
> at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
>
> at
> org.apache.cassandra.io.util.RandomAccessReader.<init>(RandomAccessReader.java:58)
>
> at
> org.apache.cassandra.io.compress.CompressedRandomAccessReader.<init>(CompressedRandomAccessReader.java:76)
>
> at
> org.apache.cassandra.io.compress.CompressedRandomAccessReader.open(CompressedRandomAccessReader.java:43)
>
> ... 29 more
>
> INFO [MemoryMeter:1] 2014-08-20 14:05:06,310 Memtable.java (line 481)
> CFS(Keyspace='system', ColumnFamily='sstable_activity') liveRatio is
> 14.591601139687077 (just-counted was 14.591111111111111). calculation took
> 6ms for 120 cells
>
>
> ------------------------------
>
> Thanks and regards,
>
> 深圳市国泰安信息技术有限公司
>
> *A3**开发部 **资深软件工程师 **鄢来琼*
>
> 手机：18620306659
>
> 邮箱：laiqiong.yan@gtafe.com
>
> 地址：深圳市南山区南头检查站关口二路智恒产业园19栋3楼
>
> http://www.gtafe.com/
>
> [image: 说明: cid:image001.png@01CF5897.E1268DE0]
>
>
>
答复: can not query data from cassandra
Posted by 鄢来琼 <la...@gtafe.com>.
Is it related to MAX_HEAP_SIZE and HEAP_NEWSIZE?
My system memory size is 4G,but the MAX_HEAP_SIZE and HEAP_NEWSIZE are set to 2G and 800M, respectively.
________________________________
Thanks and regards,
GTA Data
Peter.YAN
E-Mail：laiqiong.yan@gtafe.com
http://www.gtafe.com/
[说明: cid:image001.png@01CF5897.E1268DE0]
发件人: 鄢来琼 [mailto:laiqiong.yan@gtafe.com]
发送时间: 2014年8月20日 14:13
收件人: user@cassandra.apache.org
主题: can not query data from cassandra
HI ALL,
I setup Cassandra on a linux host.
I have insert some data into “mykeyspace.cffex_l23” table.
The following error are raised during query data from “mykeyspace.cffex_l23”.
Could you give me any suggestion to fix it?
According to “top” cmd, I found that most of the memory are used by Cassandra.
Cpu(s): 0.0%us, 0.1%sy, 0.0%ni, 99.9%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 4043660k total, 3281336k used, 762324k free, 42704k buffers
Swap: 0k total, 0k used, 0k free, 741456k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
7583 root 20 0 4437m 2.3g 65m S 0.0 58.7 531:32.23 java
10907 root 15 0 575m 27m 2024 S 0.0 0.7 0:03.07 mongod
The system.log is attached.
INFO [MemoryMeter:1] 2014-08-20 14:00:24,612 Memtable.java (line 481) CFS(Keyspace='mykeyspace', ColumnFamily='cffex_l23') liveRatio is 6.294228546622461 (just-counted was 6.294228546622461). calculation took 2907ms for 279972 cells
ERROR [ReadStage:871] 2014-08-20 14:01:51,197 CassandraDaemon.java (line 199) Exception in thread Thread[ReadStage:871,5,main]
java.lang.RuntimeException: java.lang.RuntimeException: java.io.FileNotFoundException: /opt/apache-cassandra-2.0.9/cassandraData/data/mykeyspace/cffex_l23/mykeyspace-cffex_l23-jb-799-Data.db (No such file or directory)
at org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1931)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: /opt/apache-cassandra-2.0.9/cassandraData/data/mykeyspace/cffex_l23/mykeyspace-cffex_l23-jb-799-Data.db (No such file or directory)
at org.apache.cassandra.io.compress.CompressedRandomAccessReader.open(CompressedRandomAccessReader.java:47)
at org.apache.cassandra.io.util.CompressedPoolingSegmentedFile.createReader(CompressedPoolingSegmentedFile.java:48)
at org.apache.cassandra.io.util.PoolingSegmentedFile.getSegment(PoolingSegmentedFile.java:39)
at org.apache.cassandra.io.sstable.SSTableReader.getFileDataInput(SSTableReader.java:1195)
at org.apache.cassandra.db.columniterator.IndexedSliceReader$IndexedBlockFetcher.getNextBlock(IndexedSliceReader.java:396)
at org.apache.cassandra.db.columniterator.IndexedSliceReader$IndexedBlockFetcher.fetchMoreData(IndexedSliceReader.java:366)
at org.apache.cassandra.db.columniterator.IndexedSliceReader.computeNext(IndexedSliceReader.java:145)
at org.apache.cassandra.db.columniterator.IndexedSliceReader.computeNext(IndexedSliceReader.java:45)
at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
at org.apache.cassandra.db.columniterator.SSTableSliceIterator.hasNext(SSTableSliceIterator.java:82)
at org.apache.cassandra.db.filter.QueryFilter$2.getNext(QueryFilter.java:157)
at org.apache.cassandra.db.filter.QueryFilter$2.hasNext(QueryFilter.java:140)
at org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterator.java:144)
at org.apache.cassandra.utils.MergeIterator$ManyToOne.<init>(MergeIterator.java:87)
at org.apache.cassandra.utils.MergeIterator.get(MergeIterator.java:46)
at org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFilter.java:120)
at org.apache.cassandra.db.filter.QueryFilter.collateOnDiskAtom(QueryFilter.java:80)
at org.apache.cassandra.db.filter.QueryFilter.collateOnDiskAtom(QueryFilter.java:72)
at org.apache.cassandra.db.CollationController.collectAllData(CollationController.java:297)
at org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationController.java:53)
at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1547)
at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1376)
at org.apache.cassandra.db.Keyspace.getRow(Keyspace.java:333)
at org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:65)
at org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:1363)
at org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1927)
... 3 more
Caused by: java.io.FileNotFoundException: /opt/apache-cassandra-2.0.9/cassandraData/data/mykeyspace/cffex_l23/mykeyspace-cffex_l23-jb-799-Data.db (No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
at org.apache.cassandra.io.util.RandomAccessReader.<init>(RandomAccessReader.java:58)
at org.apache.cassandra.io.compress.CompressedRandomAccessReader.<init>(CompressedRandomAccessReader.java:76)
at org.apache.cassandra.io.compress.CompressedRandomAccessReader.open(CompressedRandomAccessReader.java:43)
... 29 more
INFO [MemoryMeter:1] 2014-08-20 14:05:06,310 Memtable.java (line 481) CFS(Keyspace='system', ColumnFamily='sstable_activity') liveRatio is 14.591601139687077 (just-counted was 14.591111111111111). calculation took 6ms for 120 cells
________________________________
Thanks and regards,
深圳市国泰安信息技术有限公司
A3开发部 资深软件工程师 鄢来琼
手机：18620306659
邮箱：laiqiong.yan@gtafe.com<ma...@gtafe.com>
地址：深圳市南山区南头检查站关口二路智恒产业园19栋3楼
http://www.gtafe.com/
[说明: cid:image001.png@01CF5897.E1268DE0]