You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jackson Chung (JIRA)" <ji...@apache.org> on 2011/04/21 19:56:05 UTC
[jira] [Created] (CASSANDRA-2528) NPE from PrecompactedRow
NPE from PrecompactedRow
------------------------
Key: CASSANDRA-2528
URL: https://issues.apache.org/jira/browse/CASSANDRA-2528
Project: Cassandra
Issue Type: Bug
Reporter: Jackson Chung
received a NPE from trunk (0.8) on PrecompactedRow:
ERROR [CompactionExecutor:2] 2011-04-21 17:21:31,610 AbstractCassandraDaemon.java (line 112) Fatal exception in thread Thread[CompactionExecutor:2,1,main]
java.lang.NullPointerException
at org.apache.cassandra.io.PrecompactedRow.<init>(PrecompactedRow.java:86)
at org.apache.cassandra.io.CompactionIterator.getCompactedRow(CompactionIterator.java:167)
at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:124)
at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:44)
at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
at org.apache.cassandra.db.CompactionManager.doCompaction(CompactionManager.java:553)
at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:146)
at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:112)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
size of data in /var/lib/cassandra is 11G on this, but there is also report that 1.7G also see the same.
data was previously populated from 0.7.4 cassandra
added debug logging, not sure how much this help (this is logged before the exception.)
INFO [CompactionExecutor:2] 2011-04-21 17:21:31,588 CompactionManager.java (line 534) Compacting Major: [SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-10-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-7-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-6-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-8-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-9-Data.db')]
DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-10-Data.db : 256
DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-7-Data.db : 512
DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-6-Data.db : 768
DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-8-Data.db : 1024
DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-9-Data.db : 1280
INFO [CompactionExecutor:2] 2011-04-21 17:21:31,609 CompactionIterator.java (line 185) Major@1181554512(cfs, inode.path, 523/10895) now compacting at 16777 bytes/ms.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2528) NPE from PrecompactedRow
Posted by "Jackson Chung (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022886#comment-13022886 ]
Jackson Chung commented on CASSANDRA-2528:
------------------------------------------
{code:title=PrepcompactedRow.java}
85 logger.debug(String.format("debugging controoler %b", controller.shouldPurge(key)));
86 compactedCf = controller.shouldPurge(key) ? ColumnFamilyStore.removeDeleted(cf, controller.gcBefore) : cf;
87 logger.debug(String.format("debugging compactedCF: %s", compactedCf.toString()));
88 //if (compactedCf != null && compactedCf.metadata().getDefaultValidator().isCommutative())
89 if (compactedCf != null)
90 {
91 assert compactedCf.metadata() != null;
92 assert compactedCf.metadata().getDefaultValidator() != null;
93 if (compactedCf.metadata().getDefaultValidator().isCommutative())
94 {
95 CounterColumn.removeOldShards(compactedCf, controller.gcBefore);
96 }
{code}
> NPE from PrecompactedRow
> ------------------------
>
> Key: CASSANDRA-2528
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2528
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8 beta 1
> Reporter: Jackson Chung
> Assignee: Jonathan Ellis
> Fix For: 0.8.0
>
> Attachments: 2528.txt
>
>
> received a NPE from trunk (0.8) on PrecompactedRow:
> ERROR [CompactionExecutor:2] 2011-04-21 17:21:31,610 AbstractCassandraDaemon.java (line 112) Fatal exception in thread Thread[CompactionExecutor:2,1,main]
> java.lang.NullPointerException
> at org.apache.cassandra.io.PrecompactedRow.<init>(PrecompactedRow.java:86)
> at org.apache.cassandra.io.CompactionIterator.getCompactedRow(CompactionIterator.java:167)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:124)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:44)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.CompactionManager.doCompaction(CompactionManager.java:553)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:146)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:112)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> size of data in /var/lib/cassandra is 11G on this, but there is also report that 1.7G also see the same.
> data was previously populated from 0.7.4 cassandra
> added debug logging, not sure how much this help (this is logged before the exception.)
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,588 CompactionManager.java (line 534) Compacting Major: [SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-10-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-7-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-6-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-8-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-9-Data.db')]
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-10-Data.db : 256
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-7-Data.db : 512
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-6-Data.db : 768
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-8-Data.db : 1024
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-9-Data.db : 1280
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,609 CompactionIterator.java (line 185) Major@1181554512(cfs, inode.path, 523/10895) now compacting at 16777 bytes/ms.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2528) NPE from PrecompactedRow
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-2528:
--------------------------------------
Attachment: 2528.txt
can you try w/ this patch? it adds additional asserts to narrow down where the error is
> NPE from PrecompactedRow
> ------------------------
>
> Key: CASSANDRA-2528
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2528
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8 beta 1
> Reporter: Jackson Chung
> Fix For: 0.8.0
>
> Attachments: 2528.txt
>
>
> received a NPE from trunk (0.8) on PrecompactedRow:
> ERROR [CompactionExecutor:2] 2011-04-21 17:21:31,610 AbstractCassandraDaemon.java (line 112) Fatal exception in thread Thread[CompactionExecutor:2,1,main]
> java.lang.NullPointerException
> at org.apache.cassandra.io.PrecompactedRow.<init>(PrecompactedRow.java:86)
> at org.apache.cassandra.io.CompactionIterator.getCompactedRow(CompactionIterator.java:167)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:124)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:44)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.CompactionManager.doCompaction(CompactionManager.java:553)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:146)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:112)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> size of data in /var/lib/cassandra is 11G on this, but there is also report that 1.7G also see the same.
> data was previously populated from 0.7.4 cassandra
> added debug logging, not sure how much this help (this is logged before the exception.)
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,588 CompactionManager.java (line 534) Compacting Major: [SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-10-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-7-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-6-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-8-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-9-Data.db')]
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-10-Data.db : 256
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-7-Data.db : 512
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-6-Data.db : 768
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-8-Data.db : 1024
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-9-Data.db : 1280
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,609 CompactionIterator.java (line 185) Major@1181554512(cfs, inode.path, 523/10895) now compacting at 16777 bytes/ms.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2528) NPE from PrecompactedRow
Posted by "Jackson Chung (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022885#comment-13022885 ]
Jackson Chung commented on CASSANDRA-2528:
------------------------------------------
DEBUG [CompactionExecutor:2] 2011-04-21 19:31:46,797 PrecompactedRow.java (line 85) debugging controoler true
DEBUG [CompactionExecutor:2] 2011-04-21 19:31:46,798 PrecompactedRow.java (line 87) debugging compactedCF: ColumnFamily(<anonymous> [3636363663643736663936393536343639653762653339643735306363376439:false:0@1303340825329,])
INFO [CompactionExecutor:2] 2011-04-21 19:31:46,799 CompactionIterator.java (line 185) Major@31583366(cfs, inode.path, 772/11720) now compacting at 8388 bytes/ms.
ERROR [CompactionExecutor:2] 2011-04-21 19:31:46,850 AbstractCassandraDaemon.java (line 112) Fatal exception in thread Thread[CompactionExecutor:2,1,main]
java.lang.AssertionError
at org.apache.cassandra.io.PrecompactedRow.<init>(PrecompactedRow.java:91)
at org.apache.cassandra.io.CompactionIterator.getCompactedRow(CompactionIterator.java:167)
at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:124)
at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:44)
at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
at org.apache.cassandra.db.CompactionManager.doCompaction(CompactionManager.java:553)
at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:146)
at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:112)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
> NPE from PrecompactedRow
> ------------------------
>
> Key: CASSANDRA-2528
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2528
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8 beta 1
> Reporter: Jackson Chung
> Assignee: Jonathan Ellis
> Fix For: 0.8.0
>
> Attachments: 2528.txt
>
>
> received a NPE from trunk (0.8) on PrecompactedRow:
> ERROR [CompactionExecutor:2] 2011-04-21 17:21:31,610 AbstractCassandraDaemon.java (line 112) Fatal exception in thread Thread[CompactionExecutor:2,1,main]
> java.lang.NullPointerException
> at org.apache.cassandra.io.PrecompactedRow.<init>(PrecompactedRow.java:86)
> at org.apache.cassandra.io.CompactionIterator.getCompactedRow(CompactionIterator.java:167)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:124)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:44)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.CompactionManager.doCompaction(CompactionManager.java:553)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:146)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:112)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> size of data in /var/lib/cassandra is 11G on this, but there is also report that 1.7G also see the same.
> data was previously populated from 0.7.4 cassandra
> added debug logging, not sure how much this help (this is logged before the exception.)
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,588 CompactionManager.java (line 534) Compacting Major: [SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-10-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-7-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-6-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-8-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-9-Data.db')]
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-10-Data.db : 256
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-7-Data.db : 512
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-6-Data.db : 768
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-8-Data.db : 1024
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-9-Data.db : 1280
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,609 CompactionIterator.java (line 185) Major@1181554512(cfs, inode.path, 523/10895) now compacting at 16777 bytes/ms.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2528) NPE from PrecompactedRow
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-2528:
--------------------------------------
Reviewer: cywjackson
Affects Version/s: 0.8 beta 1
Fix Version/s: 0.8.0
Assignee: Jonathan Ellis
> NPE from PrecompactedRow
> ------------------------
>
> Key: CASSANDRA-2528
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2528
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8 beta 1
> Reporter: Jackson Chung
> Assignee: Jonathan Ellis
> Fix For: 0.8.0
>
> Attachments: 2528.txt
>
>
> received a NPE from trunk (0.8) on PrecompactedRow:
> ERROR [CompactionExecutor:2] 2011-04-21 17:21:31,610 AbstractCassandraDaemon.java (line 112) Fatal exception in thread Thread[CompactionExecutor:2,1,main]
> java.lang.NullPointerException
> at org.apache.cassandra.io.PrecompactedRow.<init>(PrecompactedRow.java:86)
> at org.apache.cassandra.io.CompactionIterator.getCompactedRow(CompactionIterator.java:167)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:124)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:44)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.CompactionManager.doCompaction(CompactionManager.java:553)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:146)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:112)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> size of data in /var/lib/cassandra is 11G on this, but there is also report that 1.7G also see the same.
> data was previously populated from 0.7.4 cassandra
> added debug logging, not sure how much this help (this is logged before the exception.)
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,588 CompactionManager.java (line 534) Compacting Major: [SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-10-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-7-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-6-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-8-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-9-Data.db')]
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-10-Data.db : 256
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-7-Data.db : 512
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-6-Data.db : 768
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-8-Data.db : 1024
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-9-Data.db : 1280
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,609 CompactionIterator.java (line 185) Major@1181554512(cfs, inode.path, 523/10895) now compacting at 16777 bytes/ms.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2528) NPE from PrecompactedRow
Posted by "Jackson Chung (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022887#comment-13022887 ]
Jackson Chung commented on CASSANDRA-2528:
------------------------------------------
$ grep java.lang.AssertionError -A3 /var/log/cassandra/system.log
{noformat}
java.lang.AssertionError
at org.apache.cassandra.io.PrecompactedRow.<init>(PrecompactedRow.java:91)
at org.apache.cassandra.io.CompactionIterator.getCompactedRow(CompactionIterator.java:167)
at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:124)
--
java.lang.AssertionError
at org.apache.cassandra.io.PrecompactedRow.<init>(PrecompactedRow.java:91)
at org.apache.cassandra.io.CompactionIterator.getCompactedRow(CompactionIterator.java:167)
at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:124)
{noformat}
> NPE from PrecompactedRow
> ------------------------
>
> Key: CASSANDRA-2528
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2528
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8 beta 1
> Reporter: Jackson Chung
> Assignee: Jonathan Ellis
> Fix For: 0.8.0
>
> Attachments: 2528.txt
>
>
> received a NPE from trunk (0.8) on PrecompactedRow:
> ERROR [CompactionExecutor:2] 2011-04-21 17:21:31,610 AbstractCassandraDaemon.java (line 112) Fatal exception in thread Thread[CompactionExecutor:2,1,main]
> java.lang.NullPointerException
> at org.apache.cassandra.io.PrecompactedRow.<init>(PrecompactedRow.java:86)
> at org.apache.cassandra.io.CompactionIterator.getCompactedRow(CompactionIterator.java:167)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:124)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:44)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.CompactionManager.doCompaction(CompactionManager.java:553)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:146)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:112)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> size of data in /var/lib/cassandra is 11G on this, but there is also report that 1.7G also see the same.
> data was previously populated from 0.7.4 cassandra
> added debug logging, not sure how much this help (this is logged before the exception.)
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,588 CompactionManager.java (line 534) Compacting Major: [SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-10-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-7-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-6-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-8-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-9-Data.db')]
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-10-Data.db : 256
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-7-Data.db : 512
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-6-Data.db : 768
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-8-Data.db : 1024
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-9-Data.db : 1280
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,609 CompactionIterator.java (line 185) Major@1181554512(cfs, inode.path, 523/10895) now compacting at 16777 bytes/ms.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2528) NPE from PrecompactedRow
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022977#comment-13022977 ]
Hudson commented on CASSANDRA-2528:
-----------------------------------
Integrated in Cassandra-0.8 #32 (See [https://builds.apache.org/hudson/job/Cassandra-0.8/32/])
fix NPE compacting index CFs
patch by jbellis; reviewed by Jackson Chung for CASSANDRA-2528
> NPE from PrecompactedRow
> ------------------------
>
> Key: CASSANDRA-2528
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2528
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8 beta 1
> Reporter: Jackson Chung
> Assignee: Jonathan Ellis
> Fix For: 0.8.0
>
> Attachments: 2528.txt, 2528.txt
>
>
> received a NPE from trunk (0.8) on PrecompactedRow:
> ERROR [CompactionExecutor:2] 2011-04-21 17:21:31,610 AbstractCassandraDaemon.java (line 112) Fatal exception in thread Thread[CompactionExecutor:2,1,main]
> java.lang.NullPointerException
> at org.apache.cassandra.io.PrecompactedRow.<init>(PrecompactedRow.java:86)
> at org.apache.cassandra.io.CompactionIterator.getCompactedRow(CompactionIterator.java:167)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:124)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:44)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.CompactionManager.doCompaction(CompactionManager.java:553)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:146)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:112)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> size of data in /var/lib/cassandra is 11G on this, but there is also report that 1.7G also see the same.
> data was previously populated from 0.7.4 cassandra
> added debug logging, not sure how much this help (this is logged before the exception.)
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,588 CompactionManager.java (line 534) Compacting Major: [SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-10-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-7-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-6-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-8-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-9-Data.db')]
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-10-Data.db : 256
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-7-Data.db : 512
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-6-Data.db : 768
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-8-Data.db : 1024
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-9-Data.db : 1280
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,609 CompactionIterator.java (line 185) Major@1181554512(cfs, inode.path, 523/10895) now compacting at 16777 bytes/ms.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2528) NPE from PrecompactedRow
Posted by "Jackson Chung (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022962#comment-13022962 ]
Jackson Chung commented on CASSANDRA-2528:
------------------------------------------
the fix does address the NPE as now all CF has metadata.
> NPE from PrecompactedRow
> ------------------------
>
> Key: CASSANDRA-2528
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2528
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8 beta 1
> Reporter: Jackson Chung
> Assignee: Jonathan Ellis
> Fix For: 0.8.0
>
> Attachments: 2528.txt, 2528.txt
>
>
> received a NPE from trunk (0.8) on PrecompactedRow:
> ERROR [CompactionExecutor:2] 2011-04-21 17:21:31,610 AbstractCassandraDaemon.java (line 112) Fatal exception in thread Thread[CompactionExecutor:2,1,main]
> java.lang.NullPointerException
> at org.apache.cassandra.io.PrecompactedRow.<init>(PrecompactedRow.java:86)
> at org.apache.cassandra.io.CompactionIterator.getCompactedRow(CompactionIterator.java:167)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:124)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:44)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.CompactionManager.doCompaction(CompactionManager.java:553)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:146)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:112)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> size of data in /var/lib/cassandra is 11G on this, but there is also report that 1.7G also see the same.
> data was previously populated from 0.7.4 cassandra
> added debug logging, not sure how much this help (this is logged before the exception.)
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,588 CompactionManager.java (line 534) Compacting Major: [SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-10-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-7-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-6-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-8-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-9-Data.db')]
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-10-Data.db : 256
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-7-Data.db : 512
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-6-Data.db : 768
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-8-Data.db : 1024
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-9-Data.db : 1280
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,609 CompactionIterator.java (line 185) Major@1181554512(cfs, inode.path, 523/10895) now compacting at 16777 bytes/ms.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2528) NPE from PrecompactedRow
Posted by "Jackson Chung (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022884#comment-13022884 ]
Jackson Chung commented on CASSANDRA-2528:
------------------------------------------
sure, here is the Assertion Error, the null is on metadata:
> NPE from PrecompactedRow
> ------------------------
>
> Key: CASSANDRA-2528
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2528
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8 beta 1
> Reporter: Jackson Chung
> Assignee: Jonathan Ellis
> Fix For: 0.8.0
>
> Attachments: 2528.txt
>
>
> received a NPE from trunk (0.8) on PrecompactedRow:
> ERROR [CompactionExecutor:2] 2011-04-21 17:21:31,610 AbstractCassandraDaemon.java (line 112) Fatal exception in thread Thread[CompactionExecutor:2,1,main]
> java.lang.NullPointerException
> at org.apache.cassandra.io.PrecompactedRow.<init>(PrecompactedRow.java:86)
> at org.apache.cassandra.io.CompactionIterator.getCompactedRow(CompactionIterator.java:167)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:124)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:44)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.CompactionManager.doCompaction(CompactionManager.java:553)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:146)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:112)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> size of data in /var/lib/cassandra is 11G on this, but there is also report that 1.7G also see the same.
> data was previously populated from 0.7.4 cassandra
> added debug logging, not sure how much this help (this is logged before the exception.)
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,588 CompactionManager.java (line 534) Compacting Major: [SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-10-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-7-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-6-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-8-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-9-Data.db')]
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-10-Data.db : 256
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-7-Data.db : 512
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-6-Data.db : 768
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-8-Data.db : 1024
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-9-Data.db : 1280
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,609 CompactionIterator.java (line 185) Major@1181554512(cfs, inode.path, 523/10895) now compacting at 16777 bytes/ms.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2528) NPE from PrecompactedRow
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-2528:
--------------------------------------
Attachment: 2528.txt
Patch to preserve the CFMetaData object used to construct the ColumnFamily, instead of looking it up from the registry (which does not contain metadata for index CFs).
> NPE from PrecompactedRow
> ------------------------
>
> Key: CASSANDRA-2528
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2528
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8 beta 1
> Reporter: Jackson Chung
> Assignee: Jonathan Ellis
> Fix For: 0.8.0
>
> Attachments: 2528.txt, 2528.txt
>
>
> received a NPE from trunk (0.8) on PrecompactedRow:
> ERROR [CompactionExecutor:2] 2011-04-21 17:21:31,610 AbstractCassandraDaemon.java (line 112) Fatal exception in thread Thread[CompactionExecutor:2,1,main]
> java.lang.NullPointerException
> at org.apache.cassandra.io.PrecompactedRow.<init>(PrecompactedRow.java:86)
> at org.apache.cassandra.io.CompactionIterator.getCompactedRow(CompactionIterator.java:167)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:124)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:44)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.CompactionManager.doCompaction(CompactionManager.java:553)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:146)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:112)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> size of data in /var/lib/cassandra is 11G on this, but there is also report that 1.7G also see the same.
> data was previously populated from 0.7.4 cassandra
> added debug logging, not sure how much this help (this is logged before the exception.)
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,588 CompactionManager.java (line 534) Compacting Major: [SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-10-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-7-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-6-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-8-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-9-Data.db')]
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-10-Data.db : 256
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-7-Data.db : 512
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-6-Data.db : 768
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-8-Data.db : 1024
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-9-Data.db : 1280
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,609 CompactionIterator.java (line 185) Major@1181554512(cfs, inode.path, 523/10895) now compacting at 16777 bytes/ms.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2528) NPE from PrecompactedRow
Posted by "Patricio Echague (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022863#comment-13022863 ]
Patricio Echague commented on CASSANDRA-2528:
---------------------------------------------
I'm seeing the same stacktrace when writing 1GB of data.
> NPE from PrecompactedRow
> ------------------------
>
> Key: CASSANDRA-2528
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2528
> Project: Cassandra
> Issue Type: Bug
> Reporter: Jackson Chung
>
> received a NPE from trunk (0.8) on PrecompactedRow:
> ERROR [CompactionExecutor:2] 2011-04-21 17:21:31,610 AbstractCassandraDaemon.java (line 112) Fatal exception in thread Thread[CompactionExecutor:2,1,main]
> java.lang.NullPointerException
> at org.apache.cassandra.io.PrecompactedRow.<init>(PrecompactedRow.java:86)
> at org.apache.cassandra.io.CompactionIterator.getCompactedRow(CompactionIterator.java:167)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:124)
> at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:44)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
> at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
> at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
> at org.apache.cassandra.db.CompactionManager.doCompaction(CompactionManager.java:553)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:146)
> at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:112)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> size of data in /var/lib/cassandra is 11G on this, but there is also report that 1.7G also see the same.
> data was previously populated from 0.7.4 cassandra
> added debug logging, not sure how much this help (this is logged before the exception.)
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,588 CompactionManager.java (line 534) Compacting Major: [SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-10-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-7-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-6-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-8-Data.db'), SSTableReader(path='/var/lib/cassandra/data/cfs/inode.path-f-9-Data.db')]
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-10-Data.db : 256
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-7-Data.db : 512
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,588 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-6-Data.db : 768
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-8-Data.db : 1024
> DEBUG [CompactionExecutor:2] 2011-04-21 17:21:31,589 SSTableReader.java (line 132) index size for bloom filter calc for file : /var/lib/cassandra/data/cfs/inode.path-f-9-Data.db : 1280
> INFO [CompactionExecutor:2] 2011-04-21 17:21:31,609 CompactionIterator.java (line 185) Major@1181554512(cfs, inode.path, 523/10895) now compacting at 16777 bytes/ms.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira