You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Brandon Williams (JIRA)" <ji...@apache.org> on 2012/09/19 15:01:07 UTC
[jira] [Created] (CASSANDRA-4685) scrubbing the system keyspace
fails on peers and schema
Brandon Williams created CASSANDRA-4685:
-------------------------------------------
Summary: scrubbing the system keyspace fails on peers and schema
Key: CASSANDRA-4685
URL: https://issues.apache.org/jira/browse/CASSANDRA-4685
Project: Cassandra
Issue Type: Bug
Affects Versions: 1.2.0 beta 1
Reporter: Brandon Williams
Fix For: 1.2.0
{noformat}
INFO 12:20:42,822 Scrubbing SSTableReader(path='/var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-ia-1-Data.db')
WARN 12:20:42,826 Non-fatal error reading row (stacktrace follows)
java.lang.RuntimeException: Error validating row DecoratedKey(61935297886570031978600740763604084078, 4b6579737061636531)
at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:244)
at org.apache.cassandra.db.compaction.PrecompactedRow.merge(PrecompactedRow.java:111)
at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:95)
at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:151)
at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:157)
at org.apache.cassandra.db.compaction.Scrubber.scrub(Scrubber.java:173)
at org.apache.cassandra.db.compaction.CompactionManager.scrubOne(CompactionManager.java:495)
at org.apache.cassandra.db.compaction.CompactionManager.doScrub(CompactionManager.java:484)
at org.apache.cassandra.db.compaction.CompactionManager.access$300(CompactionManager.java:66)
at org.apache.cassandra.db.compaction.CompactionManager$3.perform(CompactionManager.java:223)
at org.apache.cassandra.db.compaction.CompactionManager$2.call(CompactionManager.java:193)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: org.apache.cassandra.db.marshal.MarshalException: String didn't validate.
at org.apache.cassandra.db.marshal.UTF8Type.validate(UTF8Type.java:65)
at org.apache.cassandra.db.Column.validateFields(Column.java:287)
at org.apache.cassandra.db.ColumnFamily.validateColumnFields(ColumnFamily.java:378)
at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:240)
... 15 more
WARN 12:20:42,826 Row at 19 is unreadable; skipping to next
WARN 12:20:42,827 No valid rows found while scrubbing SSTableReader(path='/var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-ia-1-Data.db'); it is marked for deletion now. If you want to attempt manual recovery, you can find a copy in the pre-scrub snapshot
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Comment Edited] (CASSANDRA-4685) scrubbing the system
keyspace fails on peers and schema
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462098#comment-13462098 ]
Jonathan Ellis edited comment on CASSANDRA-4685 at 9/25/12 7:42 AM:
--------------------------------------------------------------------
attached patch demonstrates that it's trying to validate gossip_generation as utf8, when it's declared int. bug in schema compiling?
{noformat}
Caused by: org.apache.cassandra.db.marshal.MarshalException: Failed to validate column gossip_generation
at org.apache.cassandra.db.Column.validateFields(Column.java:295)
at org.apache.cassandra.db.ColumnFamily.validateColumnFields(ColumnFamily.java:378)
at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTabl
eIdentityIterator.java:240)
... 15 more
Caused by: org.apache.cassandra.db.marshal.MarshalException: String didn't validate.
{noformat}
was (Author: jbellis):
attached patch demonstrates that it's trying to validate gossip_generation as utf8, when it's declared int. bug in schema compiling?
> scrubbing the system keyspace fails on peers and schema
> -------------------------------------------------------
>
> Key: CASSANDRA-4685
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4685
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.2.0 beta 1
> Reporter: Brandon Williams
> Assignee: Sylvain Lebresne
> Fix For: 1.2.0 beta 2
>
> Attachments: scrub-transparency.txt
>
>
> {noformat}
> INFO 12:20:42,822 Scrubbing SSTableReader(path='/var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-ia-1-Data.db')
> WARN 12:20:42,826 Non-fatal error reading row (stacktrace follows)
> java.lang.RuntimeException: Error validating row DecoratedKey(61935297886570031978600740763604084078, 4b6579737061636531)
> at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:244)
> at org.apache.cassandra.db.compaction.PrecompactedRow.merge(PrecompactedRow.java:111)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:95)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:151)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:157)
> at org.apache.cassandra.db.compaction.Scrubber.scrub(Scrubber.java:173)
> at org.apache.cassandra.db.compaction.CompactionManager.scrubOne(CompactionManager.java:495)
> at org.apache.cassandra.db.compaction.CompactionManager.doScrub(CompactionManager.java:484)
> at org.apache.cassandra.db.compaction.CompactionManager.access$300(CompactionManager.java:66)
> at org.apache.cassandra.db.compaction.CompactionManager$3.perform(CompactionManager.java:223)
> at org.apache.cassandra.db.compaction.CompactionManager$2.call(CompactionManager.java:193)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: org.apache.cassandra.db.marshal.MarshalException: String didn't validate.
> at org.apache.cassandra.db.marshal.UTF8Type.validate(UTF8Type.java:65)
> at org.apache.cassandra.db.Column.validateFields(Column.java:287)
> at org.apache.cassandra.db.ColumnFamily.validateColumnFields(ColumnFamily.java:378)
> at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:240)
> ... 15 more
> WARN 12:20:42,826 Row at 19 is unreadable; skipping to next
> WARN 12:20:42,827 No valid rows found while scrubbing SSTableReader(path='/var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-ia-1-Data.db'); it is marked for deletion now. If you want to attempt manual recovery, you can find a copy in the pre-scrub snapshot
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4685) scrubbing the system keyspace
fails on peers and schema
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-4685:
--------------------------------------
Attachment: scrub-transparency.txt
attached patch demonstrates that it's trying to validate gossip_generation as utf8, when it's declared int. bug in schema compiling?
> scrubbing the system keyspace fails on peers and schema
> -------------------------------------------------------
>
> Key: CASSANDRA-4685
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4685
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.2.0 beta 1
> Reporter: Brandon Williams
> Fix For: 1.2.0 beta 2
>
> Attachments: scrub-transparency.txt
>
>
> {noformat}
> INFO 12:20:42,822 Scrubbing SSTableReader(path='/var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-ia-1-Data.db')
> WARN 12:20:42,826 Non-fatal error reading row (stacktrace follows)
> java.lang.RuntimeException: Error validating row DecoratedKey(61935297886570031978600740763604084078, 4b6579737061636531)
> at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:244)
> at org.apache.cassandra.db.compaction.PrecompactedRow.merge(PrecompactedRow.java:111)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:95)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:151)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:157)
> at org.apache.cassandra.db.compaction.Scrubber.scrub(Scrubber.java:173)
> at org.apache.cassandra.db.compaction.CompactionManager.scrubOne(CompactionManager.java:495)
> at org.apache.cassandra.db.compaction.CompactionManager.doScrub(CompactionManager.java:484)
> at org.apache.cassandra.db.compaction.CompactionManager.access$300(CompactionManager.java:66)
> at org.apache.cassandra.db.compaction.CompactionManager$3.perform(CompactionManager.java:223)
> at org.apache.cassandra.db.compaction.CompactionManager$2.call(CompactionManager.java:193)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: org.apache.cassandra.db.marshal.MarshalException: String didn't validate.
> at org.apache.cassandra.db.marshal.UTF8Type.validate(UTF8Type.java:65)
> at org.apache.cassandra.db.Column.validateFields(Column.java:287)
> at org.apache.cassandra.db.ColumnFamily.validateColumnFields(ColumnFamily.java:378)
> at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:240)
> ... 15 more
> WARN 12:20:42,826 Row at 19 is unreadable; skipping to next
> WARN 12:20:42,827 No valid rows found while scrubbing SSTableReader(path='/var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-ia-1-Data.db'); it is marked for deletion now. If you want to attempt manual recovery, you can find a copy in the pre-scrub snapshot
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4685) Fix scrubbing of CQL3 created
tables
Posted by "Sylvain Lebresne (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sylvain Lebresne updated CASSANDRA-4685:
----------------------------------------
Summary: Fix scrubbing of CQL3 created tables (was: scrubbing the system keyspace fails on peers and schema)
> Fix scrubbing of CQL3 created tables
> ------------------------------------
>
> Key: CASSANDRA-4685
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4685
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.2.0 beta 1
> Reporter: Brandon Williams
> Assignee: Sylvain Lebresne
> Fix For: 1.2.0 beta 2
>
> Attachments: 4685.txt, scrub-transparency.txt
>
>
> {noformat}
> INFO 12:20:42,822 Scrubbing SSTableReader(path='/var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-ia-1-Data.db')
> WARN 12:20:42,826 Non-fatal error reading row (stacktrace follows)
> java.lang.RuntimeException: Error validating row DecoratedKey(61935297886570031978600740763604084078, 4b6579737061636531)
> at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:244)
> at org.apache.cassandra.db.compaction.PrecompactedRow.merge(PrecompactedRow.java:111)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:95)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:151)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:157)
> at org.apache.cassandra.db.compaction.Scrubber.scrub(Scrubber.java:173)
> at org.apache.cassandra.db.compaction.CompactionManager.scrubOne(CompactionManager.java:495)
> at org.apache.cassandra.db.compaction.CompactionManager.doScrub(CompactionManager.java:484)
> at org.apache.cassandra.db.compaction.CompactionManager.access$300(CompactionManager.java:66)
> at org.apache.cassandra.db.compaction.CompactionManager$3.perform(CompactionManager.java:223)
> at org.apache.cassandra.db.compaction.CompactionManager$2.call(CompactionManager.java:193)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: org.apache.cassandra.db.marshal.MarshalException: String didn't validate.
> at org.apache.cassandra.db.marshal.UTF8Type.validate(UTF8Type.java:65)
> at org.apache.cassandra.db.Column.validateFields(Column.java:287)
> at org.apache.cassandra.db.ColumnFamily.validateColumnFields(ColumnFamily.java:378)
> at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:240)
> ... 15 more
> WARN 12:20:42,826 Row at 19 is unreadable; skipping to next
> WARN 12:20:42,827 No valid rows found while scrubbing SSTableReader(path='/var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-ia-1-Data.db'); it is marked for deletion now. If you want to attempt manual recovery, you can find a copy in the pre-scrub snapshot
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Comment Edited] (CASSANDRA-4685) scrubbing the system
keyspace fails on peers and schema
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462098#comment-13462098 ]
Jonathan Ellis edited comment on CASSANDRA-4685 at 9/25/12 7:43 AM:
--------------------------------------------------------------------
attached patch demonstrates that it's trying to validate gossip_generation as utf8, when it's declared int. bug in schema compiling?
{noformat}
Caused by: org.apache.cassandra.db.marshal.MarshalException: Failed to validate column gossip_generation
at org.apache.cassandra.db.Column.validateFields(Column.java:295)
at org.apache.cassandra.db.ColumnFamily.validateColumnFields(ColumnFamily.java:378)
at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTabl
eIdentityIterator.java:240)
... 15 more
Caused by: org.apache.cassandra.db.marshal.MarshalException: String didn't validate.
at org.apache.cassandra.db.marshal.UTF8Type.validate(UTF8Type.java:65)
{noformat}
was (Author: jbellis):
attached patch demonstrates that it's trying to validate gossip_generation as utf8, when it's declared int. bug in schema compiling?
{noformat}
Caused by: org.apache.cassandra.db.marshal.MarshalException: Failed to validate column gossip_generation
at org.apache.cassandra.db.Column.validateFields(Column.java:295)
at org.apache.cassandra.db.ColumnFamily.validateColumnFields(ColumnFamily.java:378)
at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTabl
eIdentityIterator.java:240)
... 15 more
Caused by: org.apache.cassandra.db.marshal.MarshalException: String didn't validate.
{noformat}
> scrubbing the system keyspace fails on peers and schema
> -------------------------------------------------------
>
> Key: CASSANDRA-4685
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4685
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.2.0 beta 1
> Reporter: Brandon Williams
> Assignee: Sylvain Lebresne
> Fix For: 1.2.0 beta 2
>
> Attachments: scrub-transparency.txt
>
>
> {noformat}
> INFO 12:20:42,822 Scrubbing SSTableReader(path='/var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-ia-1-Data.db')
> WARN 12:20:42,826 Non-fatal error reading row (stacktrace follows)
> java.lang.RuntimeException: Error validating row DecoratedKey(61935297886570031978600740763604084078, 4b6579737061636531)
> at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:244)
> at org.apache.cassandra.db.compaction.PrecompactedRow.merge(PrecompactedRow.java:111)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:95)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:151)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:157)
> at org.apache.cassandra.db.compaction.Scrubber.scrub(Scrubber.java:173)
> at org.apache.cassandra.db.compaction.CompactionManager.scrubOne(CompactionManager.java:495)
> at org.apache.cassandra.db.compaction.CompactionManager.doScrub(CompactionManager.java:484)
> at org.apache.cassandra.db.compaction.CompactionManager.access$300(CompactionManager.java:66)
> at org.apache.cassandra.db.compaction.CompactionManager$3.perform(CompactionManager.java:223)
> at org.apache.cassandra.db.compaction.CompactionManager$2.call(CompactionManager.java:193)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: org.apache.cassandra.db.marshal.MarshalException: String didn't validate.
> at org.apache.cassandra.db.marshal.UTF8Type.validate(UTF8Type.java:65)
> at org.apache.cassandra.db.Column.validateFields(Column.java:287)
> at org.apache.cassandra.db.ColumnFamily.validateColumnFields(ColumnFamily.java:378)
> at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:240)
> ... 15 more
> WARN 12:20:42,826 Row at 19 is unreadable; skipping to next
> WARN 12:20:42,827 No valid rows found while scrubbing SSTableReader(path='/var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-ia-1-Data.db'); it is marked for deletion now. If you want to attempt manual recovery, you can find a copy in the pre-scrub snapshot
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-4685) scrubbing the system keyspace
fails on peers and schema
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462958#comment-13462958 ]
Jonathan Ellis commented on CASSANDRA-4685:
-------------------------------------------
+1
> scrubbing the system keyspace fails on peers and schema
> -------------------------------------------------------
>
> Key: CASSANDRA-4685
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4685
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.2.0 beta 1
> Reporter: Brandon Williams
> Assignee: Sylvain Lebresne
> Fix For: 1.2.0 beta 2
>
> Attachments: 4685.txt, scrub-transparency.txt
>
>
> {noformat}
> INFO 12:20:42,822 Scrubbing SSTableReader(path='/var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-ia-1-Data.db')
> WARN 12:20:42,826 Non-fatal error reading row (stacktrace follows)
> java.lang.RuntimeException: Error validating row DecoratedKey(61935297886570031978600740763604084078, 4b6579737061636531)
> at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:244)
> at org.apache.cassandra.db.compaction.PrecompactedRow.merge(PrecompactedRow.java:111)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:95)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:151)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:157)
> at org.apache.cassandra.db.compaction.Scrubber.scrub(Scrubber.java:173)
> at org.apache.cassandra.db.compaction.CompactionManager.scrubOne(CompactionManager.java:495)
> at org.apache.cassandra.db.compaction.CompactionManager.doScrub(CompactionManager.java:484)
> at org.apache.cassandra.db.compaction.CompactionManager.access$300(CompactionManager.java:66)
> at org.apache.cassandra.db.compaction.CompactionManager$3.perform(CompactionManager.java:223)
> at org.apache.cassandra.db.compaction.CompactionManager$2.call(CompactionManager.java:193)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: org.apache.cassandra.db.marshal.MarshalException: String didn't validate.
> at org.apache.cassandra.db.marshal.UTF8Type.validate(UTF8Type.java:65)
> at org.apache.cassandra.db.Column.validateFields(Column.java:287)
> at org.apache.cassandra.db.ColumnFamily.validateColumnFields(ColumnFamily.java:378)
> at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:240)
> ... 15 more
> WARN 12:20:42,826 Row at 19 is unreadable; skipping to next
> WARN 12:20:42,827 No valid rows found while scrubbing SSTableReader(path='/var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-ia-1-Data.db'); it is marked for deletion now. If you want to attempt manual recovery, you can find a copy in the pre-scrub snapshot
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4685) scrubbing the system keyspace
fails on peers and schema
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-4685:
--------------------------------------
Reviewer: jbellis
Fix Version/s: (was: 1.2.0)
1.2.0 beta 2
Assignee: Sylvain Lebresne
(patch not intended for inclusion, since we can't trust wide row names to not blow up our log file)
> scrubbing the system keyspace fails on peers and schema
> -------------------------------------------------------
>
> Key: CASSANDRA-4685
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4685
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.2.0 beta 1
> Reporter: Brandon Williams
> Assignee: Sylvain Lebresne
> Fix For: 1.2.0 beta 2
>
> Attachments: scrub-transparency.txt
>
>
> {noformat}
> INFO 12:20:42,822 Scrubbing SSTableReader(path='/var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-ia-1-Data.db')
> WARN 12:20:42,826 Non-fatal error reading row (stacktrace follows)
> java.lang.RuntimeException: Error validating row DecoratedKey(61935297886570031978600740763604084078, 4b6579737061636531)
> at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:244)
> at org.apache.cassandra.db.compaction.PrecompactedRow.merge(PrecompactedRow.java:111)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:95)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:151)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:157)
> at org.apache.cassandra.db.compaction.Scrubber.scrub(Scrubber.java:173)
> at org.apache.cassandra.db.compaction.CompactionManager.scrubOne(CompactionManager.java:495)
> at org.apache.cassandra.db.compaction.CompactionManager.doScrub(CompactionManager.java:484)
> at org.apache.cassandra.db.compaction.CompactionManager.access$300(CompactionManager.java:66)
> at org.apache.cassandra.db.compaction.CompactionManager$3.perform(CompactionManager.java:223)
> at org.apache.cassandra.db.compaction.CompactionManager$2.call(CompactionManager.java:193)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: org.apache.cassandra.db.marshal.MarshalException: String didn't validate.
> at org.apache.cassandra.db.marshal.UTF8Type.validate(UTF8Type.java:65)
> at org.apache.cassandra.db.Column.validateFields(Column.java:287)
> at org.apache.cassandra.db.ColumnFamily.validateColumnFields(ColumnFamily.java:378)
> at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:240)
> ... 15 more
> WARN 12:20:42,826 Row at 19 is unreadable; skipping to next
> WARN 12:20:42,827 No valid rows found while scrubbing SSTableReader(path='/var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-ia-1-Data.db'); it is marked for deletion now. If you want to attempt manual recovery, you can find a copy in the pre-scrub snapshot
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4685) scrubbing the system keyspace
fails on peers and schema
Posted by "Sylvain Lebresne (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sylvain Lebresne updated CASSANDRA-4685:
----------------------------------------
Attachment: 4685.txt
The problem was that scrub was correctly handling the CQL3 ColumnDefinition. Basically it needs the same thing that we've introduced in CASSANDRA-4377, so attaching patch that move said code to CFMetadata to be used more generally.
> scrubbing the system keyspace fails on peers and schema
> -------------------------------------------------------
>
> Key: CASSANDRA-4685
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4685
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.2.0 beta 1
> Reporter: Brandon Williams
> Assignee: Sylvain Lebresne
> Fix For: 1.2.0 beta 2
>
> Attachments: 4685.txt, scrub-transparency.txt
>
>
> {noformat}
> INFO 12:20:42,822 Scrubbing SSTableReader(path='/var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-ia-1-Data.db')
> WARN 12:20:42,826 Non-fatal error reading row (stacktrace follows)
> java.lang.RuntimeException: Error validating row DecoratedKey(61935297886570031978600740763604084078, 4b6579737061636531)
> at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:244)
> at org.apache.cassandra.db.compaction.PrecompactedRow.merge(PrecompactedRow.java:111)
> at org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:95)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:151)
> at org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:157)
> at org.apache.cassandra.db.compaction.Scrubber.scrub(Scrubber.java:173)
> at org.apache.cassandra.db.compaction.CompactionManager.scrubOne(CompactionManager.java:495)
> at org.apache.cassandra.db.compaction.CompactionManager.doScrub(CompactionManager.java:484)
> at org.apache.cassandra.db.compaction.CompactionManager.access$300(CompactionManager.java:66)
> at org.apache.cassandra.db.compaction.CompactionManager$3.perform(CompactionManager.java:223)
> at org.apache.cassandra.db.compaction.CompactionManager$2.call(CompactionManager.java:193)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: org.apache.cassandra.db.marshal.MarshalException: String didn't validate.
> at org.apache.cassandra.db.marshal.UTF8Type.validate(UTF8Type.java:65)
> at org.apache.cassandra.db.Column.validateFields(Column.java:287)
> at org.apache.cassandra.db.ColumnFamily.validateColumnFields(ColumnFamily.java:378)
> at org.apache.cassandra.io.sstable.SSTableIdentityIterator.getColumnFamilyWithColumns(SSTableIdentityIterator.java:240)
> ... 15 more
> WARN 12:20:42,826 Row at 19 is unreadable; skipping to next
> WARN 12:20:42,827 No valid rows found while scrubbing SSTableReader(path='/var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-ia-1-Data.db'); it is marked for deletion now. If you want to attempt manual recovery, you can find a copy in the pre-scrub snapshot
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira