You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Olivier Smadja (JIRA)" <ji...@apache.org> on 2011/05/13 21:57:47 UTC

[jira] [Created] (CASSANDRA-2648) Failing while starting Cassandar server : Corrupt (negative) value length encountered

Failing while starting Cassandar server : Corrupt (negative) value length encountered
-------------------------------------------------------------------------------------

                 Key: CASSANDRA-2648
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2648
             Project: Cassandra
          Issue Type: Bug
    Affects Versions: 0.7.4
         Environment: Linux
            Reporter: Olivier Smadja


 INFO 16:50:35,307 reading saved cache /home/tapix/data/cassandra/data/saved_caches/tapix_prod-StreamPostsStatistics-KeyCache
 INFO 16:50:35,316 Opening /home/tapix/data/cassandra/data/tapix_prod/StreamPostsStatistics-f-121
 INFO 16:50:35,320 Opening /home/tapix/data/cassandra/data/tapix_prod/StreamPostsStatistics-f-120
 INFO 16:50:35,329 Opening /home/tapix/data/cassandra/data/tapix_prod/StreamLine-f-9
 INFO 16:50:35,352 Creating new commitlog segment /home/tapix/data/cassandra/data/commitlog/CommitLog-1305316235352.log
 INFO 16:50:35,362 Replaying /home/tapix/data/cassandra/data/commitlog/CommitLog-1303829569725.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1303948043185.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1304361402015.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1304728796807.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1305208776962.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1305316204091.log
 INFO 16:50:35,536 Finished reading /home/tapix/data/cassandra/data/commitlog/CommitLog-1303829569725.log
ERROR 16:50:35,537 Exception encountered during startup.
java.io.IOException: Corrupt (negative) value length encountered
	at org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:269)
	at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:94)
	at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:35)
	at org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:129)
	at org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:120)
	at org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:380)
	at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:253)
	at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:156)
	at org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:173)
	at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:314)
	at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:79)
Exception encountered during startup.
java.io.IOException: Corrupt (negative) value length encountered
	at org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:269)
	at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:94)
	at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:35)
	at org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:129)
	at org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:120)
	at org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:380)
	at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:253)
	at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:156)
	at org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:173)
	at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:314)
	at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:79)


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (CASSANDRA-2648) Failing while starting Cassandar server : Corrupt (negative) value length encountered

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-2648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis resolved CASSANDRA-2648.
---------------------------------------

    Resolution: Cannot Reproduce

> Failing while starting Cassandar server : Corrupt (negative) value length encountered
> -------------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-2648
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2648
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.7.4
>         Environment: Linux
>            Reporter: Olivier Smadja
>
>  INFO 16:50:35,307 reading saved cache /home/tapix/data/cassandra/data/saved_caches/tapix_prod-StreamPostsStatistics-KeyCache
>  INFO 16:50:35,316 Opening /home/tapix/data/cassandra/data/tapix_prod/StreamPostsStatistics-f-121
>  INFO 16:50:35,320 Opening /home/tapix/data/cassandra/data/tapix_prod/StreamPostsStatistics-f-120
>  INFO 16:50:35,329 Opening /home/tapix/data/cassandra/data/tapix_prod/StreamLine-f-9
>  INFO 16:50:35,352 Creating new commitlog segment /home/tapix/data/cassandra/data/commitlog/CommitLog-1305316235352.log
>  INFO 16:50:35,362 Replaying /home/tapix/data/cassandra/data/commitlog/CommitLog-1303829569725.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1303948043185.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1304361402015.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1304728796807.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1305208776962.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1305316204091.log
>  INFO 16:50:35,536 Finished reading /home/tapix/data/cassandra/data/commitlog/CommitLog-1303829569725.log
> ERROR 16:50:35,537 Exception encountered during startup.
> java.io.IOException: Corrupt (negative) value length encountered
> 	at org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:269)
> 	at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:94)
> 	at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:35)
> 	at org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:129)
> 	at org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:120)
> 	at org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:380)
> 	at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:253)
> 	at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:156)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:173)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:314)
> 	at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:79)
> Exception encountered during startup.
> java.io.IOException: Corrupt (negative) value length encountered
> 	at org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:269)
> 	at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:94)
> 	at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:35)
> 	at org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:129)
> 	at org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:120)
> 	at org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:380)
> 	at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:253)
> 	at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:156)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:173)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:314)
> 	at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:79)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-2648) Failing while starting Cassandar server : Corrupt (negative) value length encountered

Posted by "Stu Hood (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-2648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13033431#comment-13033431 ] 

Stu Hood commented on CASSANDRA-2648:
-------------------------------------

Assuming this is random corruption, you should be able to start the node by moving that commitlog out of the way. If the data is not sensitive, it would probably be helpful if you could attach a (compressed copy).

Was there anything unusual about how the node went offline?

> Failing while starting Cassandar server : Corrupt (negative) value length encountered
> -------------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-2648
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2648
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.7.4
>         Environment: Linux
>            Reporter: Olivier Smadja
>
>  INFO 16:50:35,307 reading saved cache /home/tapix/data/cassandra/data/saved_caches/tapix_prod-StreamPostsStatistics-KeyCache
>  INFO 16:50:35,316 Opening /home/tapix/data/cassandra/data/tapix_prod/StreamPostsStatistics-f-121
>  INFO 16:50:35,320 Opening /home/tapix/data/cassandra/data/tapix_prod/StreamPostsStatistics-f-120
>  INFO 16:50:35,329 Opening /home/tapix/data/cassandra/data/tapix_prod/StreamLine-f-9
>  INFO 16:50:35,352 Creating new commitlog segment /home/tapix/data/cassandra/data/commitlog/CommitLog-1305316235352.log
>  INFO 16:50:35,362 Replaying /home/tapix/data/cassandra/data/commitlog/CommitLog-1303829569725.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1303948043185.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1304361402015.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1304728796807.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1305208776962.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1305316204091.log
>  INFO 16:50:35,536 Finished reading /home/tapix/data/cassandra/data/commitlog/CommitLog-1303829569725.log
> ERROR 16:50:35,537 Exception encountered during startup.
> java.io.IOException: Corrupt (negative) value length encountered
> 	at org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:269)
> 	at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:94)
> 	at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:35)
> 	at org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:129)
> 	at org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:120)
> 	at org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:380)
> 	at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:253)
> 	at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:156)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:173)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:314)
> 	at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:79)
> Exception encountered during startup.
> java.io.IOException: Corrupt (negative) value length encountered
> 	at org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:269)
> 	at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:94)
> 	at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:35)
> 	at org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:129)
> 	at org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:120)
> 	at org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:380)
> 	at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:253)
> 	at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:156)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:173)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:314)
> 	at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:79)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (CASSANDRA-2648) Failing while starting Cassandar server : Corrupt (negative) value length encountered

Posted by "Olivier Smadja (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-2648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13033584#comment-13033584 ] 

Olivier Smadja commented on CASSANDRA-2648:
-------------------------------------------

Yes, I removed the file and all way running ok.

About the file: I renamed it  with a .old extension but it not there anymore
:-( It seems Cassandra deleted it.

Thanks,
Olivier








> Failing while starting Cassandar server : Corrupt (negative) value length encountered
> -------------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-2648
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2648
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.7.4
>         Environment: Linux
>            Reporter: Olivier Smadja
>
>  INFO 16:50:35,307 reading saved cache /home/tapix/data/cassandra/data/saved_caches/tapix_prod-StreamPostsStatistics-KeyCache
>  INFO 16:50:35,316 Opening /home/tapix/data/cassandra/data/tapix_prod/StreamPostsStatistics-f-121
>  INFO 16:50:35,320 Opening /home/tapix/data/cassandra/data/tapix_prod/StreamPostsStatistics-f-120
>  INFO 16:50:35,329 Opening /home/tapix/data/cassandra/data/tapix_prod/StreamLine-f-9
>  INFO 16:50:35,352 Creating new commitlog segment /home/tapix/data/cassandra/data/commitlog/CommitLog-1305316235352.log
>  INFO 16:50:35,362 Replaying /home/tapix/data/cassandra/data/commitlog/CommitLog-1303829569725.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1303948043185.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1304361402015.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1304728796807.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1305208776962.log, /home/tapix/data/cassandra/data/commitlog/CommitLog-1305316204091.log
>  INFO 16:50:35,536 Finished reading /home/tapix/data/cassandra/data/commitlog/CommitLog-1303829569725.log
> ERROR 16:50:35,537 Exception encountered during startup.
> java.io.IOException: Corrupt (negative) value length encountered
> 	at org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:269)
> 	at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:94)
> 	at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:35)
> 	at org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:129)
> 	at org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:120)
> 	at org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:380)
> 	at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:253)
> 	at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:156)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:173)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:314)
> 	at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:79)
> Exception encountered during startup.
> java.io.IOException: Corrupt (negative) value length encountered
> 	at org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:269)
> 	at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:94)
> 	at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:35)
> 	at org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:129)
> 	at org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:120)
> 	at org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:380)
> 	at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:253)
> 	at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:156)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:173)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:314)
> 	at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:79)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira