You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@cassandra.apache.org by Arya Goudarzi <ag...@gaiaonline.com> on 2010/07/29 23:42:47 UTC

Avro Runtime Exception Bad Index

Just wanted to toss this out there in case if this is an issue or the format really changed and have to start from a clean slate. I was running from yesterday's trunc and had some Keyspaces with data. Today's trunc failed server start giving this exception:

ERROR [main] 2010-07-29 14:05:21,489 AbstractCassandraDaemon.java (line 107) Exception encountered during startup.
org.apache.avro.AvroRuntimeException: Bad index
	at org.apache.cassandra.avro.KsDef.put(KsDef.java:27)
	at org.apache.avro.specific.SpecificDatumReader.setField(SpecificDatumReader.java:47)
	at org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:108)
	at org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:80)
	at org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:71)
	at org.apache.cassandra.io.SerDeUtils.deserialize(SerDeUtils.java:57)
	at org.apache.cassandra.db.DefsTable.loadFromStorage(DefsTable.java:112)
	at org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDescriptor.java:471)
	at org.apache.cassandra.thrift.CassandraDaemon.setup(CassandraDaemon.java:103)
	at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:90)
	at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:224)


-Arya

Re: Avro Runtime Exception Bad Index

Posted by Stu Hood <st...@rackspace.com>.

Thanks for the report Arya! I've opened https://issues.apache.org/jira/browse/CASSANDRA-1351 to take care of this.

-----Original Message-----
From: "Arya Goudarzi" <ag...@gaiaonline.com>
Sent: Friday, July 30, 2010 5:17pm
To: user@cassandra.apache.org
Cc: stu.hood@rackspace.com
Subject: Re: Avro Runtime Exception Bad Index

I pull from trunc and build every day at 2pm PST. So,

Previous Version: Trunc, July 28th @ 2pm pst
Broken Startup Version: Trunc, July 29th @ 2pm pst

Today, I also ended up getting the following AssertionError when my cron svn updated and built and i had to cleanup my commit and data directories for it to start:

Previous Version: Trunc, July, 29th @ 2pm pst
Broken Startup Version: Trunc, July, 30th @ 2pm pst


java.lang.AssertionError
        at org.apache.cassandra.db.ColumnFamily.create(ColumnFamily.java:67)
        at org.apache.cassandra.db.ColumnFamily.create(ColumnFamily.java:57)
        at org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:112)
        at org.apache.cassandra.db.RowMutationSerializer.defreezeTheMaps(RowMutation.java:372)
        at org.apache.cassandra.db.RowMutationSerializer.deserialize(RowMutation.java:382)
        at org.apache.cassandra.db.RowMutationSerializer.deserialize(RowMutation.java:340)
        at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:255)
        at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:173)
        at org.apache.cassandra.thrift.CassandraDaemon.setup(CassandraDaemon.java:120)
        at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:90)
        at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:224)

No one is using this cluster. So, there is 0 traffic at the time update happens. 


----- Original Message -----
From: "Stu Hood" <st...@rackspace.com>
To: user@cassandra.apache.org
Sent: Thursday, July 29, 2010 2:52:48 PM
Subject: RE: Avro Runtime Exception Bad Index

Can you determine approximately what revisions you were running before and after?

-----Original Message-----
From: "Arya Goudarzi" <ag...@gaiaonline.com>
Sent: Thursday, July 29, 2010 4:42pm
To: user@cassandra.apache.org
Subject: Avro Runtime Exception Bad Index

Just wanted to toss this out there in case if this is an issue or the format really changed and have to start from a clean slate. I was running from yesterday's trunc and had some Keyspaces with data. Today's trunc failed server start giving this exception:

ERROR [main] 2010-07-29 14:05:21,489 AbstractCassandraDaemon.java (line 107) Exception encountered during startup.
org.apache.avro.AvroRuntimeException: Bad index
	at org.apache.cassandra.avro.KsDef.put(KsDef.java:27)
	at org.apache.avro.specific.SpecificDatumReader.setField(SpecificDatumReader.java:47)
	at org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:108)
	at org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:80)
	at org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:71)
	at org.apache.cassandra.io.SerDeUtils.deserialize(SerDeUtils.java:57)
	at org.apache.cassandra.db.DefsTable.loadFromStorage(DefsTable.java:112)
	at org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDescriptor.java:471)
	at org.apache.cassandra.thrift.CassandraDaemon.setup(CassandraDaemon.java:103)
	at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:90)
	at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:224)


-Arya

Re: Avro Runtime Exception Bad Index

Posted by Arya Goudarzi <ag...@gaiaonline.com>.

I pull from trunc and build every day at 2pm PST. So,

Previous Version: Trunc, July 28th @ 2pm pst
Broken Startup Version: Trunc, July 29th @ 2pm pst

Today, I also ended up getting the following AssertionError when my cron svn updated and built and i had to cleanup my commit and data directories for it to start:

Previous Version: Trunc, July, 29th @ 2pm pst
Broken Startup Version: Trunc, July, 30th @ 2pm pst


java.lang.AssertionError
        at org.apache.cassandra.db.ColumnFamily.create(ColumnFamily.java:67)
        at org.apache.cassandra.db.ColumnFamily.create(ColumnFamily.java:57)
        at org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:112)
        at org.apache.cassandra.db.RowMutationSerializer.defreezeTheMaps(RowMutation.java:372)
        at org.apache.cassandra.db.RowMutationSerializer.deserialize(RowMutation.java:382)
        at org.apache.cassandra.db.RowMutationSerializer.deserialize(RowMutation.java:340)
        at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:255)
        at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:173)
        at org.apache.cassandra.thrift.CassandraDaemon.setup(CassandraDaemon.java:120)
        at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:90)
        at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:224)

No one is using this cluster. So, there is 0 traffic at the time update happens. 


----- Original Message -----
From: "Stu Hood" <st...@rackspace.com>
To: user@cassandra.apache.org
Sent: Thursday, July 29, 2010 2:52:48 PM
Subject: RE: Avro Runtime Exception Bad Index

Can you determine approximately what revisions you were running before and after?

-----Original Message-----
From: "Arya Goudarzi" <ag...@gaiaonline.com>
Sent: Thursday, July 29, 2010 4:42pm
To: user@cassandra.apache.org
Subject: Avro Runtime Exception Bad Index

Just wanted to toss this out there in case if this is an issue or the format really changed and have to start from a clean slate. I was running from yesterday's trunc and had some Keyspaces with data. Today's trunc failed server start giving this exception:

ERROR [main] 2010-07-29 14:05:21,489 AbstractCassandraDaemon.java (line 107) Exception encountered during startup.
org.apache.avro.AvroRuntimeException: Bad index
	at org.apache.cassandra.avro.KsDef.put(KsDef.java:27)
	at org.apache.avro.specific.SpecificDatumReader.setField(SpecificDatumReader.java:47)
	at org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:108)
	at org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:80)
	at org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:71)
	at org.apache.cassandra.io.SerDeUtils.deserialize(SerDeUtils.java:57)
	at org.apache.cassandra.db.DefsTable.loadFromStorage(DefsTable.java:112)
	at org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDescriptor.java:471)
	at org.apache.cassandra.thrift.CassandraDaemon.setup(CassandraDaemon.java:103)
	at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:90)
	at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:224)


-Arya

RE: Avro Runtime Exception Bad Index

Posted by Stu Hood <st...@rackspace.com>.

Can you determine approximately what revisions you were running before and after?

-----Original Message-----
From: "Arya Goudarzi" <ag...@gaiaonline.com>
Sent: Thursday, July 29, 2010 4:42pm
To: user@cassandra.apache.org
Subject: Avro Runtime Exception Bad Index

Just wanted to toss this out there in case if this is an issue or the format really changed and have to start from a clean slate. I was running from yesterday's trunc and had some Keyspaces with data. Today's trunc failed server start giving this exception:

ERROR [main] 2010-07-29 14:05:21,489 AbstractCassandraDaemon.java (line 107) Exception encountered during startup.
org.apache.avro.AvroRuntimeException: Bad index
	at org.apache.cassandra.avro.KsDef.put(KsDef.java:27)
	at org.apache.avro.specific.SpecificDatumReader.setField(SpecificDatumReader.java:47)
	at org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:108)
	at org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:80)
	at org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:71)
	at org.apache.cassandra.io.SerDeUtils.deserialize(SerDeUtils.java:57)
	at org.apache.cassandra.db.DefsTable.loadFromStorage(DefsTable.java:112)
	at org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDescriptor.java:471)
	at org.apache.cassandra.thrift.CassandraDaemon.setup(CassandraDaemon.java:103)
	at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:90)
	at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:224)


-Arya