You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by JKnight JKnight <be...@gmail.com> on 2010/03/31 09:48:01 UTC

Cassandra data file corrupt

Dear all,

My Cassandra data file had problem and I can not get data from this file.
And all row after error row can not be accessed. So I lost a lot of data.

Will next version of Cassandra implement the way to prevent data lost. Maybe
we use the checkpoint. If data file corrupt, we will read from the next
checkpoint.

If not, can you suggest me the way to implement this function?

-- 
Best regards,
JKnight

Re: Cassandra data file corrupt

Posted by Stu Hood <st...@rackspace.com>.
808 depends on 674, which has not been fixed, so no, there is no code for 808.

-----Original Message-----
From: "JKnight JKnight" <be...@gmail.com>
Sent: Wednesday, March 31, 2010 10:22pm
To: user@cassandra.apache.org
Subject: Re: Cassandra data file corrupt

Dear Jeremy Dunck,

I tried to compact, and get and error:

Caused by: java.io.UTFDataFormatException: malformed input around byte 13
    at java.io.DataInputStream.readUTF(DataInputStream.java:617)
    at java.io.RandomAccessFile.readUTF(RandomAccessFile.java:887)
    at org.apache.cassandra.io.IteratingRow.<init>(IteratingRow.java:48)
    at
org.apache.cassandra.io.SSTableScanner$KeyScanningIterator.next(SSTableScanner.java:115)

I also tried in version 0.6, but above error still exist.

Perhaps, I will tried the way David Timothy suggest.

@Stu Hood: Do you implement code for 808 issues?

Thank a lot for support.

On Wed, Mar 31, 2010 at 11:02 AM, Jeremy Dunck <jd...@gmail.com> wrote:

> On Wed, Mar 31, 2010 at 7:55 AM, Stu Hood <st...@rackspace.com> wrote:
> > Eventually the new file format will make it in with #674, and we'll be
> able to implement an option to skip corrupted data:
> >
> > https://issues.apache.org/jira/browse/CASSANDRA-808
>
> That ticket seems to indicate that compaction will remove the corrupt
> data, and might make the later data readable.
>
> JKnight, did you try compacting?
>



-- 
Best regards,
JKnight

Re: Cassandra data file corrupt

Posted by JKnight JKnight <be...@gmail.com>.
Dear Jeremy Dunck,

I tried to compact, and get and error:

Caused by: java.io.UTFDataFormatException: malformed input around byte 13
    at java.io.DataInputStream.readUTF(DataInputStream.java:617)
    at java.io.RandomAccessFile.readUTF(RandomAccessFile.java:887)
    at org.apache.cassandra.io.IteratingRow.<init>(IteratingRow.java:48)
    at
org.apache.cassandra.io.SSTableScanner$KeyScanningIterator.next(SSTableScanner.java:115)

I also tried in version 0.6, but above error still exist.

Perhaps, I will tried the way David Timothy suggest.

@Stu Hood: Do you implement code for 808 issues?

Thank a lot for support.

On Wed, Mar 31, 2010 at 11:02 AM, Jeremy Dunck <jd...@gmail.com> wrote:

> On Wed, Mar 31, 2010 at 7:55 AM, Stu Hood <st...@rackspace.com> wrote:
> > Eventually the new file format will make it in with #674, and we'll be
> able to implement an option to skip corrupted data:
> >
> > https://issues.apache.org/jira/browse/CASSANDRA-808
>
> That ticket seems to indicate that compaction will remove the corrupt
> data, and might make the later data readable.
>
> JKnight, did you try compacting?
>



-- 
Best regards,
JKnight

Re: Cassandra data file corrupt

Posted by Jeremy Dunck <jd...@gmail.com>.
On Wed, Mar 31, 2010 at 7:55 AM, Stu Hood <st...@rackspace.com> wrote:
> Eventually the new file format will make it in with #674, and we'll be able to implement an option to skip corrupted data:
>
> https://issues.apache.org/jira/browse/CASSANDRA-808

That ticket seems to indicate that compaction will remove the corrupt
data, and might make the later data readable.

JKnight, did you try compacting?

Re: Cassandra data file corrupt

Posted by Stu Hood <st...@rackspace.com>.
Eventually the new file format will make it in with #674, and we'll be able to implement an option to skip corrupted data:

https://issues.apache.org/jira/browse/CASSANDRA-808

We're not ignoring this issue.

-----Original Message-----
From: "David Timothy Strauss" <da...@fourkitchens.com>
Sent: Wednesday, March 31, 2010 7:16am
To: user@cassandra.apache.org, cassandra-user@incubator.apache.org
Subject: Re: Cassandra data file corrupt

Cassandra has always supported two great ways to prevent data loss:

* Replication
* Backups

I doubt Cassandra will ever focus extensively on single-node recovery when it's so easy to wipe and rebuild any node from the cluster.

-----Original Message-----
From: JKnight JKnight <be...@gmail.com>
Date: Wed, 31 Mar 2010 03:48:01 
To: <ca...@incubator.apache.org>
Subject: Cassandra data file corrupt

Dear all,

My Cassandra data file had problem and I can not get data from this file.
And all row after error row can not be accessed. So I lost a lot of data.

Will next version of Cassandra implement the way to prevent data lost. Maybe
we use the checkpoint. If data file corrupt, we will read from the next
checkpoint.

If not, can you suggest me the way to implement this function?

-- 
Best regards,
JKnight

Re: Cassandra data file corrupt

Posted by JKnight JKnight <be...@gmail.com>.
Dear David Timothy Strauss,

Could you tell me more detail about Backups? As I know, Cassandra data file
will compact new data, so it can be changed many times.

How to backup Cassandra data?

Thanks.

On Wed, Mar 31, 2010 at 8:16 AM, David Timothy Strauss <
david@fourkitchens.com> wrote:

> Cassandra has always supported two great ways to prevent data loss:
>
> * Replication
> * Backups
>
> I doubt Cassandra will ever focus extensively on single-node recovery when
> it's so easy to wipe and rebuild any node from the cluster.
> ------------------------------
> *From: * JKnight JKnight <be...@gmail.com>
> *Date: *Wed, 31 Mar 2010 03:48:01 -0400
> *To: *<ca...@incubator.apache.org>
> *Subject: *Cassandra data file corrupt
>
> Dear all,
>
> My Cassandra data file had problem and I can not get data from this file.
> And all row after error row can not be accessed. So I lost a lot of data.
>
> Will next version of Cassandra implement the way to prevent data lost.
> Maybe we use the checkpoint. If data file corrupt, we will read from the
> next checkpoint.
>
> If not, can you suggest me the way to implement this function?
>
> --
> Best regards,
> JKnight
>



-- 
Best regards,
JKnight

Re: Cassandra data file corrupt

Posted by David Timothy Strauss <da...@fourkitchens.com>.
Cassandra has always supported two great ways to prevent data loss:

* Replication
* Backups

I doubt Cassandra will ever focus extensively on single-node recovery when it's so easy to wipe and rebuild any node from the cluster.

-----Original Message-----
From: JKnight JKnight <be...@gmail.com>
Date: Wed, 31 Mar 2010 03:48:01 
To: <ca...@incubator.apache.org>
Subject: Cassandra data file corrupt

Dear all,

My Cassandra data file had problem and I can not get data from this file.
And all row after error row can not be accessed. So I lost a lot of data.

Will next version of Cassandra implement the way to prevent data lost. Maybe
we use the checkpoint. If data file corrupt, we will read from the next
checkpoint.

If not, can you suggest me the way to implement this function?

-- 
Best regards,
JKnight