You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by William Oberman <ob...@civicscience.com> on 2013/01/21 20:36:43 UTC

sstable2json had random behavior

I'm running 1.1.6 from the datastax repo.

I ran sstable2json and got the following error:
Exception in thread "main" java.io.IOError: java.io.IOException: dataSize
of 7020023552240793698 starting at 993981393 would be larger than file
/var/lib/cassandra/data/XXXXX-Data.db length 7502161255
        at
org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:156)
        at
org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:86)
        at
org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:70)
        at
org.apache.cassandra.io.sstable.SSTableScanner$KeyScanningIterator.next(SSTableScanner.java:187)
        at
org.apache.cassandra.io.sstable.SSTableScanner$KeyScanningIterator.next(SSTableScanner.java:151)
        at
org.apache.cassandra.io.sstable.SSTableScanner.next(SSTableScanner.java:143)
        at
org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:309)
        at
org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:340)
        at
org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:353)
        at
org.apache.cassandra.tools.SSTableExport.main(SSTableExport.java:418)
Caused by: java.io.IOException: dataSize of 7020023552240793698 starting at
993981393 would be larger than file /var/lib/cassandra/data/XXXXX-Data.db
length 7502161255
        at
org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:115)
        ... 9 more


I ran it again, and didn't.  This makes me worried :-)  Does anyone else
ever see this class of error, and does it ever disappear for them?

Re: sstable2json had random behavior

Posted by William Oberman <ob...@civicscience.com>.
No, I have the other files unfortunately and I had it fail once and succeed
every time after.

I'm tracking the "external information" of sstable2json more carefully now
(exit status, stdout, stderr), so hopefully if it happens again I can be
more help.

will


On Tue, Jan 22, 2013 at 3:38 PM, aaron morton <aa...@thelastpickle.com>wrote:

> William,
> If the solution from Binh works for you can you please submit a ticket to
> https://issues.apache.org/jira/browse/CASSANDRA
>
> The error message could be better if that is the case.
>
> Cheers
>
>    -----------------
> Aaron Morton
> Freelance Cassandra Developer
> New Zealand
>
> @aaronmorton
> http://www.thelastpickle.com
>
> On 22/01/2013, at 9:16 AM, Binh Nguyen <bi...@gmail.com> wrote:
>
> Hi William,
>
> I also saw this one before but it always happened in my case when I have
> only Data and Index files. The problem goes away when I have all another
> files (Compression, Filter...)
>
>
> On Mon, Jan 21, 2013 at 11:36 AM, William Oberman <
> oberman@civicscience.com> wrote:
>
>> I'm running 1.1.6 from the datastax repo.
>>
>> I ran sstable2json and got the following error:
>> Exception in thread "main" java.io.IOError: java.io.IOException: dataSize
>> of 7020023552240793698 starting at 993981393 would be larger than file
>> /var/lib/cassandra/data/XXXXX-Data.db length 7502161255
>>         at
>> org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:156)
>>         at
>> org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:86)
>>         at
>> org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:70)
>>         at
>> org.apache.cassandra.io.sstable.SSTableScanner$KeyScanningIterator.next(SSTableScanner.java:187)
>>         at
>> org.apache.cassandra.io.sstable.SSTableScanner$KeyScanningIterator.next(SSTableScanner.java:151)
>>         at
>> org.apache.cassandra.io.sstable.SSTableScanner.next(SSTableScanner.java:143)
>>         at
>> org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:309)
>>         at
>> org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:340)
>>         at
>> org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:353)
>>         at
>> org.apache.cassandra.tools.SSTableExport.main(SSTableExport.java:418)
>> Caused by: java.io.IOException: dataSize of 7020023552240793698 starting
>> at 993981393 would be larger than file
>> /var/lib/cassandra/data/XXXXX-Data.db length 7502161255
>>         at
>> org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:115)
>>         ... 9 more
>>
>>
>> I ran it again, and didn't.  This makes me worried :-)  Does anyone else
>> ever see this class of error, and does it ever disappear for them?
>>
>
>
>

Re: sstable2json had random behavior

Posted by aaron morton <aa...@thelastpickle.com>.
William,
	If the solution from Binh works for you can you please submit a ticket to https://issues.apache.org/jira/browse/CASSANDRA

	The error message could be better if that is the case. 

Cheers

-----------------
Aaron Morton
Freelance Cassandra Developer
New Zealand

@aaronmorton
http://www.thelastpickle.com

On 22/01/2013, at 9:16 AM, Binh Nguyen <bi...@gmail.com> wrote:

> Hi William,
> 
> I also saw this one before but it always happened in my case when I have only Data and Index files. The problem goes away when I have all another files (Compression, Filter...)
> 
> 
> On Mon, Jan 21, 2013 at 11:36 AM, William Oberman <ob...@civicscience.com> wrote:
> I'm running 1.1.6 from the datastax repo.  
> 
> I ran sstable2json and got the following error:
> Exception in thread "main" java.io.IOError: java.io.IOException: dataSize of 7020023552240793698 starting at 993981393 would be larger than file /var/lib/cassandra/data/XXXXX-Data.db length 7502161255
>         at org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:156)
>         at org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:86)
>         at org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:70)
>         at org.apache.cassandra.io.sstable.SSTableScanner$KeyScanningIterator.next(SSTableScanner.java:187)
>         at org.apache.cassandra.io.sstable.SSTableScanner$KeyScanningIterator.next(SSTableScanner.java:151)
>         at org.apache.cassandra.io.sstable.SSTableScanner.next(SSTableScanner.java:143)
>         at org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:309)
>         at org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:340)
>         at org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:353)
>         at org.apache.cassandra.tools.SSTableExport.main(SSTableExport.java:418)
> Caused by: java.io.IOException: dataSize of 7020023552240793698 starting at 993981393 would be larger than file /var/lib/cassandra/data/XXXXX-Data.db length 7502161255
>         at org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:115)
>         ... 9 more
> 
> 
> I ran it again, and didn't.  This makes me worried :-)  Does anyone else ever see this class of error, and does it ever disappear for them?
>

Re: sstable2json had random behavior

Posted by Binh Nguyen <bi...@gmail.com>.
Hi William,

I also saw this one before but it always happened in my case when I have
only Data and Index files. The problem goes away when I have all another
files (Compression, Filter...)


On Mon, Jan 21, 2013 at 11:36 AM, William Oberman
<ob...@civicscience.com>wrote:

> I'm running 1.1.6 from the datastax repo.
>
> I ran sstable2json and got the following error:
> Exception in thread "main" java.io.IOError: java.io.IOException: dataSize
> of 7020023552240793698 starting at 993981393 would be larger than file
> /var/lib/cassandra/data/XXXXX-Data.db length 7502161255
>         at
> org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:156)
>         at
> org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:86)
>         at
> org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:70)
>         at
> org.apache.cassandra.io.sstable.SSTableScanner$KeyScanningIterator.next(SSTableScanner.java:187)
>         at
> org.apache.cassandra.io.sstable.SSTableScanner$KeyScanningIterator.next(SSTableScanner.java:151)
>         at
> org.apache.cassandra.io.sstable.SSTableScanner.next(SSTableScanner.java:143)
>         at
> org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:309)
>         at
> org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:340)
>         at
> org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:353)
>         at
> org.apache.cassandra.tools.SSTableExport.main(SSTableExport.java:418)
> Caused by: java.io.IOException: dataSize of 7020023552240793698 starting
> at 993981393 would be larger than file
> /var/lib/cassandra/data/XXXXX-Data.db length 7502161255
>         at
> org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:115)
>         ... 9 more
>
>
> I ran it again, and didn't.  This makes me worried :-)  Does anyone else
> ever see this class of error, and does it ever disappear for them?
>