You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by amit nanda <am...@gmail.com> on 2014/04/18 12:27:15 UTC
Cannot decode file block: Error decompressing block with deflate,
possible data error
Hi,
While reading a file using avrocat tool, i am getting errors *Cannot decode
file block: Error decompressing block with deflate, possible data error.*
And when using avro-tools-1.7.6.jar i get Invalid Sync! errors.
Can anyone please tel me why these errors are coming, and is there a way to
correct the file now without loosing any data?
File was created using 1.7.4 C library
Thanks
Amit
RE: Cannot decode file block: Error decompressing block with
deflate, possible data error
Posted by "Cooper, Michael" <Mi...@hitwise.com>.
I have also experienced deflate errors while reading some (very small % of files) with the C library (and written with the C# library).
Some sort of recovery tool would be a help for me as well.
It could just drop the broken block from the file.
-Michael
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: Wednesday, 30 April 2014 8:11 PM
To: dev@avro.apache.org
Cc: user@avro apache. org
Subject: Re: Cannot decode file block: Error decompressing block with deflate, possible data error
Are all your files running into this, or just a few among the C-written ones? The file is possibly corrupt cause of missing bytes or other reasons (hard to tell specifically). Having more info on the behaviour or a sample such file to inspect may help.
On Fri, Apr 18, 2014 at 3:57 PM, amit nanda <am...@gmail.com> wrote:
> Hi,
>
> While reading a file using avrocat tool, i am getting errors *Cannot
> decode file block: Error decompressing block with deflate, possible
> data error.*
>
> And when using avro-tools-1.7.6.jar i get Invalid Sync! errors.
>
> Can anyone please tel me why these errors are coming, and is there a
> way to correct the file now without loosing any data?
>
> File was created using 1.7.4 C library
>
> Thanks
> Amit
--
Harsh J
Re: Cannot decode file block: Error decompressing block with deflate,
possible data error
Posted by amit nanda <am...@gmail.com>.
This is happening for a very files, out of thousands of file i am writing
2-3 are having this issue.
On Wed, Apr 30, 2014 at 3:40 PM, Harsh J <ha...@cloudera.com> wrote:
> Are all your files running into this, or just a few among the
> C-written ones? The file is possibly corrupt cause of missing bytes or
> other reasons (hard to tell specifically). Having more info on the
> behaviour or a sample such file to inspect may help.
>
> On Fri, Apr 18, 2014 at 3:57 PM, amit nanda <am...@gmail.com> wrote:
> > Hi,
> >
> > While reading a file using avrocat tool, i am getting errors *Cannot
> decode
> > file block: Error decompressing block with deflate, possible data error.*
> >
> > And when using avro-tools-1.7.6.jar i get Invalid Sync! errors.
> >
> > Can anyone please tel me why these errors are coming, and is there a way
> to
> > correct the file now without loosing any data?
> >
> > File was created using 1.7.4 C library
> >
> > Thanks
> > Amit
>
>
>
> --
> Harsh J
>
Re: Cannot decode file block: Error decompressing block with deflate,
possible data error
Posted by amit nanda <am...@gmail.com>.
This is happening for a very files, out of thousands of file i am writing
2-3 are having this issue.
On Wed, Apr 30, 2014 at 3:40 PM, Harsh J <ha...@cloudera.com> wrote:
> Are all your files running into this, or just a few among the
> C-written ones? The file is possibly corrupt cause of missing bytes or
> other reasons (hard to tell specifically). Having more info on the
> behaviour or a sample such file to inspect may help.
>
> On Fri, Apr 18, 2014 at 3:57 PM, amit nanda <am...@gmail.com> wrote:
> > Hi,
> >
> > While reading a file using avrocat tool, i am getting errors *Cannot
> decode
> > file block: Error decompressing block with deflate, possible data error.*
> >
> > And when using avro-tools-1.7.6.jar i get Invalid Sync! errors.
> >
> > Can anyone please tel me why these errors are coming, and is there a way
> to
> > correct the file now without loosing any data?
> >
> > File was created using 1.7.4 C library
> >
> > Thanks
> > Amit
>
>
>
> --
> Harsh J
>
Re: Cannot decode file block: Error decompressing block with deflate,
possible data error
Posted by Harsh J <ha...@cloudera.com>.
Are all your files running into this, or just a few among the
C-written ones? The file is possibly corrupt cause of missing bytes or
other reasons (hard to tell specifically). Having more info on the
behaviour or a sample such file to inspect may help.
On Fri, Apr 18, 2014 at 3:57 PM, amit nanda <am...@gmail.com> wrote:
> Hi,
>
> While reading a file using avrocat tool, i am getting errors *Cannot decode
> file block: Error decompressing block with deflate, possible data error.*
>
> And when using avro-tools-1.7.6.jar i get Invalid Sync! errors.
>
> Can anyone please tel me why these errors are coming, and is there a way to
> correct the file now without loosing any data?
>
> File was created using 1.7.4 C library
>
> Thanks
> Amit
--
Harsh J
Re: Cannot decode file block: Error decompressing block with deflate,
possible data error
Posted by Harsh J <ha...@cloudera.com>.
Are all your files running into this, or just a few among the
C-written ones? The file is possibly corrupt cause of missing bytes or
other reasons (hard to tell specifically). Having more info on the
behaviour or a sample such file to inspect may help.
On Fri, Apr 18, 2014 at 3:57 PM, amit nanda <am...@gmail.com> wrote:
> Hi,
>
> While reading a file using avrocat tool, i am getting errors *Cannot decode
> file block: Error decompressing block with deflate, possible data error.*
>
> And when using avro-tools-1.7.6.jar i get Invalid Sync! errors.
>
> Can anyone please tel me why these errors are coming, and is there a way to
> correct the file now without loosing any data?
>
> File was created using 1.7.4 C library
>
> Thanks
> Amit
--
Harsh J