You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@avro.apache.org by amit nanda <am...@gmail.com> on 2014/04/14 10:28:52 UTC
Invalid sync! error
Hi,
I am getting "Invalid sync!" error, while reading some of the while from
HDFS. I can see there is already an jira ticket, but i am not sure is this
is a problem is Hadoop core or Avro,
Meaning is this is problem while writing the write and some precaution
needs to be taken at that time?
I am using avro 1.7.5 C library.
Thanks
Amit
Re: Invalid sync! error
Posted by Mika Ristimaki <mi...@gmail.com>.
Okay, then the error is probably somewhere in the write process. Don't know how to help with that.
-Mika
On Apr 15, 2014, at 11:46 AM, amit nanda <am...@gmail.com> wrote:
> I tried to read the file with avro-tools-1.7.6.jar, but i am getting the same error
>
>
> On Tue, Apr 15, 2014 at 1:19 PM, Mika Ristimaki <mi...@gmail.com> wrote:
> Only updating the reading part should be enough.
>
> -Mika
>
> On Apr 15, 2014, at 8:54 AM, amit nanda <am...@gmail.com> wrote:
>
>> So do i need to update to 1.7.6 both while reading and writing, or only updating writing part is sufficient?
>>
>>
>> On Mon, Apr 14, 2014 at 3:50 PM, Mika Ristimaki <mi...@gmail.com> wrote:
>> At least one issue related to reading data was fixed. Might be the one that you are facing or it might not. But the first thing I would recommend you to do is update the Avro lib.
>>
>> -Mika
>>
>> On Apr 14, 2014, at 11:59 AM, amit nanda <am...@gmail.com> wrote:
>>
>>> So is the issue fixed in Avro-C 1.7.6
>>>
>>>
>>> On Mon, Apr 14, 2014 at 4:32 AM, Mika Ristimaki <mi...@gmail.com> wrote:
>>> Hi,
>>>
>>> Try first with Avro-C 1.7.6. There was at least one related bug fixed in that release.
>>>
>>> -Mika
>>>
>>> On Apr 14, 2014, at 11:28 AM, amit nanda <am...@gmail.com> wrote:
>>>
>>> > Hi,
>>> >
>>> > I am getting "Invalid sync!" error, while reading some of the while from HDFS. I can see there is already an jira ticket, but i am not sure is this is a problem is Hadoop core or Avro,
>>> > Meaning is this is problem while writing the write and some precaution needs to be taken at that time?
>>> >
>>> > I am using avro 1.7.5 C library.
>>> >
>>> >
>>> > Thanks
>>> > Amit
>>>
>>>
>>
>>
>
>
Re: Invalid sync! error
Posted by Mika Ristimaki <mi...@gmail.com>.
Okay, then the error is probably somewhere in the write process. Don't know how to help with that.
-Mika
On Apr 15, 2014, at 11:46 AM, amit nanda <am...@gmail.com> wrote:
> I tried to read the file with avro-tools-1.7.6.jar, but i am getting the same error
>
>
> On Tue, Apr 15, 2014 at 1:19 PM, Mika Ristimaki <mi...@gmail.com> wrote:
> Only updating the reading part should be enough.
>
> -Mika
>
> On Apr 15, 2014, at 8:54 AM, amit nanda <am...@gmail.com> wrote:
>
>> So do i need to update to 1.7.6 both while reading and writing, or only updating writing part is sufficient?
>>
>>
>> On Mon, Apr 14, 2014 at 3:50 PM, Mika Ristimaki <mi...@gmail.com> wrote:
>> At least one issue related to reading data was fixed. Might be the one that you are facing or it might not. But the first thing I would recommend you to do is update the Avro lib.
>>
>> -Mika
>>
>> On Apr 14, 2014, at 11:59 AM, amit nanda <am...@gmail.com> wrote:
>>
>>> So is the issue fixed in Avro-C 1.7.6
>>>
>>>
>>> On Mon, Apr 14, 2014 at 4:32 AM, Mika Ristimaki <mi...@gmail.com> wrote:
>>> Hi,
>>>
>>> Try first with Avro-C 1.7.6. There was at least one related bug fixed in that release.
>>>
>>> -Mika
>>>
>>> On Apr 14, 2014, at 11:28 AM, amit nanda <am...@gmail.com> wrote:
>>>
>>> > Hi,
>>> >
>>> > I am getting "Invalid sync!" error, while reading some of the while from HDFS. I can see there is already an jira ticket, but i am not sure is this is a problem is Hadoop core or Avro,
>>> > Meaning is this is problem while writing the write and some precaution needs to be taken at that time?
>>> >
>>> > I am using avro 1.7.5 C library.
>>> >
>>> >
>>> > Thanks
>>> > Amit
>>>
>>>
>>
>>
>
>
Re: Invalid sync! error
Posted by amit nanda <am...@gmail.com>.
I tried to read the file with avro-tools-1.7.6.jar, but i am getting the
same error
On Tue, Apr 15, 2014 at 1:19 PM, Mika Ristimaki <mi...@gmail.com>wrote:
> Only updating the reading part should be enough.
>
> -Mika
>
> On Apr 15, 2014, at 8:54 AM, amit nanda <am...@gmail.com> wrote:
>
> So do i need to update to 1.7.6 both while reading and writing, or only
> updating writing part is sufficient?
>
>
> On Mon, Apr 14, 2014 at 3:50 PM, Mika Ristimaki <mi...@gmail.com>wrote:
>
>> At least one issue related to reading data was fixed. Might be the one
>> that you are facing or it might not. But the first thing I would recommend
>> you to do is update the Avro lib.
>>
>> -Mika
>>
>> On Apr 14, 2014, at 11:59 AM, amit nanda <am...@gmail.com> wrote:
>>
>> So is the issue fixed in Avro-C 1.7.6
>>
>>
>> On Mon, Apr 14, 2014 at 4:32 AM, Mika Ristimaki <mika.ristimaki@gmail.com
>> > wrote:
>>
>>> Hi,
>>>
>>> Try first with Avro-C 1.7.6. There was at least one related bug fixed in
>>> that release.
>>>
>>> -Mika
>>>
>>> On Apr 14, 2014, at 11:28 AM, amit nanda <am...@gmail.com> wrote:
>>>
>>> > Hi,
>>> >
>>> > I am getting "Invalid sync!" error, while reading some of the while
>>> from HDFS. I can see there is already an jira ticket, but i am not sure is
>>> this is a problem is Hadoop core or Avro,
>>> > Meaning is this is problem while writing the write and some precaution
>>> needs to be taken at that time?
>>> >
>>> > I am using avro 1.7.5 C library.
>>> >
>>> >
>>> > Thanks
>>> > Amit
>>>
>>>
>>
>>
>
>
Re: Invalid sync! error
Posted by amit nanda <am...@gmail.com>.
I tried to read the file with avro-tools-1.7.6.jar, but i am getting the
same error
On Tue, Apr 15, 2014 at 1:19 PM, Mika Ristimaki <mi...@gmail.com>wrote:
> Only updating the reading part should be enough.
>
> -Mika
>
> On Apr 15, 2014, at 8:54 AM, amit nanda <am...@gmail.com> wrote:
>
> So do i need to update to 1.7.6 both while reading and writing, or only
> updating writing part is sufficient?
>
>
> On Mon, Apr 14, 2014 at 3:50 PM, Mika Ristimaki <mi...@gmail.com>wrote:
>
>> At least one issue related to reading data was fixed. Might be the one
>> that you are facing or it might not. But the first thing I would recommend
>> you to do is update the Avro lib.
>>
>> -Mika
>>
>> On Apr 14, 2014, at 11:59 AM, amit nanda <am...@gmail.com> wrote:
>>
>> So is the issue fixed in Avro-C 1.7.6
>>
>>
>> On Mon, Apr 14, 2014 at 4:32 AM, Mika Ristimaki <mika.ristimaki@gmail.com
>> > wrote:
>>
>>> Hi,
>>>
>>> Try first with Avro-C 1.7.6. There was at least one related bug fixed in
>>> that release.
>>>
>>> -Mika
>>>
>>> On Apr 14, 2014, at 11:28 AM, amit nanda <am...@gmail.com> wrote:
>>>
>>> > Hi,
>>> >
>>> > I am getting "Invalid sync!" error, while reading some of the while
>>> from HDFS. I can see there is already an jira ticket, but i am not sure is
>>> this is a problem is Hadoop core or Avro,
>>> > Meaning is this is problem while writing the write and some precaution
>>> needs to be taken at that time?
>>> >
>>> > I am using avro 1.7.5 C library.
>>> >
>>> >
>>> > Thanks
>>> > Amit
>>>
>>>
>>
>>
>
>
Re: Invalid sync! error
Posted by Mika Ristimaki <mi...@gmail.com>.
Only updating the reading part should be enough.
-Mika
On Apr 15, 2014, at 8:54 AM, amit nanda <am...@gmail.com> wrote:
> So do i need to update to 1.7.6 both while reading and writing, or only updating writing part is sufficient?
>
>
> On Mon, Apr 14, 2014 at 3:50 PM, Mika Ristimaki <mi...@gmail.com> wrote:
> At least one issue related to reading data was fixed. Might be the one that you are facing or it might not. But the first thing I would recommend you to do is update the Avro lib.
>
> -Mika
>
> On Apr 14, 2014, at 11:59 AM, amit nanda <am...@gmail.com> wrote:
>
>> So is the issue fixed in Avro-C 1.7.6
>>
>>
>> On Mon, Apr 14, 2014 at 4:32 AM, Mika Ristimaki <mi...@gmail.com> wrote:
>> Hi,
>>
>> Try first with Avro-C 1.7.6. There was at least one related bug fixed in that release.
>>
>> -Mika
>>
>> On Apr 14, 2014, at 11:28 AM, amit nanda <am...@gmail.com> wrote:
>>
>> > Hi,
>> >
>> > I am getting "Invalid sync!" error, while reading some of the while from HDFS. I can see there is already an jira ticket, but i am not sure is this is a problem is Hadoop core or Avro,
>> > Meaning is this is problem while writing the write and some precaution needs to be taken at that time?
>> >
>> > I am using avro 1.7.5 C library.
>> >
>> >
>> > Thanks
>> > Amit
>>
>>
>
>
Re: Invalid sync! error
Posted by Mika Ristimaki <mi...@gmail.com>.
Only updating the reading part should be enough.
-Mika
On Apr 15, 2014, at 8:54 AM, amit nanda <am...@gmail.com> wrote:
> So do i need to update to 1.7.6 both while reading and writing, or only updating writing part is sufficient?
>
>
> On Mon, Apr 14, 2014 at 3:50 PM, Mika Ristimaki <mi...@gmail.com> wrote:
> At least one issue related to reading data was fixed. Might be the one that you are facing or it might not. But the first thing I would recommend you to do is update the Avro lib.
>
> -Mika
>
> On Apr 14, 2014, at 11:59 AM, amit nanda <am...@gmail.com> wrote:
>
>> So is the issue fixed in Avro-C 1.7.6
>>
>>
>> On Mon, Apr 14, 2014 at 4:32 AM, Mika Ristimaki <mi...@gmail.com> wrote:
>> Hi,
>>
>> Try first with Avro-C 1.7.6. There was at least one related bug fixed in that release.
>>
>> -Mika
>>
>> On Apr 14, 2014, at 11:28 AM, amit nanda <am...@gmail.com> wrote:
>>
>> > Hi,
>> >
>> > I am getting "Invalid sync!" error, while reading some of the while from HDFS. I can see there is already an jira ticket, but i am not sure is this is a problem is Hadoop core or Avro,
>> > Meaning is this is problem while writing the write and some precaution needs to be taken at that time?
>> >
>> > I am using avro 1.7.5 C library.
>> >
>> >
>> > Thanks
>> > Amit
>>
>>
>
>
Re: Invalid sync! error
Posted by amit nanda <am...@gmail.com>.
So do i need to update to 1.7.6 both while reading and writing, or only
updating writing part is sufficient?
On Mon, Apr 14, 2014 at 3:50 PM, Mika Ristimaki <mi...@gmail.com>wrote:
> At least one issue related to reading data was fixed. Might be the one
> that you are facing or it might not. But the first thing I would recommend
> you to do is update the Avro lib.
>
> -Mika
>
> On Apr 14, 2014, at 11:59 AM, amit nanda <am...@gmail.com> wrote:
>
> So is the issue fixed in Avro-C 1.7.6
>
>
> On Mon, Apr 14, 2014 at 4:32 AM, Mika Ristimaki <mi...@gmail.com>wrote:
>
>> Hi,
>>
>> Try first with Avro-C 1.7.6. There was at least one related bug fixed in
>> that release.
>>
>> -Mika
>>
>> On Apr 14, 2014, at 11:28 AM, amit nanda <am...@gmail.com> wrote:
>>
>> > Hi,
>> >
>> > I am getting "Invalid sync!" error, while reading some of the while
>> from HDFS. I can see there is already an jira ticket, but i am not sure is
>> this is a problem is Hadoop core or Avro,
>> > Meaning is this is problem while writing the write and some precaution
>> needs to be taken at that time?
>> >
>> > I am using avro 1.7.5 C library.
>> >
>> >
>> > Thanks
>> > Amit
>>
>>
>
>
Re: Invalid sync! error
Posted by amit nanda <am...@gmail.com>.
So do i need to update to 1.7.6 both while reading and writing, or only
updating writing part is sufficient?
On Mon, Apr 14, 2014 at 3:50 PM, Mika Ristimaki <mi...@gmail.com>wrote:
> At least one issue related to reading data was fixed. Might be the one
> that you are facing or it might not. But the first thing I would recommend
> you to do is update the Avro lib.
>
> -Mika
>
> On Apr 14, 2014, at 11:59 AM, amit nanda <am...@gmail.com> wrote:
>
> So is the issue fixed in Avro-C 1.7.6
>
>
> On Mon, Apr 14, 2014 at 4:32 AM, Mika Ristimaki <mi...@gmail.com>wrote:
>
>> Hi,
>>
>> Try first with Avro-C 1.7.6. There was at least one related bug fixed in
>> that release.
>>
>> -Mika
>>
>> On Apr 14, 2014, at 11:28 AM, amit nanda <am...@gmail.com> wrote:
>>
>> > Hi,
>> >
>> > I am getting "Invalid sync!" error, while reading some of the while
>> from HDFS. I can see there is already an jira ticket, but i am not sure is
>> this is a problem is Hadoop core or Avro,
>> > Meaning is this is problem while writing the write and some precaution
>> needs to be taken at that time?
>> >
>> > I am using avro 1.7.5 C library.
>> >
>> >
>> > Thanks
>> > Amit
>>
>>
>
>
Re: Invalid sync! error
Posted by Mika Ristimaki <mi...@gmail.com>.
At least one issue related to reading data was fixed. Might be the one that you are facing or it might not. But the first thing I would recommend you to do is update the Avro lib.
-Mika
On Apr 14, 2014, at 11:59 AM, amit nanda <am...@gmail.com> wrote:
> So is the issue fixed in Avro-C 1.7.6
>
>
> On Mon, Apr 14, 2014 at 4:32 AM, Mika Ristimaki <mi...@gmail.com> wrote:
> Hi,
>
> Try first with Avro-C 1.7.6. There was at least one related bug fixed in that release.
>
> -Mika
>
> On Apr 14, 2014, at 11:28 AM, amit nanda <am...@gmail.com> wrote:
>
> > Hi,
> >
> > I am getting "Invalid sync!" error, while reading some of the while from HDFS. I can see there is already an jira ticket, but i am not sure is this is a problem is Hadoop core or Avro,
> > Meaning is this is problem while writing the write and some precaution needs to be taken at that time?
> >
> > I am using avro 1.7.5 C library.
> >
> >
> > Thanks
> > Amit
>
>
Re: Invalid sync! error
Posted by Mika Ristimaki <mi...@gmail.com>.
At least one issue related to reading data was fixed. Might be the one that you are facing or it might not. But the first thing I would recommend you to do is update the Avro lib.
-Mika
On Apr 14, 2014, at 11:59 AM, amit nanda <am...@gmail.com> wrote:
> So is the issue fixed in Avro-C 1.7.6
>
>
> On Mon, Apr 14, 2014 at 4:32 AM, Mika Ristimaki <mi...@gmail.com> wrote:
> Hi,
>
> Try first with Avro-C 1.7.6. There was at least one related bug fixed in that release.
>
> -Mika
>
> On Apr 14, 2014, at 11:28 AM, amit nanda <am...@gmail.com> wrote:
>
> > Hi,
> >
> > I am getting "Invalid sync!" error, while reading some of the while from HDFS. I can see there is already an jira ticket, but i am not sure is this is a problem is Hadoop core or Avro,
> > Meaning is this is problem while writing the write and some precaution needs to be taken at that time?
> >
> > I am using avro 1.7.5 C library.
> >
> >
> > Thanks
> > Amit
>
>
Re: Invalid sync! error
Posted by amit nanda <am...@gmail.com>.
So is the issue fixed in Avro-C 1.7.6
On Mon, Apr 14, 2014 at 4:32 AM, Mika Ristimaki <mi...@gmail.com>wrote:
> Hi,
>
> Try first with Avro-C 1.7.6. There was at least one related bug fixed in
> that release.
>
> -Mika
>
> On Apr 14, 2014, at 11:28 AM, amit nanda <am...@gmail.com> wrote:
>
> > Hi,
> >
> > I am getting "Invalid sync!" error, while reading some of the while from
> HDFS. I can see there is already an jira ticket, but i am not sure is this
> is a problem is Hadoop core or Avro,
> > Meaning is this is problem while writing the write and some precaution
> needs to be taken at that time?
> >
> > I am using avro 1.7.5 C library.
> >
> >
> > Thanks
> > Amit
>
>
Re: Invalid sync! error
Posted by amit nanda <am...@gmail.com>.
So is the issue fixed in Avro-C 1.7.6
On Mon, Apr 14, 2014 at 4:32 AM, Mika Ristimaki <mi...@gmail.com>wrote:
> Hi,
>
> Try first with Avro-C 1.7.6. There was at least one related bug fixed in
> that release.
>
> -Mika
>
> On Apr 14, 2014, at 11:28 AM, amit nanda <am...@gmail.com> wrote:
>
> > Hi,
> >
> > I am getting "Invalid sync!" error, while reading some of the while from
> HDFS. I can see there is already an jira ticket, but i am not sure is this
> is a problem is Hadoop core or Avro,
> > Meaning is this is problem while writing the write and some precaution
> needs to be taken at that time?
> >
> > I am using avro 1.7.5 C library.
> >
> >
> > Thanks
> > Amit
>
>
Re: Invalid sync! error
Posted by Mika Ristimaki <mi...@gmail.com>.
Hi,
Try first with Avro-C 1.7.6. There was at least one related bug fixed in that release.
-Mika
On Apr 14, 2014, at 11:28 AM, amit nanda <am...@gmail.com> wrote:
> Hi,
>
> I am getting "Invalid sync!" error, while reading some of the while from HDFS. I can see there is already an jira ticket, but i am not sure is this is a problem is Hadoop core or Avro,
> Meaning is this is problem while writing the write and some precaution needs to be taken at that time?
>
> I am using avro 1.7.5 C library.
>
>
> Thanks
> Amit
Re: Invalid sync! error
Posted by Mika Ristimaki <mi...@gmail.com>.
Hi,
Try first with Avro-C 1.7.6. There was at least one related bug fixed in that release.
-Mika
On Apr 14, 2014, at 11:28 AM, amit nanda <am...@gmail.com> wrote:
> Hi,
>
> I am getting "Invalid sync!" error, while reading some of the while from HDFS. I can see there is already an jira ticket, but i am not sure is this is a problem is Hadoop core or Avro,
> Meaning is this is problem while writing the write and some precaution needs to be taken at that time?
>
> I am using avro 1.7.5 C library.
>
>
> Thanks
> Amit