You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nifi.apache.org by Mike Thomsen <mi...@gmail.com> on 2020/10/14 14:35:35 UTC

Upgrading Avro

This PR only focuses on the standard services.
https://github.com/apache/nifi/pull/4601

Overall, LGTM, but I wanted to see if anyone is aware of any potential
issues here with a partial update. I'm using a mix of 1.10 and 1.8.2
with some custom code, and haven't run into issues, but wanted to
check before going deeper on this.

Thanks,

Mike

Re: Upgrading Avro

Posted by Matt Burgess <ma...@apache.org>.

Mike,

LGTM too, my only concerns at this point (I haven't tried them yet to
see if they are warranted) are:

1) https://issues.apache.org/jira/browse/AVRO-2278
(GenericRecord.get() now throws exception on missing field, used to
return null)
2) Snappy compatibility (can you take a Snappy-compressed Avro 1.8.1
file and read it with 1.10 and vice versa)
3) nifi-hadoop-libraries-nar version compatibility (do the processors
that use 1.8.1 from hadoop-libraries play nicely with the 1.10
reader/writers/etc)

Regards,
Matt

On Wed, Oct 14, 2020 at 10:36 AM Mike Thomsen <mi...@gmail.com> wrote:
>
> This PR only focuses on the standard services.
> https://github.com/apache/nifi/pull/4601
>
> Overall, LGTM, but I wanted to see if anyone is aware of any potential
> issues here with a partial update. I'm using a mix of 1.10 and 1.8.2
> with some custom code, and haven't run into issues, but wanted to
> check before going deeper on this.
>
> Thanks,
>
> Mike