Re: [DISCUSS] Drop Hadoop 2 support from Avro

[Ryan Skraba <ry...@skraba.com>]

I've created the JIRA https://issues.apache.org/jira/browse/AVRO-3565
to track this work for Avro 1.12.0

On Wed, Jun 22, 2022 at 9:15 PM Ryan Skraba <ry...@skraba.com> wrote:
>
> Thanks Oscar!
>
> I'm thinking that the _right_ thing to do for the concerned PRs is to
> merge the heavier reflection-based version and cherry-pick it to
> branch-1.11...
>
> ... and then drop it in favour of the clean cast-based version as we
> drop Hadoop 2 support for Avro 1.12.0.
>
> I'm super interested in the opinion of anyone still using older
> versions of Hadoop!
>
> All my best, Ryan
>
> On Fri, Jun 17, 2022 at 8:42 PM Oscar Westra van Holthe - Kind
> <os...@westravanholthe.nl> wrote:
> >
> > Hi all,
> >
> > Although Hadoop 2 is alive (version 2.10.2 was released on 31 May 2022 with
> > "211 bug fixes, improvements and enhancements since 2.10.1" [1]), versions
> > 2.9.x and older are EOL, as are version 3.0.x and 3.1.x [2].
> >
> > On Java support: Hadoop 2.10 supports both Java 7 & Java 8. Hadoop 3.3 and
> > later support both Java 8 & Java 11 [3]. This confirms what Steve pointed
> > out: Hadoop 2 does not support Java >8.
> >
> > Now Java 8 has reached EOL a few months ago (on 31 March 2022), though
> > it'll receive security updates until 31 March 2025 [4]. This proves Hadoop
> > 2 is a dead end, and fully obsolete in 2 years, 9 months.
> >
> > As a result, I'd be happy to drop support for Hadoop 2 from Avro in the
> > next major release.
> >
> > Kind regards,
> > Oscar
> >
> > [1] https://hadoop.apache.org/release/2.10.2.html
> > [2]
> > https://cwiki.apache.org/confluence/display/HADOOP/EOL+%28End-of-life%29+Release+Branches
> > [3] https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Java+Versions
> > [4] https://endoflife.date/java
> >
> >
> > On Fri, 17 Jun 2022 at 18:52, Ryan Skraba <ry...@skraba.com> wrote:
> >
> > > Hello!  There's some discussion on these two PRs:
> > >
> > > https://github.com/apache/avro/pull/1431
> > > https://github.com/apache/avro/pull/1618
> > >
> > > TL;DR: In order to support features present in Hadoop 3, we either
> > > need to detect the version of Hadoop by reflection, or stop supporting
> > > Hadoop 2.
> > >
> > > Steve has reported that Hadoop 2 is not likely to work with Java 8 and
> > > recent versions of Avro... Does anybody have any objections to
> > > removing Hadoop 2 support in the next major version?
> > >
> > > All my best, Ryan
> > >
> >
> >
> > --
> >
> > ✉️ Oscar Westra van Holthe - Kind <os...@westravanholthe.nl>