You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@beam.apache.org by Piotr Szuberski <pi...@polidea.com> on 2020/11/18 10:54:04 UTC

[ANNOUNCEMENT] Support for Hadoop 3 confirmed

Starting with [1] all of the Beam modules except for Hive/HBase are confirmed to support Hadoop 3.

The change comes with 2.27.0 version.

[1] https://github.com/apache/beam/pull/13352

Re: [ANNOUNCEMENT] Support for Hadoop 3 confirmed

Posted by Ahmet Altay <al...@google.com>.

Awesome! Thank you Piotr!

On Tue, Nov 24, 2020 at 4:45 AM Piotr Szuberski <pi...@polidea.com>
wrote:

> > PS: What’s about Hive/HBase modules?
> >
>
> HCatalog doesn't want the tests to be passed with Hadoop3 - I tried to
> figure out why but I gave up.
>
> HBase - there is an effort to test Beam against HBase 1 and 2 and then the
> tests for Hadoop will be done as well.
>

Re: [ANNOUNCEMENT] Support for Hadoop 3 confirmed

Posted by Piotr Szuberski <pi...@polidea.com>.

> PS: What’s about Hive/HBase modules?
> 

HCatalog doesn't want the tests to be passed with Hadoop3 - I tried to figure out why but I gave up.

HBase - there is an effort to test Beam against HBase 1 and 2 and then the tests for Hadoop will be done as well.

Re: [ANNOUNCEMENT] Support for Hadoop 3 confirmed

Posted by Pablo Estrada <pa...@google.com>.

Very nice. Thanks Piotr!

On Wed, Nov 18, 2020 at 7:42 AM Alexey Romanenko <ar...@gmail.com>
wrote:

> This is very good improvement, thank you for working on this!
>
> PS: What’s about Hive/HBase modules?
>
> > On 18 Nov 2020, at 11:54, Piotr Szuberski <pi...@polidea.com>
> wrote:
> >
> > Starting with [1] all of the Beam modules except for Hive/HBase are
> confirmed to support Hadoop 3.
> >
> > The change comes with 2.27.0 version.
> >
> > [1] https://github.com/apache/beam/pull/13352
>
>

Re: [ANNOUNCEMENT] Support for Hadoop 3 confirmed

Posted by Alexey Romanenko <ar...@gmail.com>.

This is very good improvement, thank you for working on this!

PS: What’s about Hive/HBase modules?

> On 18 Nov 2020, at 11:54, Piotr Szuberski <pi...@polidea.com> wrote:
> 
> Starting with [1] all of the Beam modules except for Hive/HBase are confirmed to support Hadoop 3.
> 
> The change comes with 2.27.0 version.
> 
> [1] https://github.com/apache/beam/pull/13352