You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@beam.apache.org by Edgar H <ka...@gmail.com> on 2023/06/13 10:10:23 UTC

Is Flink >1.14 really supported by the runners?

Hi all,

I've been running Beam with Flink in 1.14 for quite some time now but just
seen in Maven that runners supporting 1.15 and 1.16 are available to use,
however no mention to them within the compatibility matrix.

Are they stable enough to be used?

And also, https://issues.apache.org/jira/browse/BEAM-14538 seeing this
issue and wondering, does Beam really need to support the operator usage or
is it something not related to?

Thanks!

Re: Is Flink >1.14 really supported by the runners?

Posted by Jan Lukavský <je...@seznam.cz>.
Probably better for dev@ <ma...@beam.apache.org> (added).

  Jan

On 6/13/23 12:43, Edgar H wrote:
> Got you, thanks!
>
> Are there any plans on supporting 1.17 anytime soon too?
>
> El mar, 13 jun 2023, 12:27, Jan Lukavský <je...@seznam.cz> escribió:
>
>     Hi Edgar,
>
>     the website seems to be mistakenly not updated when the support for
>     Flink versions was added. This should be fixed [1], the runner is
>     stable
>     on versions up to 1.16.
>
>     Regarding Flink Operator, I'm not 100% familiar with it, but given
>     that
>     Beam Pipeline is translated into standard Flink application, Beam
>     should
>     be able to run on the operator just like any other application.
>
>     Best,
>
>       Jan
>
>     [1] https://github.com/apache/beam/issues/27115
>
>     On 6/13/23 12:10, Edgar H wrote:
>     > Hi all,
>     >
>     > I've been running Beam with Flink in 1.14 for quite some time
>     now but
>     > just seen in Maven that runners supporting 1.15 and 1.16 are
>     available
>     > to use, however no mention to them within the compatibility matrix.
>     >
>     > Are they stable enough to be used?
>     >
>     > And also, https://issues.apache.org/jira/browse/BEAM-14538
>     seeing this
>     > issue and wondering, does Beam really need to support the operator
>     > usage or is it something not related to?
>     >
>     > Thanks!
>

Re: Is Flink >1.14 really supported by the runners?

Posted by Jan Lukavský <je...@seznam.cz>.
Probably better for dev@ <ma...@beam.apache.org> (added).

  Jan

On 6/13/23 12:43, Edgar H wrote:
> Got you, thanks!
>
> Are there any plans on supporting 1.17 anytime soon too?
>
> El mar, 13 jun 2023, 12:27, Jan Lukavský <je...@seznam.cz> escribió:
>
>     Hi Edgar,
>
>     the website seems to be mistakenly not updated when the support for
>     Flink versions was added. This should be fixed [1], the runner is
>     stable
>     on versions up to 1.16.
>
>     Regarding Flink Operator, I'm not 100% familiar with it, but given
>     that
>     Beam Pipeline is translated into standard Flink application, Beam
>     should
>     be able to run on the operator just like any other application.
>
>     Best,
>
>       Jan
>
>     [1] https://github.com/apache/beam/issues/27115
>
>     On 6/13/23 12:10, Edgar H wrote:
>     > Hi all,
>     >
>     > I've been running Beam with Flink in 1.14 for quite some time
>     now but
>     > just seen in Maven that runners supporting 1.15 and 1.16 are
>     available
>     > to use, however no mention to them within the compatibility matrix.
>     >
>     > Are they stable enough to be used?
>     >
>     > And also, https://issues.apache.org/jira/browse/BEAM-14538
>     seeing this
>     > issue and wondering, does Beam really need to support the operator
>     > usage or is it something not related to?
>     >
>     > Thanks!
>

Re: Is Flink >1.14 really supported by the runners?

Posted by Edgar H <ka...@gmail.com>.
Got you, thanks!

Are there any plans on supporting 1.17 anytime soon too?

El mar, 13 jun 2023, 12:27, Jan Lukavský <je...@seznam.cz> escribió:

> Hi Edgar,
>
> the website seems to be mistakenly not updated when the support for
> Flink versions was added. This should be fixed [1], the runner is stable
> on versions up to 1.16.
>
> Regarding Flink Operator, I'm not 100% familiar with it, but given that
> Beam Pipeline is translated into standard Flink application, Beam should
> be able to run on the operator just like any other application.
>
> Best,
>
>   Jan
>
> [1] https://github.com/apache/beam/issues/27115
>
> On 6/13/23 12:10, Edgar H wrote:
> > Hi all,
> >
> > I've been running Beam with Flink in 1.14 for quite some time now but
> > just seen in Maven that runners supporting 1.15 and 1.16 are available
> > to use, however no mention to them within the compatibility matrix.
> >
> > Are they stable enough to be used?
> >
> > And also, https://issues.apache.org/jira/browse/BEAM-14538 seeing this
> > issue and wondering, does Beam really need to support the operator
> > usage or is it something not related to?
> >
> > Thanks!
>

Re: Is Flink >1.14 really supported by the runners?

Posted by Jan Lukavský <je...@seznam.cz>.
Hi Edgar,

the website seems to be mistakenly not updated when the support for 
Flink versions was added. This should be fixed [1], the runner is stable 
on versions up to 1.16.

Regarding Flink Operator, I'm not 100% familiar with it, but given that 
Beam Pipeline is translated into standard Flink application, Beam should 
be able to run on the operator just like any other application.

Best,

  Jan

[1] https://github.com/apache/beam/issues/27115

On 6/13/23 12:10, Edgar H wrote:
> Hi all,
>
> I've been running Beam with Flink in 1.14 for quite some time now but 
> just seen in Maven that runners supporting 1.15 and 1.16 are available 
> to use, however no mention to them within the compatibility matrix.
>
> Are they stable enough to be used?
>
> And also, https://issues.apache.org/jira/browse/BEAM-14538 seeing this 
> issue and wondering, does Beam really need to support the operator 
> usage or is it something not related to?
>
> Thanks!