You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Lukasz Cwik <lc...@google.com> on 2018/10/30 17:50:16 UTC
Re: Flink 1.6 Support
+dev <de...@beam.apache.org>
On Tue, Oct 30, 2018 at 10:30 AM Jins George <Ji...@aeris.net> wrote:
> Hi Community,
>
> Noticed that the Beam 2.8 release comes with flink 1.5.x dependency.
> Are there any plans to upgrade flink to 1.6.x in next beam release. (
> I am looking for the better k8s support in Flink 1.6)
>
> Thanks,
>
> Jins George
>
>
Re: Flink 1.6 Support
Posted by Jins George <Ji...@aeris.net>.
Thanks Max. That would help a lot. Manually creating the build with 1.6
will work for us in short term with development, but to go to production
it has to be an official release ( due to some regulations at my company)
Thanks,
Jins
On 10/31/18 3:15 AM, Maximilian Michels wrote:
> Hi Jins,
>
> As Thomas mentioned, the Flink Runner has already been prepared for
> Flink 1.6, you just have to change the Flink version in the Gradle
> build file.
>
> Of course this is not convenient because you can't fetch this version
> via Maven Central. So we're planning to release both versions:
>
> https://issues.apache.org/jira/browse/BEAM-5419
>
> Thanks,
> Max
>
> On 31.10.18 06:28, Jins George wrote:
>> Thank you Thomas. Idea of providing different build targets for
>> runners is great, as it enables users to pick from a list of runner
>> versions.
>>
>> Thanks
>>
>> Jins George
>>
>> On 10/30/18 12:36 PM, Thomas Weise wrote:
>>> There has not been any decision to move to 1.6.x for the next
>>> release yet.
>>>
>>> There has been related general discussion about upgrading runners
>>> recently [1]
>>>
>>> Overall we need to consider the support for newer Flink versions
>>> that users find (the Flink version in distributions and what users
>>> typically have in their deployment stacks). These upgrades are not
>>> automatic/cheap/fast, so there is a balance to strike.
>>>
>>> The good news is that with Beam 2.8.0 you should be able to make a
>>> build for 1.6.x with just a version number change [2] (Other compile
>>> differences have been cleaned up.)
>>>
>>> [1]
>>> https://lists.apache.org/thread.html/0588ed783767991aa36b00b8529bbd29b3a8958ee6e82fca83ac2938@%3Cdev.beam.apache.org%3E
>>> [2]
>>> https://github.com/apache/beam/blob/v2.8.0/runners/flink/build.gradle#L49
>>>
>>>
>>> On Tue, Oct 30, 2018 at 10:50 AM Lukasz Cwik <lcwik@google.com
>>> <ma...@google.com>> wrote:
>>>
>>> +dev <ma...@beam.apache.org>
>>>
>>> On Tue, Oct 30, 2018 at 10:30 AM Jins George
>>> <Jins.George@aeris.net <ma...@aeris.net>> wrote:
>>>
>>> Hi Community,
>>>
>>> Noticed that the Beam 2.8 release comes with flink 1.5.x
>>> dependency.
>>> Are there any plans to upgrade flink to 1.6.x in next beam
>>> release. (
>>> I am looking for the better k8s support in Flink 1.6)
>>>
>>> Thanks,
>>>
>>> Jins George
>>>
Re: Flink 1.6 Support
Posted by Jins George <Ji...@aeris.net>.
Thanks Max. That would help a lot. Manually creating the build with 1.6
will work for us in short term with development, but to go to production
it has to be an official release ( due to some regulations at my company)
Thanks,
Jins
On 10/31/18 3:15 AM, Maximilian Michels wrote:
> Hi Jins,
>
> As Thomas mentioned, the Flink Runner has already been prepared for
> Flink 1.6, you just have to change the Flink version in the Gradle
> build file.
>
> Of course this is not convenient because you can't fetch this version
> via Maven Central. So we're planning to release both versions:
>
> https://issues.apache.org/jira/browse/BEAM-5419
>
> Thanks,
> Max
>
> On 31.10.18 06:28, Jins George wrote:
>> Thank you Thomas. Idea of providing different build targets for
>> runners is great, as it enables users to pick from a list of runner
>> versions.
>>
>> Thanks
>>
>> Jins George
>>
>> On 10/30/18 12:36 PM, Thomas Weise wrote:
>>> There has not been any decision to move to 1.6.x for the next
>>> release yet.
>>>
>>> There has been related general discussion about upgrading runners
>>> recently [1]
>>>
>>> Overall we need to consider the support for newer Flink versions
>>> that users find (the Flink version in distributions and what users
>>> typically have in their deployment stacks). These upgrades are not
>>> automatic/cheap/fast, so there is a balance to strike.
>>>
>>> The good news is that with Beam 2.8.0 you should be able to make a
>>> build for 1.6.x with just a version number change [2] (Other compile
>>> differences have been cleaned up.)
>>>
>>> [1]
>>> https://lists.apache.org/thread.html/0588ed783767991aa36b00b8529bbd29b3a8958ee6e82fca83ac2938@%3Cdev.beam.apache.org%3E
>>> [2]
>>> https://github.com/apache/beam/blob/v2.8.0/runners/flink/build.gradle#L49
>>>
>>>
>>> On Tue, Oct 30, 2018 at 10:50 AM Lukasz Cwik <lcwik@google.com
>>> <ma...@google.com>> wrote:
>>>
>>> +dev <ma...@beam.apache.org>
>>>
>>> On Tue, Oct 30, 2018 at 10:30 AM Jins George
>>> <Jins.George@aeris.net <ma...@aeris.net>> wrote:
>>>
>>> Hi Community,
>>>
>>> Noticed that the Beam 2.8 release comes with flink 1.5.x
>>> dependency.
>>> Are there any plans to upgrade flink to 1.6.x in next beam
>>> release. (
>>> I am looking for the better k8s support in Flink 1.6)
>>>
>>> Thanks,
>>>
>>> Jins George
>>>
Re: Flink 1.6 Support
Posted by Maximilian Michels <mx...@apache.org>.
Hi Jins,
As Thomas mentioned, the Flink Runner has already been prepared for
Flink 1.6, you just have to change the Flink version in the Gradle build
file.
Of course this is not convenient because you can't fetch this version
via Maven Central. So we're planning to release both versions:
https://issues.apache.org/jira/browse/BEAM-5419
Thanks,
Max
On 31.10.18 06:28, Jins George wrote:
> Thank you Thomas. Idea of providing different build targets for
> runners is great, as it enables users to pick from a list of runner
> versions.
>
> Thanks
>
> Jins George
>
> On 10/30/18 12:36 PM, Thomas Weise wrote:
>> There has not been any decision to move to 1.6.x for the next release
>> yet.
>>
>> There has been related general discussion about upgrading runners
>> recently [1]
>>
>> Overall we need to consider the support for newer Flink versions that
>> users find (the Flink version in distributions and what users
>> typically have in their deployment stacks). These upgrades are not
>> automatic/cheap/fast, so there is a balance to strike.
>>
>> The good news is that with Beam 2.8.0 you should be able to make a
>> build for 1.6.x with just a version number change [2] (Other compile
>> differences have been cleaned up.)
>>
>> [1]
>> https://lists.apache.org/thread.html/0588ed783767991aa36b00b8529bbd29b3a8958ee6e82fca83ac2938@%3Cdev.beam.apache.org%3E
>> [2]
>> https://github.com/apache/beam/blob/v2.8.0/runners/flink/build.gradle#L49
>>
>>
>> On Tue, Oct 30, 2018 at 10:50 AM Lukasz Cwik <lcwik@google.com
>> <ma...@google.com>> wrote:
>>
>> +dev <ma...@beam.apache.org>
>>
>> On Tue, Oct 30, 2018 at 10:30 AM Jins George
>> <Jins.George@aeris.net <ma...@aeris.net>> wrote:
>>
>> Hi Community,
>>
>> Noticed that the Beam 2.8 release comes with flink 1.5.x
>> dependency.
>> Are there any plans to upgrade flink to 1.6.x in next beam
>> release. (
>> I am looking for the better k8s support in Flink 1.6)
>>
>> Thanks,
>>
>> Jins George
>>
Re: Flink 1.6 Support
Posted by Maximilian Michels <mx...@apache.org>.
Hi Jins,
As Thomas mentioned, the Flink Runner has already been prepared for
Flink 1.6, you just have to change the Flink version in the Gradle build
file.
Of course this is not convenient because you can't fetch this version
via Maven Central. So we're planning to release both versions:
https://issues.apache.org/jira/browse/BEAM-5419
Thanks,
Max
On 31.10.18 06:28, Jins George wrote:
> Thank you Thomas. Idea of providing different build targets for
> runners is great, as it enables users to pick from a list of runner
> versions.
>
> Thanks
>
> Jins George
>
> On 10/30/18 12:36 PM, Thomas Weise wrote:
>> There has not been any decision to move to 1.6.x for the next release
>> yet.
>>
>> There has been related general discussion about upgrading runners
>> recently [1]
>>
>> Overall we need to consider the support for newer Flink versions that
>> users find (the Flink version in distributions and what users
>> typically have in their deployment stacks). These upgrades are not
>> automatic/cheap/fast, so there is a balance to strike.
>>
>> The good news is that with Beam 2.8.0 you should be able to make a
>> build for 1.6.x with just a version number change [2] (Other compile
>> differences have been cleaned up.)
>>
>> [1]
>> https://lists.apache.org/thread.html/0588ed783767991aa36b00b8529bbd29b3a8958ee6e82fca83ac2938@%3Cdev.beam.apache.org%3E
>> [2]
>> https://github.com/apache/beam/blob/v2.8.0/runners/flink/build.gradle#L49
>>
>>
>> On Tue, Oct 30, 2018 at 10:50 AM Lukasz Cwik <lcwik@google.com
>> <ma...@google.com>> wrote:
>>
>> +dev <ma...@beam.apache.org>
>>
>> On Tue, Oct 30, 2018 at 10:30 AM Jins George
>> <Jins.George@aeris.net <ma...@aeris.net>> wrote:
>>
>> Hi Community,
>>
>> Noticed that the Beam 2.8 release comes with flink 1.5.x
>> dependency.
>> Are there any plans to upgrade flink to 1.6.x in next beam
>> release. (
>> I am looking for the better k8s support in Flink 1.6)
>>
>> Thanks,
>>
>> Jins George
>>
Re: Flink 1.6 Support
Posted by Jins George <Ji...@aeris.net>.
Thank you Thomas. Idea of providing different build targets for runners is great, as it enables users to pick from a list of runner versions.
Thanks
Jins George
On 10/30/18 12:36 PM, Thomas Weise wrote:
There has not been any decision to move to 1.6.x for the next release yet.
There has been related general discussion about upgrading runners recently [1]
Overall we need to consider the support for newer Flink versions that users find (the Flink version in distributions and what users typically have in their deployment stacks). These upgrades are not automatic/cheap/fast, so there is a balance to strike.
The good news is that with Beam 2.8.0 you should be able to make a build for 1.6.x with just a version number change [2] (Other compile differences have been cleaned up.)
[1] https://lists.apache.org/thread.html/0588ed783767991aa36b00b8529bbd29b3a8958ee6e82fca83ac2938@%3Cdev.beam.apache.org%3E
[2] https://github.com/apache/beam/blob/v2.8.0/runners/flink/build.gradle#L49
On Tue, Oct 30, 2018 at 10:50 AM Lukasz Cwik <lc...@google.com>> wrote:
+dev<ma...@beam.apache.org>
On Tue, Oct 30, 2018 at 10:30 AM Jins George <Ji...@aeris.net>> wrote:
Hi Community,
Noticed that the Beam 2.8 release comes with flink 1.5.x dependency.
Are there any plans to upgrade flink to 1.6.x in next beam release. (
I am looking for the better k8s support in Flink 1.6)
Thanks,
Jins George
Re: Flink 1.6 Support
Posted by Jins George <Ji...@aeris.net>.
Thank you Thomas. Idea of providing different build targets for runners is great, as it enables users to pick from a list of runner versions.
Thanks
Jins George
On 10/30/18 12:36 PM, Thomas Weise wrote:
There has not been any decision to move to 1.6.x for the next release yet.
There has been related general discussion about upgrading runners recently [1]
Overall we need to consider the support for newer Flink versions that users find (the Flink version in distributions and what users typically have in their deployment stacks). These upgrades are not automatic/cheap/fast, so there is a balance to strike.
The good news is that with Beam 2.8.0 you should be able to make a build for 1.6.x with just a version number change [2] (Other compile differences have been cleaned up.)
[1] https://lists.apache.org/thread.html/0588ed783767991aa36b00b8529bbd29b3a8958ee6e82fca83ac2938@%3Cdev.beam.apache.org%3E
[2] https://github.com/apache/beam/blob/v2.8.0/runners/flink/build.gradle#L49
On Tue, Oct 30, 2018 at 10:50 AM Lukasz Cwik <lc...@google.com>> wrote:
+dev<ma...@beam.apache.org>
On Tue, Oct 30, 2018 at 10:30 AM Jins George <Ji...@aeris.net>> wrote:
Hi Community,
Noticed that the Beam 2.8 release comes with flink 1.5.x dependency.
Are there any plans to upgrade flink to 1.6.x in next beam release. (
I am looking for the better k8s support in Flink 1.6)
Thanks,
Jins George
Re: Flink 1.6 Support
Posted by Thomas Weise <th...@apache.org>.
There has not been any decision to move to 1.6.x for the next release yet.
There has been related general discussion about upgrading runners recently
[1]
Overall we need to consider the support for newer Flink versions that users
find (the Flink version in distributions and what users typically have in
their deployment stacks). These upgrades are not automatic/cheap/fast, so
there is a balance to strike.
The good news is that with Beam 2.8.0 you should be able to make a build
for 1.6.x with just a version number change [2] (Other compile differences
have been cleaned up.)
[1]
https://lists.apache.org/thread.html/0588ed783767991aa36b00b8529bbd29b3a8958ee6e82fca83ac2938@%3Cdev.beam.apache.org%3E
[2]
https://github.com/apache/beam/blob/v2.8.0/runners/flink/build.gradle#L49
On Tue, Oct 30, 2018 at 10:50 AM Lukasz Cwik <lc...@google.com> wrote:
> +dev <de...@beam.apache.org>
>
> On Tue, Oct 30, 2018 at 10:30 AM Jins George <Ji...@aeris.net>
> wrote:
>
>> Hi Community,
>>
>> Noticed that the Beam 2.8 release comes with flink 1.5.x dependency.
>> Are there any plans to upgrade flink to 1.6.x in next beam release. (
>> I am looking for the better k8s support in Flink 1.6)
>>
>> Thanks,
>>
>> Jins George
>>
>>
Re: Flink 1.6 Support
Posted by Thomas Weise <th...@apache.org>.
There has not been any decision to move to 1.6.x for the next release yet.
There has been related general discussion about upgrading runners recently
[1]
Overall we need to consider the support for newer Flink versions that users
find (the Flink version in distributions and what users typically have in
their deployment stacks). These upgrades are not automatic/cheap/fast, so
there is a balance to strike.
The good news is that with Beam 2.8.0 you should be able to make a build
for 1.6.x with just a version number change [2] (Other compile differences
have been cleaned up.)
[1]
https://lists.apache.org/thread.html/0588ed783767991aa36b00b8529bbd29b3a8958ee6e82fca83ac2938@%3Cdev.beam.apache.org%3E
[2]
https://github.com/apache/beam/blob/v2.8.0/runners/flink/build.gradle#L49
On Tue, Oct 30, 2018 at 10:50 AM Lukasz Cwik <lc...@google.com> wrote:
> +dev <de...@beam.apache.org>
>
> On Tue, Oct 30, 2018 at 10:30 AM Jins George <Ji...@aeris.net>
> wrote:
>
>> Hi Community,
>>
>> Noticed that the Beam 2.8 release comes with flink 1.5.x dependency.
>> Are there any plans to upgrade flink to 1.6.x in next beam release. (
>> I am looking for the better k8s support in Flink 1.6)
>>
>> Thanks,
>>
>> Jins George
>>
>>