You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by Martijn Visser <ma...@ververica.com> on 2021/09/22 11:34:34 UTC
[DISCUSS] Releasing Flink 1.13.3
Hi all,
I would like to start discussing releasing Flink 1.13.3. There are
currently 138 tickets already resolved for 1.13.3, a few important fixes
are:
* https://issues.apache.org/jira/browse/FLINK-24347 (KafkaSource cannot
checkpoint if the parallelism is higher than the partition number)
* https://issues.apache.org/jira/browse/FLINK-24303 (SourceCoordinator
exception may fail Session Cluster)
* https://issues.apache.org/jira/browse/FLINK-24277 (Offset commit should
be disabled if consumer group ID is not specified in KafkaSource)
* https://issues.apache.org/jira/browse/FLINK-23802 (Reduce
ReadTimeoutExceptions for Kinesis Consumer)
There are currently 4 tickets with fix version 1.13.3 that are in progress:
* https://issues.apache.org/jira/browse/FLINK-24315 (Cannot rebuild watcher
thread while the K8S API server is unavailable)
* https://issues.apache.org/jira/browse/FLINK-23946 (Application mode fails
fatally when being shut down)
* https://issues.apache.org/jira/browse/FLINK-23519 (Aggregate State
Backend Latency by State Level)
* https://issues.apache.org/jira/browse/FLINK-21853 (Running HA per-job
cluster (rocks, non-incremental) end-to-end test could not finished in 900
seconds)
Can Yangze, David, Yun and Till give an update on the status for those?
Are there any other open tickets that we should wait for? Is there a PMC
member who would like to manage the release?
Best regards,
Martijn Visser | Product Manager
martijn@ververica.com
<https://www.ververica.com/>
Follow us @VervericaData
--
Join Flink Forward <https://flink-forward.org/> - The Apache Flink
Conference
Stream Processing | Event Driven | Real Time
Re: [DISCUSS] Releasing Flink 1.13.3
Posted by Leonard Xu <xb...@gmail.com>.
> Hi Leonard and Chesnay,
>
> Can we start with the preparation for the release and get a RC out? I did a
> quick check and there are no open blockers and 2 critical open items
Hi, Martijn
I agree that FLINK-23496 and FLINK-17914 are not the blockers for 1.13.3 release.
And I also checked the issues related to 1.13.3. there's no blocker issues and we can prepare the first RC.
Chesnay will kindly help prepare the release after a fast sync, If you need help during the release process, I will be very happy to help.
Best,
Leonard
> On Fri, 1 Oct 2021 at 08:35, Jark Wu <im...@gmail.com> wrote:
>
>> Thanks Leonard for volunteering to release 1.13.3.
>> I can also help from the PMC side if you need.
>>
>> Best,
>> Jark
>>
>> On Fri, 1 Oct 2021 at 10:32, Leonard Xu <xb...@gmail.com> wrote:
>>
>>>> From the SQL primary key issue side, all backports are merged. Feel
>> free
>>> to proceed with the release.
>>>
>>>
>>> The changelog ordering mechanism is pretty important for SQL users,
>> thanks
>>> Timo for the backports effort.
>>>
>>>>> I can help Leonard with the PMC bits for the 1.13.3 release.
>>>
>>> Thanks Chesnay for the help from PMC side.
>>> As the first week of October is a traditional holiday in China, many
>>> developers, committers, and PMCs from China are on vacation, which may
>>> result in not enough votes. I will start preparing for release first, and
>>> start voting after they back to office.
>>>
>>> Best,
>>> Leonard
>>>
>>>
>>>
>>>>> On 27/09/2021 21:26, Martijn Visser wrote:
>>>>>> Hi Timo,
>>>>>>
>>>>>> Sounds good to me.
>>>>>>
>>>>>> However, I still need a PMC to make to the release. I definitely
>>> volunteer
>>>>>> to help out with keeping track of things, communication etc.
>> Hopefully
>>>>>> there's a PMC who can help.
>>>>>>
>>>>>> Best regards,
>>>>>>
>>>>>> Martijn
>>>>>>
>>>>>> Op ma 27 sep. 2021 om 11:32 schreef Timo Walther <twalthr@apache.org
>>>
>>>>>>
>>>>>>> Hi Martijn,
>>>>>>>
>>>>>>> we are currently in the process of backporting a couple of PRs to
>> the
>>>>>>> 1.13 branch to fix the partially broken primary key support in Flink
>>>>>>> SQL. See FLINK-20374 for more information.
>>>>>>>
>>>>>>> I hope we can finalize this in one or two days. It should be
>> completed
>>>>>>> in 1.13.3 to avoid confusion for backported commits that would
>> spread
>>>>>>> multiple releases otherwise.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Timo
>>>>>>>
>>>>>>> On 24.09.21 07:44, Yun Tang wrote:
>>>>>>>> Hi Martijn,
>>>>>>>>
>>>>>>>> Thanks for your reminder of FLINK-23519[1], this ticket has been
>>> merged
>>>>>>> in release-1.13 before but not yet merged into release-1.14 as we
>>> have not
>>>>>>> release Flink-1.14.0 officially.
>>>>>>>> That's why the ticket is still in status IN-PROGRESS, and I think
>>> this
>>>>>>> would not block the release of flink-1.13.3.
>>>>>>>>
>>>>>>>> [1] https://issues.apache.org/jira/browse/FLINK-23519
>>>>>>>>
>>>>>>>> Best
>>>>>>>> Yun Tang
>>>>>>>> ________________________________
>>>>>>>> From: Leonard Xu <xb...@gmail.com>
>>>>>>>> Sent: Friday, September 24, 2021 10:22
>>>>>>>> To: +dev <de...@flink.apache.org>
>>>>>>>> Subject: Re: [DISCUSS] Releasing Flink 1.13.3
>>>>>>>>
>>>>>>>>
>>>>>>>>> My conclusion would be that there are no tickets open right now
>>> which
>>>>>>> would
>>>>>>>>> block a 1.13.3 release. I only need a PMC member who would like to
>>>>>>> manage
>>>>>>>>> the release. Anyone?
>>>>>>>> Hello, Matijn
>>>>>>>>
>>>>>>>> I am willing to help release 1.13.3 if possible, but maybe I need
>>> some
>>>>>>> assistance from PMC member.
>>>>>>>> Best,
>>>>>>>> Leonard
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>> Best regards,
>>>>>>>>>
>>>>>>>>> Martijn
>>>>>>>>>
>>>>>>>>> On Thu, 23 Sept 2021 at 15:29, Yang Wang <da...@gmail.com>
>>> wrote:
>>>>>>>>>
>>>>>>>>>> FYI: I have merged FLINK-24315[1].
>>>>>>>>>>
>>>>>>>>>> [1]. https://issues.apache.org/jira/browse/FLINK-24315
>>>>>>>>>>
>>>>>>>>>> Best,
>>>>>>>>>> Yang
>>>>>>>>>>
>>>>>>>>>> Yangze Guo <ka...@gmail.com> 于2021年9月23日周四 上午11:17写道：
>>>>>>>>>>
>>>>>>>>>>> Thanks for driving this discussion, Martijn. +1 for releasing
>>> Flink
>>>>>>>>>> 1.13.3.
>>>>>>>>>>> In addition to the issues already listed,
>>>>>>>>>>> https://issues.apache.org/jira/browse/FLINK-24005 is also an
>>>>>>> important
>>>>>>>>>>> fix.
>>>>>>>>>>>
>>>>>>>>>>> Regarding FLINK-24315, @Yang Wang will help with the review. It
>> is
>>>>>>>>>>> likely to be merged this week, if not, I don't think it should
>>> block
>>>>>>>>>>> the release.
>>>>>>>>>>>
>>>>>>>>>>> Best,
>>>>>>>>>>> Yangze Guo
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On Wed, Sep 22, 2021 at 8:44 PM Konstantin Knauf <
>>> knaufk@apache.org>
>>>>>>>>>>> wrote:
>>>>>>>>>>>> Hi Martijn,
>>>>>>>>>>>>
>>>>>>>>>>>> Thanks for starting the discussion. +1 for a soon Flink 1.13.3.
>>> IMHO
>>>>>>> we
>>>>>>>>>>>> don't need to block the release on FLINK-23519 (an
>> improvement),
>>>>>>>>>>>> FLINK-21853 (seems like a Minor issue with a test) or
>> FLINK-23946
>>>>>>>>>>> (depends
>>>>>>>>>>>> on https://issues.apache.org/jira/browse/FLINK-23946, which is
>>> not
>>>>>>>>>>> started
>>>>>>>>>>>> yet). This would leave FLINK-24315, which I can't judge at all.
>>>>>>>>>>>>
>>>>>>>>>>>> Cheers,
>>>>>>>>>>>>
>>>>>>>>>>>> Konstantin
>>>>>>>>>>>>
>>>>>>>>>>>> On Wed, Sep 22, 2021 at 1:34 PM Martijn Visser <
>>>>>>> martijn@ververica.com>
>>>>>>>>>>>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Hi all,
>>>>>>>>>>>>>
>>>>>>>>>>>>> I would like to start discussing releasing Flink 1.13.3. There
>>> are
>>>>>>>>>>>>> currently 138 tickets already resolved for 1.13.3, a few
>>> important
>>>>>>>>>>> fixes
>>>>>>>>>>>>> are:
>>>>>>>>>>>>>
>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24347
>>> (KafkaSource
>>>>>>>>>>> cannot
>>>>>>>>>>>>> checkpoint if the parallelism is higher than the partition
>>> number)
>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24303
>>>>>>>>>> (SourceCoordinator
>>>>>>>>>>>>> exception may fail Session Cluster)
>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24277 (Offset
>>> commit
>>>>>>>>>>> should
>>>>>>>>>>>>> be disabled if consumer group ID is not specified in
>>> KafkaSource)
>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23802 (Reduce
>>>>>>>>>>>>> ReadTimeoutExceptions for Kinesis Consumer)
>>>>>>>>>>>>>
>>>>>>>>>>>>> There are currently 4 tickets with fix version 1.13.3 that are
>>> in
>>>>>>>>>>> progress:
>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24315 (Cannot
>>> rebuild
>>>>>>>>>>>>> watcher
>>>>>>>>>>>>> thread while the K8S API server is unavailable)
>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23946
>>> (Application
>>>>>>>>>> mode
>>>>>>>>>>>>> fails
>>>>>>>>>>>>> fatally when being shut down)
>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23519
>> (Aggregate
>>>>>>> State
>>>>>>>>>>>>> Backend Latency by State Level)
>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-21853 (Running
>> HA
>>>>>>>>>>> per-job
>>>>>>>>>>>>> cluster (rocks, non-incremental) end-to-end test could not
>>> finished
>>>>>>>>>> in
>>>>>>>>>>> 900
>>>>>>>>>>>>> seconds)
>>>>>>>>>>>>>
>>>>>>>>>>>>> Can Yangze, David, Yun and Till give an update on the status
>> for
>>>>>>>>>> those?
>>>>>>>>>>>>> Are there any other open tickets that we should wait for? Is
>>> there a
>>>>>>>>>>> PMC
>>>>>>>>>>>>> member who would like to manage the release?
>>>>>>>>>>>>>
>>>>>>>>>>>>> Best regards,
>>>>>>>>>>>>>
>>>>>>>>>>>>> Martijn Visser | Product Manager
>>>>>>>>>>>>>
>>>>>>>>>>>>> martijn@ververica.com
>>>>>>>>>>>>>
>>>>>>>>>>>>> <https://www.ververica.com/>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> Follow us @VervericaData
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>>
>>>>>>>>>>>>> Join Flink Forward <https://flink-forward.org/> - The Apache
>>> Flink
>>>>>>>>>>>>> Conference
>>>>>>>>>>>>>
>>>>>>>>>>>>> Stream Processing | Event Driven | Real Time
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>>
>>>>>>>>>>>> Konstantin Knauf
>>>>>>>>>>>>
>>>>>>>>>>>> https://twitter.com/snntrable
>>>>>>>>>>>>
>>>>>>>>>>>> https://github.com/knaufk
>>>>>>>>
>>>>>>> --
>>>>>> Martijn Visser | Product Manager
>>>>>>
>>>>>> martijn@ververica.com
>>>>>>
>>>>>> <https://www.ververica.com/>
>>>>>>
>>>>>>
>>>>>> Follow us @VervericaData
>>>>>>
>>>>>> --
>>>>>>
>>>>>> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
>>>>>> Conference
>>>>>>
>>>>>> Stream Processing | Event Driven | Real Time
>>>>>>
>>>>
>>>
>>>
>>
Re: [DISCUSS] Releasing Flink 1.13.3
Posted by Martijn Visser <ma...@ververica.com>.
Hi Leonard and Chesnay,
Can we start with the preparation for the release and get a RC out? I did a
quick check and there are no open blockers and 2 critical open items:
* https://issues.apache.org/jira/browse/FLINK-23946 was already discussed
previously and depends on https://issues.apache.org/jira/browse/FLINK-24038
which hasn't started yet. We will leave this out of 1.13.3.
* https://issues.apache.org/jira/browse/FLINK-17914 is a test instability,
but there's already an approved PR for that so I think that would not be a
problem.
More than happy to help. Let me know what you think.
Best regards,
Martijn
On Fri, 1 Oct 2021 at 08:35, Jark Wu <im...@gmail.com> wrote:
> Thanks Leonard for volunteering to release 1.13.3.
> I can also help from the PMC side if you need.
>
> Best,
> Jark
>
> On Fri, 1 Oct 2021 at 10:32, Leonard Xu <xb...@gmail.com> wrote:
>
> > > From the SQL primary key issue side, all backports are merged. Feel
> free
> > to proceed with the release.
> >
> >
> > The changelog ordering mechanism is pretty important for SQL users,
> thanks
> > Timo for the backports effort.
> >
> > >> I can help Leonard with the PMC bits for the 1.13.3 release.
> >
> > Thanks Chesnay for the help from PMC side.
> > As the first week of October is a traditional holiday in China, many
> > developers, committers, and PMCs from China are on vacation, which may
> > result in not enough votes. I will start preparing for release first, and
> > start voting after they back to office.
> >
> > Best,
> > Leonard
> >
> >
> >
> > >> On 27/09/2021 21:26, Martijn Visser wrote:
> > >>> Hi Timo,
> > >>>
> > >>> Sounds good to me.
> > >>>
> > >>> However, I still need a PMC to make to the release. I definitely
> > volunteer
> > >>> to help out with keeping track of things, communication etc.
> Hopefully
> > >>> there's a PMC who can help.
> > >>>
> > >>> Best regards,
> > >>>
> > >>> Martijn
> > >>>
> > >>> Op ma 27 sep. 2021 om 11:32 schreef Timo Walther <twalthr@apache.org
> >
> > >>>
> > >>>> Hi Martijn,
> > >>>>
> > >>>> we are currently in the process of backporting a couple of PRs to
> the
> > >>>> 1.13 branch to fix the partially broken primary key support in Flink
> > >>>> SQL. See FLINK-20374 for more information.
> > >>>>
> > >>>> I hope we can finalize this in one or two days. It should be
> completed
> > >>>> in 1.13.3 to avoid confusion for backported commits that would
> spread
> > >>>> multiple releases otherwise.
> > >>>>
> > >>>> Thanks,
> > >>>> Timo
> > >>>>
> > >>>> On 24.09.21 07:44, Yun Tang wrote:
> > >>>>> Hi Martijn,
> > >>>>>
> > >>>>> Thanks for your reminder of FLINK-23519[1], this ticket has been
> > merged
> > >>>> in release-1.13 before but not yet merged into release-1.14 as we
> > have not
> > >>>> release Flink-1.14.0 officially.
> > >>>>> That's why the ticket is still in status IN-PROGRESS, and I think
> > this
> > >>>> would not block the release of flink-1.13.3.
> > >>>>>
> > >>>>> [1] https://issues.apache.org/jira/browse/FLINK-23519
> > >>>>>
> > >>>>> Best
> > >>>>> Yun Tang
> > >>>>> ________________________________
> > >>>>> From: Leonard Xu <xb...@gmail.com>
> > >>>>> Sent: Friday, September 24, 2021 10:22
> > >>>>> To: +dev <de...@flink.apache.org>
> > >>>>> Subject: Re: [DISCUSS] Releasing Flink 1.13.3
> > >>>>>
> > >>>>>
> > >>>>>> My conclusion would be that there are no tickets open right now
> > which
> > >>>> would
> > >>>>>> block a 1.13.3 release. I only need a PMC member who would like to
> > >>>> manage
> > >>>>>> the release. Anyone?
> > >>>>> Hello, Matijn
> > >>>>>
> > >>>>> I am willing to help release 1.13.3 if possible, but maybe I need
> > some
> > >>>> assistance from PMC member.
> > >>>>> Best,
> > >>>>> Leonard
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>>> Best regards,
> > >>>>>>
> > >>>>>> Martijn
> > >>>>>>
> > >>>>>> On Thu, 23 Sept 2021 at 15:29, Yang Wang <da...@gmail.com>
> > wrote:
> > >>>>>>
> > >>>>>>> FYI: I have merged FLINK-24315[1].
> > >>>>>>>
> > >>>>>>> [1]. https://issues.apache.org/jira/browse/FLINK-24315
> > >>>>>>>
> > >>>>>>> Best,
> > >>>>>>> Yang
> > >>>>>>>
> > >>>>>>> Yangze Guo <ka...@gmail.com> 于2021年9月23日周四 上午11:17写道：
> > >>>>>>>
> > >>>>>>>> Thanks for driving this discussion, Martijn. +1 for releasing
> > Flink
> > >>>>>>> 1.13.3.
> > >>>>>>>> In addition to the issues already listed,
> > >>>>>>>> https://issues.apache.org/jira/browse/FLINK-24005 is also an
> > >>>> important
> > >>>>>>>> fix.
> > >>>>>>>>
> > >>>>>>>> Regarding FLINK-24315, @Yang Wang will help with the review. It
> is
> > >>>>>>>> likely to be merged this week, if not, I don't think it should
> > block
> > >>>>>>>> the release.
> > >>>>>>>>
> > >>>>>>>> Best,
> > >>>>>>>> Yangze Guo
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>> On Wed, Sep 22, 2021 at 8:44 PM Konstantin Knauf <
> > knaufk@apache.org>
> > >>>>>>>> wrote:
> > >>>>>>>>> Hi Martijn,
> > >>>>>>>>>
> > >>>>>>>>> Thanks for starting the discussion. +1 for a soon Flink 1.13.3.
> > IMHO
> > >>>> we
> > >>>>>>>>> don't need to block the release on FLINK-23519 (an
> improvement),
> > >>>>>>>>> FLINK-21853 (seems like a Minor issue with a test) or
> FLINK-23946
> > >>>>>>>> (depends
> > >>>>>>>>> on https://issues.apache.org/jira/browse/FLINK-23946, which is
> > not
> > >>>>>>>> started
> > >>>>>>>>> yet). This would leave FLINK-24315, which I can't judge at all.
> > >>>>>>>>>
> > >>>>>>>>> Cheers,
> > >>>>>>>>>
> > >>>>>>>>> Konstantin
> > >>>>>>>>>
> > >>>>>>>>> On Wed, Sep 22, 2021 at 1:34 PM Martijn Visser <
> > >>>> martijn@ververica.com>
> > >>>>>>>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>>> Hi all,
> > >>>>>>>>>>
> > >>>>>>>>>> I would like to start discussing releasing Flink 1.13.3. There
> > are
> > >>>>>>>>>> currently 138 tickets already resolved for 1.13.3, a few
> > important
> > >>>>>>>> fixes
> > >>>>>>>>>> are:
> > >>>>>>>>>>
> > >>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24347
> > (KafkaSource
> > >>>>>>>> cannot
> > >>>>>>>>>> checkpoint if the parallelism is higher than the partition
> > number)
> > >>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24303
> > >>>>>>> (SourceCoordinator
> > >>>>>>>>>> exception may fail Session Cluster)
> > >>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24277 (Offset
> > commit
> > >>>>>>>> should
> > >>>>>>>>>> be disabled if consumer group ID is not specified in
> > KafkaSource)
> > >>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23802 (Reduce
> > >>>>>>>>>> ReadTimeoutExceptions for Kinesis Consumer)
> > >>>>>>>>>>
> > >>>>>>>>>> There are currently 4 tickets with fix version 1.13.3 that are
> > in
> > >>>>>>>> progress:
> > >>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24315 (Cannot
> > rebuild
> > >>>>>>>>>> watcher
> > >>>>>>>>>> thread while the K8S API server is unavailable)
> > >>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23946
> > (Application
> > >>>>>>> mode
> > >>>>>>>>>> fails
> > >>>>>>>>>> fatally when being shut down)
> > >>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23519
> (Aggregate
> > >>>> State
> > >>>>>>>>>> Backend Latency by State Level)
> > >>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-21853 (Running
> HA
> > >>>>>>>> per-job
> > >>>>>>>>>> cluster (rocks, non-incremental) end-to-end test could not
> > finished
> > >>>>>>> in
> > >>>>>>>> 900
> > >>>>>>>>>> seconds)
> > >>>>>>>>>>
> > >>>>>>>>>> Can Yangze, David, Yun and Till give an update on the status
> for
> > >>>>>>> those?
> > >>>>>>>>>> Are there any other open tickets that we should wait for? Is
> > there a
> > >>>>>>>> PMC
> > >>>>>>>>>> member who would like to manage the release?
> > >>>>>>>>>>
> > >>>>>>>>>> Best regards,
> > >>>>>>>>>>
> > >>>>>>>>>> Martijn Visser | Product Manager
> > >>>>>>>>>>
> > >>>>>>>>>> martijn@ververica.com
> > >>>>>>>>>>
> > >>>>>>>>>> <https://www.ververica.com/>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> Follow us @VervericaData
> > >>>>>>>>>>
> > >>>>>>>>>> --
> > >>>>>>>>>>
> > >>>>>>>>>> Join Flink Forward <https://flink-forward.org/> - The Apache
> > Flink
> > >>>>>>>>>> Conference
> > >>>>>>>>>>
> > >>>>>>>>>> Stream Processing | Event Driven | Real Time
> > >>>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --
> > >>>>>>>>>
> > >>>>>>>>> Konstantin Knauf
> > >>>>>>>>>
> > >>>>>>>>> https://twitter.com/snntrable
> > >>>>>>>>>
> > >>>>>>>>> https://github.com/knaufk
> > >>>>>
> > >>>> --
> > >>> Martijn Visser | Product Manager
> > >>>
> > >>> martijn@ververica.com
> > >>>
> > >>> <https://www.ververica.com/>
> > >>>
> > >>>
> > >>> Follow us @VervericaData
> > >>>
> > >>> --
> > >>>
> > >>> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
> > >>> Conference
> > >>>
> > >>> Stream Processing | Event Driven | Real Time
> > >>>
> > >
> >
> >
>
Re: [DISCUSS] Releasing Flink 1.13.3
Posted by Jark Wu <im...@gmail.com>.
Thanks Leonard for volunteering to release 1.13.3.
I can also help from the PMC side if you need.
Best,
Jark
On Fri, 1 Oct 2021 at 10:32, Leonard Xu <xb...@gmail.com> wrote:
> > From the SQL primary key issue side, all backports are merged. Feel free
> to proceed with the release.
>
>
> The changelog ordering mechanism is pretty important for SQL users, thanks
> Timo for the backports effort.
>
> >> I can help Leonard with the PMC bits for the 1.13.3 release.
>
> Thanks Chesnay for the help from PMC side.
> As the first week of October is a traditional holiday in China, many
> developers, committers, and PMCs from China are on vacation, which may
> result in not enough votes. I will start preparing for release first, and
> start voting after they back to office.
>
> Best,
> Leonard
>
>
>
> >> On 27/09/2021 21:26, Martijn Visser wrote:
> >>> Hi Timo,
> >>>
> >>> Sounds good to me.
> >>>
> >>> However, I still need a PMC to make to the release. I definitely
> volunteer
> >>> to help out with keeping track of things, communication etc. Hopefully
> >>> there's a PMC who can help.
> >>>
> >>> Best regards,
> >>>
> >>> Martijn
> >>>
> >>> Op ma 27 sep. 2021 om 11:32 schreef Timo Walther <tw...@apache.org>
> >>>
> >>>> Hi Martijn,
> >>>>
> >>>> we are currently in the process of backporting a couple of PRs to the
> >>>> 1.13 branch to fix the partially broken primary key support in Flink
> >>>> SQL. See FLINK-20374 for more information.
> >>>>
> >>>> I hope we can finalize this in one or two days. It should be completed
> >>>> in 1.13.3 to avoid confusion for backported commits that would spread
> >>>> multiple releases otherwise.
> >>>>
> >>>> Thanks,
> >>>> Timo
> >>>>
> >>>> On 24.09.21 07:44, Yun Tang wrote:
> >>>>> Hi Martijn,
> >>>>>
> >>>>> Thanks for your reminder of FLINK-23519[1], this ticket has been
> merged
> >>>> in release-1.13 before but not yet merged into release-1.14 as we
> have not
> >>>> release Flink-1.14.0 officially.
> >>>>> That's why the ticket is still in status IN-PROGRESS, and I think
> this
> >>>> would not block the release of flink-1.13.3.
> >>>>>
> >>>>> [1] https://issues.apache.org/jira/browse/FLINK-23519
> >>>>>
> >>>>> Best
> >>>>> Yun Tang
> >>>>> ________________________________
> >>>>> From: Leonard Xu <xb...@gmail.com>
> >>>>> Sent: Friday, September 24, 2021 10:22
> >>>>> To: +dev <de...@flink.apache.org>
> >>>>> Subject: Re: [DISCUSS] Releasing Flink 1.13.3
> >>>>>
> >>>>>
> >>>>>> My conclusion would be that there are no tickets open right now
> which
> >>>> would
> >>>>>> block a 1.13.3 release. I only need a PMC member who would like to
> >>>> manage
> >>>>>> the release. Anyone?
> >>>>> Hello, Matijn
> >>>>>
> >>>>> I am willing to help release 1.13.3 if possible, but maybe I need
> some
> >>>> assistance from PMC member.
> >>>>> Best,
> >>>>> Leonard
> >>>>>
> >>>>>
> >>>>>
> >>>>>> Best regards,
> >>>>>>
> >>>>>> Martijn
> >>>>>>
> >>>>>> On Thu, 23 Sept 2021 at 15:29, Yang Wang <da...@gmail.com>
> wrote:
> >>>>>>
> >>>>>>> FYI: I have merged FLINK-24315[1].
> >>>>>>>
> >>>>>>> [1]. https://issues.apache.org/jira/browse/FLINK-24315
> >>>>>>>
> >>>>>>> Best,
> >>>>>>> Yang
> >>>>>>>
> >>>>>>> Yangze Guo <ka...@gmail.com> 于2021年9月23日周四 上午11:17写道：
> >>>>>>>
> >>>>>>>> Thanks for driving this discussion, Martijn. +1 for releasing
> Flink
> >>>>>>> 1.13.3.
> >>>>>>>> In addition to the issues already listed,
> >>>>>>>> https://issues.apache.org/jira/browse/FLINK-24005 is also an
> >>>> important
> >>>>>>>> fix.
> >>>>>>>>
> >>>>>>>> Regarding FLINK-24315, @Yang Wang will help with the review. It is
> >>>>>>>> likely to be merged this week, if not, I don't think it should
> block
> >>>>>>>> the release.
> >>>>>>>>
> >>>>>>>> Best,
> >>>>>>>> Yangze Guo
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> On Wed, Sep 22, 2021 at 8:44 PM Konstantin Knauf <
> knaufk@apache.org>
> >>>>>>>> wrote:
> >>>>>>>>> Hi Martijn,
> >>>>>>>>>
> >>>>>>>>> Thanks for starting the discussion. +1 for a soon Flink 1.13.3.
> IMHO
> >>>> we
> >>>>>>>>> don't need to block the release on FLINK-23519 (an improvement),
> >>>>>>>>> FLINK-21853 (seems like a Minor issue with a test) or FLINK-23946
> >>>>>>>> (depends
> >>>>>>>>> on https://issues.apache.org/jira/browse/FLINK-23946, which is
> not
> >>>>>>>> started
> >>>>>>>>> yet). This would leave FLINK-24315, which I can't judge at all.
> >>>>>>>>>
> >>>>>>>>> Cheers,
> >>>>>>>>>
> >>>>>>>>> Konstantin
> >>>>>>>>>
> >>>>>>>>> On Wed, Sep 22, 2021 at 1:34 PM Martijn Visser <
> >>>> martijn@ververica.com>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> Hi all,
> >>>>>>>>>>
> >>>>>>>>>> I would like to start discussing releasing Flink 1.13.3. There
> are
> >>>>>>>>>> currently 138 tickets already resolved for 1.13.3, a few
> important
> >>>>>>>> fixes
> >>>>>>>>>> are:
> >>>>>>>>>>
> >>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24347
> (KafkaSource
> >>>>>>>> cannot
> >>>>>>>>>> checkpoint if the parallelism is higher than the partition
> number)
> >>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24303
> >>>>>>> (SourceCoordinator
> >>>>>>>>>> exception may fail Session Cluster)
> >>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24277 (Offset
> commit
> >>>>>>>> should
> >>>>>>>>>> be disabled if consumer group ID is not specified in
> KafkaSource)
> >>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23802 (Reduce
> >>>>>>>>>> ReadTimeoutExceptions for Kinesis Consumer)
> >>>>>>>>>>
> >>>>>>>>>> There are currently 4 tickets with fix version 1.13.3 that are
> in
> >>>>>>>> progress:
> >>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24315 (Cannot
> rebuild
> >>>>>>>>>> watcher
> >>>>>>>>>> thread while the K8S API server is unavailable)
> >>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23946
> (Application
> >>>>>>> mode
> >>>>>>>>>> fails
> >>>>>>>>>> fatally when being shut down)
> >>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23519 (Aggregate
> >>>> State
> >>>>>>>>>> Backend Latency by State Level)
> >>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-21853 (Running HA
> >>>>>>>> per-job
> >>>>>>>>>> cluster (rocks, non-incremental) end-to-end test could not
> finished
> >>>>>>> in
> >>>>>>>> 900
> >>>>>>>>>> seconds)
> >>>>>>>>>>
> >>>>>>>>>> Can Yangze, David, Yun and Till give an update on the status for
> >>>>>>> those?
> >>>>>>>>>> Are there any other open tickets that we should wait for? Is
> there a
> >>>>>>>> PMC
> >>>>>>>>>> member who would like to manage the release?
> >>>>>>>>>>
> >>>>>>>>>> Best regards,
> >>>>>>>>>>
> >>>>>>>>>> Martijn Visser | Product Manager
> >>>>>>>>>>
> >>>>>>>>>> martijn@ververica.com
> >>>>>>>>>>
> >>>>>>>>>> <https://www.ververica.com/>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> Follow us @VervericaData
> >>>>>>>>>>
> >>>>>>>>>> --
> >>>>>>>>>>
> >>>>>>>>>> Join Flink Forward <https://flink-forward.org/> - The Apache
> Flink
> >>>>>>>>>> Conference
> >>>>>>>>>>
> >>>>>>>>>> Stream Processing | Event Driven | Real Time
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --
> >>>>>>>>>
> >>>>>>>>> Konstantin Knauf
> >>>>>>>>>
> >>>>>>>>> https://twitter.com/snntrable
> >>>>>>>>>
> >>>>>>>>> https://github.com/knaufk
> >>>>>
> >>>> --
> >>> Martijn Visser | Product Manager
> >>>
> >>> martijn@ververica.com
> >>>
> >>> <https://www.ververica.com/>
> >>>
> >>>
> >>> Follow us @VervericaData
> >>>
> >>> --
> >>>
> >>> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
> >>> Conference
> >>>
> >>> Stream Processing | Event Driven | Real Time
> >>>
> >
>
>
Re: [DISCUSS] Releasing Flink 1.13.3
Posted by Leonard Xu <xb...@gmail.com>.
> From the SQL primary key issue side, all backports are merged. Feel free to proceed with the release.
The changelog ordering mechanism is pretty important for SQL users, thanks Timo for the backports effort.
>> I can help Leonard with the PMC bits for the 1.13.3 release.
Thanks Chesnay for the help from PMC side.
As the first week of October is a traditional holiday in China, many developers, committers, and PMCs from China are on vacation, which may result in not enough votes. I will start preparing for release first, and start voting after they back to office.
Best,
Leonard
>> On 27/09/2021 21:26, Martijn Visser wrote:
>>> Hi Timo,
>>>
>>> Sounds good to me.
>>>
>>> However, I still need a PMC to make to the release. I definitely volunteer
>>> to help out with keeping track of things, communication etc. Hopefully
>>> there's a PMC who can help.
>>>
>>> Best regards,
>>>
>>> Martijn
>>>
>>> Op ma 27 sep. 2021 om 11:32 schreef Timo Walther <tw...@apache.org>
>>>
>>>> Hi Martijn,
>>>>
>>>> we are currently in the process of backporting a couple of PRs to the
>>>> 1.13 branch to fix the partially broken primary key support in Flink
>>>> SQL. See FLINK-20374 for more information.
>>>>
>>>> I hope we can finalize this in one or two days. It should be completed
>>>> in 1.13.3 to avoid confusion for backported commits that would spread
>>>> multiple releases otherwise.
>>>>
>>>> Thanks,
>>>> Timo
>>>>
>>>> On 24.09.21 07:44, Yun Tang wrote:
>>>>> Hi Martijn,
>>>>>
>>>>> Thanks for your reminder of FLINK-23519[1], this ticket has been merged
>>>> in release-1.13 before but not yet merged into release-1.14 as we have not
>>>> release Flink-1.14.0 officially.
>>>>> That's why the ticket is still in status IN-PROGRESS, and I think this
>>>> would not block the release of flink-1.13.3.
>>>>>
>>>>> [1] https://issues.apache.org/jira/browse/FLINK-23519
>>>>>
>>>>> Best
>>>>> Yun Tang
>>>>> ________________________________
>>>>> From: Leonard Xu <xb...@gmail.com>
>>>>> Sent: Friday, September 24, 2021 10:22
>>>>> To: +dev <de...@flink.apache.org>
>>>>> Subject: Re: [DISCUSS] Releasing Flink 1.13.3
>>>>>
>>>>>
>>>>>> My conclusion would be that there are no tickets open right now which
>>>> would
>>>>>> block a 1.13.3 release. I only need a PMC member who would like to
>>>> manage
>>>>>> the release. Anyone?
>>>>> Hello, Matijn
>>>>>
>>>>> I am willing to help release 1.13.3 if possible, but maybe I need some
>>>> assistance from PMC member.
>>>>> Best,
>>>>> Leonard
>>>>>
>>>>>
>>>>>
>>>>>> Best regards,
>>>>>>
>>>>>> Martijn
>>>>>>
>>>>>> On Thu, 23 Sept 2021 at 15:29, Yang Wang <da...@gmail.com> wrote:
>>>>>>
>>>>>>> FYI: I have merged FLINK-24315[1].
>>>>>>>
>>>>>>> [1]. https://issues.apache.org/jira/browse/FLINK-24315
>>>>>>>
>>>>>>> Best,
>>>>>>> Yang
>>>>>>>
>>>>>>> Yangze Guo <ka...@gmail.com> 于2021年9月23日周四 上午11:17写道：
>>>>>>>
>>>>>>>> Thanks for driving this discussion, Martijn. +1 for releasing Flink
>>>>>>> 1.13.3.
>>>>>>>> In addition to the issues already listed,
>>>>>>>> https://issues.apache.org/jira/browse/FLINK-24005 is also an
>>>> important
>>>>>>>> fix.
>>>>>>>>
>>>>>>>> Regarding FLINK-24315, @Yang Wang will help with the review. It is
>>>>>>>> likely to be merged this week, if not, I don't think it should block
>>>>>>>> the release.
>>>>>>>>
>>>>>>>> Best,
>>>>>>>> Yangze Guo
>>>>>>>>
>>>>>>>>
>>>>>>>> On Wed, Sep 22, 2021 at 8:44 PM Konstantin Knauf <kn...@apache.org>
>>>>>>>> wrote:
>>>>>>>>> Hi Martijn,
>>>>>>>>>
>>>>>>>>> Thanks for starting the discussion. +1 for a soon Flink 1.13.3. IMHO
>>>> we
>>>>>>>>> don't need to block the release on FLINK-23519 (an improvement),
>>>>>>>>> FLINK-21853 (seems like a Minor issue with a test) or FLINK-23946
>>>>>>>> (depends
>>>>>>>>> on https://issues.apache.org/jira/browse/FLINK-23946, which is not
>>>>>>>> started
>>>>>>>>> yet). This would leave FLINK-24315, which I can't judge at all.
>>>>>>>>>
>>>>>>>>> Cheers,
>>>>>>>>>
>>>>>>>>> Konstantin
>>>>>>>>>
>>>>>>>>> On Wed, Sep 22, 2021 at 1:34 PM Martijn Visser <
>>>> martijn@ververica.com>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi all,
>>>>>>>>>>
>>>>>>>>>> I would like to start discussing releasing Flink 1.13.3. There are
>>>>>>>>>> currently 138 tickets already resolved for 1.13.3, a few important
>>>>>>>> fixes
>>>>>>>>>> are:
>>>>>>>>>>
>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24347 (KafkaSource
>>>>>>>> cannot
>>>>>>>>>> checkpoint if the parallelism is higher than the partition number)
>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24303
>>>>>>> (SourceCoordinator
>>>>>>>>>> exception may fail Session Cluster)
>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24277 (Offset commit
>>>>>>>> should
>>>>>>>>>> be disabled if consumer group ID is not specified in KafkaSource)
>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23802 (Reduce
>>>>>>>>>> ReadTimeoutExceptions for Kinesis Consumer)
>>>>>>>>>>
>>>>>>>>>> There are currently 4 tickets with fix version 1.13.3 that are in
>>>>>>>> progress:
>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24315 (Cannot rebuild
>>>>>>>>>> watcher
>>>>>>>>>> thread while the K8S API server is unavailable)
>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23946 (Application
>>>>>>> mode
>>>>>>>>>> fails
>>>>>>>>>> fatally when being shut down)
>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23519 (Aggregate
>>>> State
>>>>>>>>>> Backend Latency by State Level)
>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-21853 (Running HA
>>>>>>>> per-job
>>>>>>>>>> cluster (rocks, non-incremental) end-to-end test could not finished
>>>>>>> in
>>>>>>>> 900
>>>>>>>>>> seconds)
>>>>>>>>>>
>>>>>>>>>> Can Yangze, David, Yun and Till give an update on the status for
>>>>>>> those?
>>>>>>>>>> Are there any other open tickets that we should wait for? Is there a
>>>>>>>> PMC
>>>>>>>>>> member who would like to manage the release?
>>>>>>>>>>
>>>>>>>>>> Best regards,
>>>>>>>>>>
>>>>>>>>>> Martijn Visser | Product Manager
>>>>>>>>>>
>>>>>>>>>> martijn@ververica.com
>>>>>>>>>>
>>>>>>>>>> <https://www.ververica.com/>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Follow us @VervericaData
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>>
>>>>>>>>>> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
>>>>>>>>>> Conference
>>>>>>>>>>
>>>>>>>>>> Stream Processing | Event Driven | Real Time
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>>
>>>>>>>>> Konstantin Knauf
>>>>>>>>>
>>>>>>>>> https://twitter.com/snntrable
>>>>>>>>>
>>>>>>>>> https://github.com/knaufk
>>>>>
>>>> --
>>> Martijn Visser | Product Manager
>>>
>>> martijn@ververica.com
>>>
>>> <https://www.ververica.com/>
>>>
>>>
>>> Follow us @VervericaData
>>>
>>> --
>>>
>>> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
>>> Conference
>>>
>>> Stream Processing | Event Driven | Real Time
>>>
>
Re: [DISCUSS] Releasing Flink 1.13.3
Posted by Timo Walther <tw...@apache.org>.
Thanks Chesnay and Leonard for helping here.
From the SQL primary key issue side, all backports are merged. Feel
free to proceed with the release.
Regards,
Timo
On 30.09.21 11:29, Chesnay Schepler wrote:
> I can help Leonard with the PMC bits for the 1.13.3 release.
>
> On 27/09/2021 21:26, Martijn Visser wrote:
>> Hi Timo,
>>
>> Sounds good to me.
>>
>> However, I still need a PMC to make to the release. I definitely
>> volunteer
>> to help out with keeping track of things, communication etc. Hopefully
>> there's a PMC who can help.
>>
>> Best regards,
>>
>> Martijn
>>
>> Op ma 27 sep. 2021 om 11:32 schreef Timo Walther <tw...@apache.org>
>>
>>> Hi Martijn,
>>>
>>> we are currently in the process of backporting a couple of PRs to the
>>> 1.13 branch to fix the partially broken primary key support in Flink
>>> SQL. See FLINK-20374 for more information.
>>>
>>> I hope we can finalize this in one or two days. It should be completed
>>> in 1.13.3 to avoid confusion for backported commits that would spread
>>> multiple releases otherwise.
>>>
>>> Thanks,
>>> Timo
>>>
>>> On 24.09.21 07:44, Yun Tang wrote:
>>>> Hi Martijn,
>>>>
>>>> Thanks for your reminder of FLINK-23519[1], this ticket has been merged
>>> in release-1.13 before but not yet merged into release-1.14 as we
>>> have not
>>> release Flink-1.14.0 officially.
>>>> That's why the ticket is still in status IN-PROGRESS, and I think this
>>> would not block the release of flink-1.13.3.
>>>>
>>>> [1] https://issues.apache.org/jira/browse/FLINK-23519
>>>>
>>>> Best
>>>> Yun Tang
>>>> ________________________________
>>>> From: Leonard Xu <xb...@gmail.com>
>>>> Sent: Friday, September 24, 2021 10:22
>>>> To: +dev <de...@flink.apache.org>
>>>> Subject: Re: [DISCUSS] Releasing Flink 1.13.3
>>>>
>>>>
>>>>> My conclusion would be that there are no tickets open right now which
>>> would
>>>>> block a 1.13.3 release. I only need a PMC member who would like to
>>> manage
>>>>> the release. Anyone?
>>>> Hello, Matijn
>>>>
>>>> I am willing to help release 1.13.3 if possible, but maybe I need some
>>> assistance from PMC member.
>>>> Best,
>>>> Leonard
>>>>
>>>>
>>>>
>>>>> Best regards,
>>>>>
>>>>> Martijn
>>>>>
>>>>> On Thu, 23 Sept 2021 at 15:29, Yang Wang <da...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> FYI: I have merged FLINK-24315[1].
>>>>>>
>>>>>> [1]. https://issues.apache.org/jira/browse/FLINK-24315
>>>>>>
>>>>>> Best,
>>>>>> Yang
>>>>>>
>>>>>> Yangze Guo <ka...@gmail.com> 于2021年9月23日周四 上午11:17写道：
>>>>>>
>>>>>>> Thanks for driving this discussion, Martijn. +1 for releasing Flink
>>>>>> 1.13.3.
>>>>>>> In addition to the issues already listed,
>>>>>>> https://issues.apache.org/jira/browse/FLINK-24005 is also an
>>> important
>>>>>>> fix.
>>>>>>>
>>>>>>> Regarding FLINK-24315, @Yang Wang will help with the review. It is
>>>>>>> likely to be merged this week, if not, I don't think it should block
>>>>>>> the release.
>>>>>>>
>>>>>>> Best,
>>>>>>> Yangze Guo
>>>>>>>
>>>>>>>
>>>>>>> On Wed, Sep 22, 2021 at 8:44 PM Konstantin Knauf <kn...@apache.org>
>>>>>>> wrote:
>>>>>>>> Hi Martijn,
>>>>>>>>
>>>>>>>> Thanks for starting the discussion. +1 for a soon Flink 1.13.3.
>>>>>>>> IMHO
>>> we
>>>>>>>> don't need to block the release on FLINK-23519 (an improvement),
>>>>>>>> FLINK-21853 (seems like a Minor issue with a test) or FLINK-23946
>>>>>>> (depends
>>>>>>>> on https://issues.apache.org/jira/browse/FLINK-23946, which is not
>>>>>>> started
>>>>>>>> yet). This would leave FLINK-24315, which I can't judge at all.
>>>>>>>>
>>>>>>>> Cheers,
>>>>>>>>
>>>>>>>> Konstantin
>>>>>>>>
>>>>>>>> On Wed, Sep 22, 2021 at 1:34 PM Martijn Visser <
>>> martijn@ververica.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi all,
>>>>>>>>>
>>>>>>>>> I would like to start discussing releasing Flink 1.13.3. There are
>>>>>>>>> currently 138 tickets already resolved for 1.13.3, a few important
>>>>>>> fixes
>>>>>>>>> are:
>>>>>>>>>
>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24347 (KafkaSource
>>>>>>> cannot
>>>>>>>>> checkpoint if the parallelism is higher than the partition number)
>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24303
>>>>>> (SourceCoordinator
>>>>>>>>> exception may fail Session Cluster)
>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24277 (Offset commit
>>>>>>> should
>>>>>>>>> be disabled if consumer group ID is not specified in KafkaSource)
>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23802 (Reduce
>>>>>>>>> ReadTimeoutExceptions for Kinesis Consumer)
>>>>>>>>>
>>>>>>>>> There are currently 4 tickets with fix version 1.13.3 that are in
>>>>>>> progress:
>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24315 (Cannot
>>>>>>>>> rebuild
>>>>>>>>> watcher
>>>>>>>>> thread while the K8S API server is unavailable)
>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23946 (Application
>>>>>> mode
>>>>>>>>> fails
>>>>>>>>> fatally when being shut down)
>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23519 (Aggregate
>>> State
>>>>>>>>> Backend Latency by State Level)
>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-21853 (Running HA
>>>>>>> per-job
>>>>>>>>> cluster (rocks, non-incremental) end-to-end test could not
>>>>>>>>> finished
>>>>>> in
>>>>>>> 900
>>>>>>>>> seconds)
>>>>>>>>>
>>>>>>>>> Can Yangze, David, Yun and Till give an update on the status for
>>>>>> those?
>>>>>>>>> Are there any other open tickets that we should wait for? Is
>>>>>>>>> there a
>>>>>>> PMC
>>>>>>>>> member who would like to manage the release?
>>>>>>>>>
>>>>>>>>> Best regards,
>>>>>>>>>
>>>>>>>>> Martijn Visser | Product Manager
>>>>>>>>>
>>>>>>>>> martijn@ververica.com
>>>>>>>>>
>>>>>>>>> <https://www.ververica.com/>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Follow us @VervericaData
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>>
>>>>>>>>> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
>>>>>>>>> Conference
>>>>>>>>>
>>>>>>>>> Stream Processing | Event Driven | Real Time
>>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>>
>>>>>>>> Konstantin Knauf
>>>>>>>>
>>>>>>>> https://twitter.com/snntrable
>>>>>>>>
>>>>>>>> https://github.com/knaufk
>>>>
>>> --
>> Martijn Visser | Product Manager
>>
>> martijn@ververica.com
>>
>> <https://www.ververica.com/>
>>
>>
>> Follow us @VervericaData
>>
>> --
>>
>> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
>> Conference
>>
>> Stream Processing | Event Driven | Real Time
>>
>
Re: [DISCUSS] Releasing Flink 1.13.3
Posted by Chesnay Schepler <ch...@apache.org>.
I can help Leonard with the PMC bits for the 1.13.3 release.
On 27/09/2021 21:26, Martijn Visser wrote:
> Hi Timo,
>
> Sounds good to me.
>
> However, I still need a PMC to make to the release. I definitely volunteer
> to help out with keeping track of things, communication etc. Hopefully
> there's a PMC who can help.
>
> Best regards,
>
> Martijn
>
> Op ma 27 sep. 2021 om 11:32 schreef Timo Walther <tw...@apache.org>
>
>> Hi Martijn,
>>
>> we are currently in the process of backporting a couple of PRs to the
>> 1.13 branch to fix the partially broken primary key support in Flink
>> SQL. See FLINK-20374 for more information.
>>
>> I hope we can finalize this in one or two days. It should be completed
>> in 1.13.3 to avoid confusion for backported commits that would spread
>> multiple releases otherwise.
>>
>> Thanks,
>> Timo
>>
>> On 24.09.21 07:44, Yun Tang wrote:
>>> Hi Martijn,
>>>
>>> Thanks for your reminder of FLINK-23519[1], this ticket has been merged
>> in release-1.13 before but not yet merged into release-1.14 as we have not
>> release Flink-1.14.0 officially.
>>> That's why the ticket is still in status IN-PROGRESS, and I think this
>> would not block the release of flink-1.13.3.
>>>
>>> [1] https://issues.apache.org/jira/browse/FLINK-23519
>>>
>>> Best
>>> Yun Tang
>>> ________________________________
>>> From: Leonard Xu <xb...@gmail.com>
>>> Sent: Friday, September 24, 2021 10:22
>>> To: +dev <de...@flink.apache.org>
>>> Subject: Re: [DISCUSS] Releasing Flink 1.13.3
>>>
>>>
>>>> My conclusion would be that there are no tickets open right now which
>> would
>>>> block a 1.13.3 release. I only need a PMC member who would like to
>> manage
>>>> the release. Anyone?
>>> Hello, Matijn
>>>
>>> I am willing to help release 1.13.3 if possible, but maybe I need some
>> assistance from PMC member.
>>> Best,
>>> Leonard
>>>
>>>
>>>
>>>> Best regards,
>>>>
>>>> Martijn
>>>>
>>>> On Thu, 23 Sept 2021 at 15:29, Yang Wang <da...@gmail.com> wrote:
>>>>
>>>>> FYI: I have merged FLINK-24315[1].
>>>>>
>>>>> [1]. https://issues.apache.org/jira/browse/FLINK-24315
>>>>>
>>>>> Best,
>>>>> Yang
>>>>>
>>>>> Yangze Guo <ka...@gmail.com> 于2021年9月23日周四 上午11:17写道：
>>>>>
>>>>>> Thanks for driving this discussion, Martijn. +1 for releasing Flink
>>>>> 1.13.3.
>>>>>> In addition to the issues already listed,
>>>>>> https://issues.apache.org/jira/browse/FLINK-24005 is also an
>> important
>>>>>> fix.
>>>>>>
>>>>>> Regarding FLINK-24315, @Yang Wang will help with the review. It is
>>>>>> likely to be merged this week, if not, I don't think it should block
>>>>>> the release.
>>>>>>
>>>>>> Best,
>>>>>> Yangze Guo
>>>>>>
>>>>>>
>>>>>> On Wed, Sep 22, 2021 at 8:44 PM Konstantin Knauf <kn...@apache.org>
>>>>>> wrote:
>>>>>>> Hi Martijn,
>>>>>>>
>>>>>>> Thanks for starting the discussion. +1 for a soon Flink 1.13.3. IMHO
>> we
>>>>>>> don't need to block the release on FLINK-23519 (an improvement),
>>>>>>> FLINK-21853 (seems like a Minor issue with a test) or FLINK-23946
>>>>>> (depends
>>>>>>> on https://issues.apache.org/jira/browse/FLINK-23946, which is not
>>>>>> started
>>>>>>> yet). This would leave FLINK-24315, which I can't judge at all.
>>>>>>>
>>>>>>> Cheers,
>>>>>>>
>>>>>>> Konstantin
>>>>>>>
>>>>>>> On Wed, Sep 22, 2021 at 1:34 PM Martijn Visser <
>> martijn@ververica.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi all,
>>>>>>>>
>>>>>>>> I would like to start discussing releasing Flink 1.13.3. There are
>>>>>>>> currently 138 tickets already resolved for 1.13.3, a few important
>>>>>> fixes
>>>>>>>> are:
>>>>>>>>
>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24347 (KafkaSource
>>>>>> cannot
>>>>>>>> checkpoint if the parallelism is higher than the partition number)
>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24303
>>>>> (SourceCoordinator
>>>>>>>> exception may fail Session Cluster)
>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24277 (Offset commit
>>>>>> should
>>>>>>>> be disabled if consumer group ID is not specified in KafkaSource)
>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23802 (Reduce
>>>>>>>> ReadTimeoutExceptions for Kinesis Consumer)
>>>>>>>>
>>>>>>>> There are currently 4 tickets with fix version 1.13.3 that are in
>>>>>> progress:
>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24315 (Cannot rebuild
>>>>>>>> watcher
>>>>>>>> thread while the K8S API server is unavailable)
>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23946 (Application
>>>>> mode
>>>>>>>> fails
>>>>>>>> fatally when being shut down)
>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23519 (Aggregate
>> State
>>>>>>>> Backend Latency by State Level)
>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-21853 (Running HA
>>>>>> per-job
>>>>>>>> cluster (rocks, non-incremental) end-to-end test could not finished
>>>>> in
>>>>>> 900
>>>>>>>> seconds)
>>>>>>>>
>>>>>>>> Can Yangze, David, Yun and Till give an update on the status for
>>>>> those?
>>>>>>>> Are there any other open tickets that we should wait for? Is there a
>>>>>> PMC
>>>>>>>> member who would like to manage the release?
>>>>>>>>
>>>>>>>> Best regards,
>>>>>>>>
>>>>>>>> Martijn Visser | Product Manager
>>>>>>>>
>>>>>>>> martijn@ververica.com
>>>>>>>>
>>>>>>>> <https://www.ververica.com/>
>>>>>>>>
>>>>>>>>
>>>>>>>> Follow us @VervericaData
>>>>>>>>
>>>>>>>> --
>>>>>>>>
>>>>>>>> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
>>>>>>>> Conference
>>>>>>>>
>>>>>>>> Stream Processing | Event Driven | Real Time
>>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>>
>>>>>>> Konstantin Knauf
>>>>>>>
>>>>>>> https://twitter.com/snntrable
>>>>>>>
>>>>>>> https://github.com/knaufk
>>>
>> --
> Martijn Visser | Product Manager
>
> martijn@ververica.com
>
> <https://www.ververica.com/>
>
>
> Follow us @VervericaData
>
> --
>
> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
> Conference
>
> Stream Processing | Event Driven | Real Time
>
Re: [DISCUSS] Releasing Flink 1.13.3
Posted by Martijn Visser <ma...@ververica.com>.
Hi Timo,
Sounds good to me.
However, I still need a PMC to make to the release. I definitely volunteer
to help out with keeping track of things, communication etc. Hopefully
there's a PMC who can help.
Best regards,
Martijn
Op ma 27 sep. 2021 om 11:32 schreef Timo Walther <tw...@apache.org>
> Hi Martijn,
>
> we are currently in the process of backporting a couple of PRs to the
> 1.13 branch to fix the partially broken primary key support in Flink
> SQL. See FLINK-20374 for more information.
>
> I hope we can finalize this in one or two days. It should be completed
> in 1.13.3 to avoid confusion for backported commits that would spread
> multiple releases otherwise.
>
> Thanks,
> Timo
>
> On 24.09.21 07:44, Yun Tang wrote:
> > Hi Martijn,
> >
> > Thanks for your reminder of FLINK-23519[1], this ticket has been merged
> in release-1.13 before but not yet merged into release-1.14 as we have not
> release Flink-1.14.0 officially.
> > That's why the ticket is still in status IN-PROGRESS, and I think this
> would not block the release of flink-1.13.3.
> >
> >
> > [1] https://issues.apache.org/jira/browse/FLINK-23519
> >
> > Best
> > Yun Tang
> > ________________________________
> > From: Leonard Xu <xb...@gmail.com>
> > Sent: Friday, September 24, 2021 10:22
> > To: +dev <de...@flink.apache.org>
> > Subject: Re: [DISCUSS] Releasing Flink 1.13.3
> >
> >
> >> My conclusion would be that there are no tickets open right now which
> would
> >> block a 1.13.3 release. I only need a PMC member who would like to
> manage
> >> the release. Anyone?
> >
> > Hello, Matijn
> >
> > I am willing to help release 1.13.3 if possible, but maybe I need some
> assistance from PMC member.
> >
> > Best,
> > Leonard
> >
> >
> >
> >>
> >> Best regards,
> >>
> >> Martijn
> >>
> >> On Thu, 23 Sept 2021 at 15:29, Yang Wang <da...@gmail.com> wrote:
> >>
> >>> FYI: I have merged FLINK-24315[1].
> >>>
> >>> [1]. https://issues.apache.org/jira/browse/FLINK-24315
> >>>
> >>> Best,
> >>> Yang
> >>>
> >>> Yangze Guo <ka...@gmail.com> 于2021年9月23日周四 上午11:17写道：
> >>>
> >>>> Thanks for driving this discussion, Martijn. +1 for releasing Flink
> >>> 1.13.3.
> >>>> In addition to the issues already listed,
> >>>> https://issues.apache.org/jira/browse/FLINK-24005 is also an
> important
> >>>> fix.
> >>>>
> >>>> Regarding FLINK-24315, @Yang Wang will help with the review. It is
> >>>> likely to be merged this week, if not, I don't think it should block
> >>>> the release.
> >>>>
> >>>> Best,
> >>>> Yangze Guo
> >>>>
> >>>>
> >>>> On Wed, Sep 22, 2021 at 8:44 PM Konstantin Knauf <kn...@apache.org>
> >>>> wrote:
> >>>>>
> >>>>> Hi Martijn,
> >>>>>
> >>>>> Thanks for starting the discussion. +1 for a soon Flink 1.13.3. IMHO
> we
> >>>>> don't need to block the release on FLINK-23519 (an improvement),
> >>>>> FLINK-21853 (seems like a Minor issue with a test) or FLINK-23946
> >>>> (depends
> >>>>> on https://issues.apache.org/jira/browse/FLINK-23946, which is not
> >>>> started
> >>>>> yet). This would leave FLINK-24315, which I can't judge at all.
> >>>>>
> >>>>> Cheers,
> >>>>>
> >>>>> Konstantin
> >>>>>
> >>>>> On Wed, Sep 22, 2021 at 1:34 PM Martijn Visser <
> martijn@ververica.com>
> >>>>> wrote:
> >>>>>
> >>>>>> Hi all,
> >>>>>>
> >>>>>> I would like to start discussing releasing Flink 1.13.3. There are
> >>>>>> currently 138 tickets already resolved for 1.13.3, a few important
> >>>> fixes
> >>>>>> are:
> >>>>>>
> >>>>>> * https://issues.apache.org/jira/browse/FLINK-24347 (KafkaSource
> >>>> cannot
> >>>>>> checkpoint if the parallelism is higher than the partition number)
> >>>>>> * https://issues.apache.org/jira/browse/FLINK-24303
> >>> (SourceCoordinator
> >>>>>> exception may fail Session Cluster)
> >>>>>> * https://issues.apache.org/jira/browse/FLINK-24277 (Offset commit
> >>>> should
> >>>>>> be disabled if consumer group ID is not specified in KafkaSource)
> >>>>>> * https://issues.apache.org/jira/browse/FLINK-23802 (Reduce
> >>>>>> ReadTimeoutExceptions for Kinesis Consumer)
> >>>>>>
> >>>>>> There are currently 4 tickets with fix version 1.13.3 that are in
> >>>> progress:
> >>>>>>
> >>>>>> * https://issues.apache.org/jira/browse/FLINK-24315 (Cannot rebuild
> >>>>>> watcher
> >>>>>> thread while the K8S API server is unavailable)
> >>>>>> * https://issues.apache.org/jira/browse/FLINK-23946 (Application
> >>> mode
> >>>>>> fails
> >>>>>> fatally when being shut down)
> >>>>>> * https://issues.apache.org/jira/browse/FLINK-23519 (Aggregate
> State
> >>>>>> Backend Latency by State Level)
> >>>>>> * https://issues.apache.org/jira/browse/FLINK-21853 (Running HA
> >>>> per-job
> >>>>>> cluster (rocks, non-incremental) end-to-end test could not finished
> >>> in
> >>>> 900
> >>>>>> seconds)
> >>>>>>
> >>>>>> Can Yangze, David, Yun and Till give an update on the status for
> >>> those?
> >>>>>>
> >>>>>> Are there any other open tickets that we should wait for? Is there a
> >>>> PMC
> >>>>>> member who would like to manage the release?
> >>>>>>
> >>>>>> Best regards,
> >>>>>>
> >>>>>> Martijn Visser | Product Manager
> >>>>>>
> >>>>>> martijn@ververica.com
> >>>>>>
> >>>>>> <https://www.ververica.com/>
> >>>>>>
> >>>>>>
> >>>>>> Follow us @VervericaData
> >>>>>>
> >>>>>> --
> >>>>>>
> >>>>>> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
> >>>>>> Conference
> >>>>>>
> >>>>>> Stream Processing | Event Driven | Real Time
> >>>>>>
> >>>>>
> >>>>>
> >>>>> --
> >>>>>
> >>>>> Konstantin Knauf
> >>>>>
> >>>>> https://twitter.com/snntrable
> >>>>>
> >>>>> https://github.com/knaufk
> >>>>
> >>>
> >
> >
>
> --
Martijn Visser | Product Manager
martijn@ververica.com
<https://www.ververica.com/>
Follow us @VervericaData
--
Join Flink Forward <https://flink-forward.org/> - The Apache Flink
Conference
Stream Processing | Event Driven | Real Time
Re: [DISCUSS] Releasing Flink 1.13.3
Posted by Timo Walther <tw...@apache.org>.
Hi Martijn,
we are currently in the process of backporting a couple of PRs to the
1.13 branch to fix the partially broken primary key support in Flink
SQL. See FLINK-20374 for more information.
I hope we can finalize this in one or two days. It should be completed
in 1.13.3 to avoid confusion for backported commits that would spread
multiple releases otherwise.
Thanks,
Timo
On 24.09.21 07:44, Yun Tang wrote:
> Hi Martijn,
>
> Thanks for your reminder of FLINK-23519[1], this ticket has been merged in release-1.13 before but not yet merged into release-1.14 as we have not release Flink-1.14.0 officially.
> That's why the ticket is still in status IN-PROGRESS, and I think this would not block the release of flink-1.13.3.
>
>
> [1] https://issues.apache.org/jira/browse/FLINK-23519
>
> Best
> Yun Tang
> ________________________________
> From: Leonard Xu <xb...@gmail.com>
> Sent: Friday, September 24, 2021 10:22
> To: +dev <de...@flink.apache.org>
> Subject: Re: [DISCUSS] Releasing Flink 1.13.3
>
>
>> My conclusion would be that there are no tickets open right now which would
>> block a 1.13.3 release. I only need a PMC member who would like to manage
>> the release. Anyone?
>
> Hello, Matijn
>
> I am willing to help release 1.13.3 if possible, but maybe I need some assistance from PMC member.
>
> Best,
> Leonard
>
>
>
>>
>> Best regards,
>>
>> Martijn
>>
>> On Thu, 23 Sept 2021 at 15:29, Yang Wang <da...@gmail.com> wrote:
>>
>>> FYI: I have merged FLINK-24315[1].
>>>
>>> [1]. https://issues.apache.org/jira/browse/FLINK-24315
>>>
>>> Best,
>>> Yang
>>>
>>> Yangze Guo <ka...@gmail.com> 于2021年9月23日周四 上午11:17写道：
>>>
>>>> Thanks for driving this discussion, Martijn. +1 for releasing Flink
>>> 1.13.3.
>>>> In addition to the issues already listed,
>>>> https://issues.apache.org/jira/browse/FLINK-24005 is also an important
>>>> fix.
>>>>
>>>> Regarding FLINK-24315, @Yang Wang will help with the review. It is
>>>> likely to be merged this week, if not, I don't think it should block
>>>> the release.
>>>>
>>>> Best,
>>>> Yangze Guo
>>>>
>>>>
>>>> On Wed, Sep 22, 2021 at 8:44 PM Konstantin Knauf <kn...@apache.org>
>>>> wrote:
>>>>>
>>>>> Hi Martijn,
>>>>>
>>>>> Thanks for starting the discussion. +1 for a soon Flink 1.13.3. IMHO we
>>>>> don't need to block the release on FLINK-23519 (an improvement),
>>>>> FLINK-21853 (seems like a Minor issue with a test) or FLINK-23946
>>>> (depends
>>>>> on https://issues.apache.org/jira/browse/FLINK-23946, which is not
>>>> started
>>>>> yet). This would leave FLINK-24315, which I can't judge at all.
>>>>>
>>>>> Cheers,
>>>>>
>>>>> Konstantin
>>>>>
>>>>> On Wed, Sep 22, 2021 at 1:34 PM Martijn Visser <ma...@ververica.com>
>>>>> wrote:
>>>>>
>>>>>> Hi all,
>>>>>>
>>>>>> I would like to start discussing releasing Flink 1.13.3. There are
>>>>>> currently 138 tickets already resolved for 1.13.3, a few important
>>>> fixes
>>>>>> are:
>>>>>>
>>>>>> * https://issues.apache.org/jira/browse/FLINK-24347 (KafkaSource
>>>> cannot
>>>>>> checkpoint if the parallelism is higher than the partition number)
>>>>>> * https://issues.apache.org/jira/browse/FLINK-24303
>>> (SourceCoordinator
>>>>>> exception may fail Session Cluster)
>>>>>> * https://issues.apache.org/jira/browse/FLINK-24277 (Offset commit
>>>> should
>>>>>> be disabled if consumer group ID is not specified in KafkaSource)
>>>>>> * https://issues.apache.org/jira/browse/FLINK-23802 (Reduce
>>>>>> ReadTimeoutExceptions for Kinesis Consumer)
>>>>>>
>>>>>> There are currently 4 tickets with fix version 1.13.3 that are in
>>>> progress:
>>>>>>
>>>>>> * https://issues.apache.org/jira/browse/FLINK-24315 (Cannot rebuild
>>>>>> watcher
>>>>>> thread while the K8S API server is unavailable)
>>>>>> * https://issues.apache.org/jira/browse/FLINK-23946 (Application
>>> mode
>>>>>> fails
>>>>>> fatally when being shut down)
>>>>>> * https://issues.apache.org/jira/browse/FLINK-23519 (Aggregate State
>>>>>> Backend Latency by State Level)
>>>>>> * https://issues.apache.org/jira/browse/FLINK-21853 (Running HA
>>>> per-job
>>>>>> cluster (rocks, non-incremental) end-to-end test could not finished
>>> in
>>>> 900
>>>>>> seconds)
>>>>>>
>>>>>> Can Yangze, David, Yun and Till give an update on the status for
>>> those?
>>>>>>
>>>>>> Are there any other open tickets that we should wait for? Is there a
>>>> PMC
>>>>>> member who would like to manage the release?
>>>>>>
>>>>>> Best regards,
>>>>>>
>>>>>> Martijn Visser | Product Manager
>>>>>>
>>>>>> martijn@ververica.com
>>>>>>
>>>>>> <https://www.ververica.com/>
>>>>>>
>>>>>>
>>>>>> Follow us @VervericaData
>>>>>>
>>>>>> --
>>>>>>
>>>>>> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
>>>>>> Conference
>>>>>>
>>>>>> Stream Processing | Event Driven | Real Time
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> Konstantin Knauf
>>>>>
>>>>> https://twitter.com/snntrable
>>>>>
>>>>> https://github.com/knaufk
>>>>
>>>
>
>
Re: [DISCUSS] Releasing Flink 1.13.3
Posted by Yun Tang <my...@live.com>.
Hi Martijn,
Thanks for your reminder of FLINK-23519[1], this ticket has been merged in release-1.13 before but not yet merged into release-1.14 as we have not release Flink-1.14.0 officially.
That's why the ticket is still in status IN-PROGRESS, and I think this would not block the release of flink-1.13.3.
[1] https://issues.apache.org/jira/browse/FLINK-23519
Best
Yun Tang
________________________________
From: Leonard Xu <xb...@gmail.com>
Sent: Friday, September 24, 2021 10:22
To: +dev <de...@flink.apache.org>
Subject: Re: [DISCUSS] Releasing Flink 1.13.3
> My conclusion would be that there are no tickets open right now which would
> block a 1.13.3 release. I only need a PMC member who would like to manage
> the release. Anyone?
Hello, Matijn
I am willing to help release 1.13.3 if possible, but maybe I need some assistance from PMC member.
Best,
Leonard
>
> Best regards,
>
> Martijn
>
> On Thu, 23 Sept 2021 at 15:29, Yang Wang <da...@gmail.com> wrote:
>
>> FYI: I have merged FLINK-24315[1].
>>
>> [1]. https://issues.apache.org/jira/browse/FLINK-24315
>>
>> Best,
>> Yang
>>
>> Yangze Guo <ka...@gmail.com> 于2021年9月23日周四 上午11:17写道：
>>
>>> Thanks for driving this discussion, Martijn. +1 for releasing Flink
>> 1.13.3.
>>> In addition to the issues already listed,
>>> https://issues.apache.org/jira/browse/FLINK-24005 is also an important
>>> fix.
>>>
>>> Regarding FLINK-24315, @Yang Wang will help with the review. It is
>>> likely to be merged this week, if not, I don't think it should block
>>> the release.
>>>
>>> Best,
>>> Yangze Guo
>>>
>>>
>>> On Wed, Sep 22, 2021 at 8:44 PM Konstantin Knauf <kn...@apache.org>
>>> wrote:
>>>>
>>>> Hi Martijn,
>>>>
>>>> Thanks for starting the discussion. +1 for a soon Flink 1.13.3. IMHO we
>>>> don't need to block the release on FLINK-23519 (an improvement),
>>>> FLINK-21853 (seems like a Minor issue with a test) or FLINK-23946
>>> (depends
>>>> on https://issues.apache.org/jira/browse/FLINK-23946, which is not
>>> started
>>>> yet). This would leave FLINK-24315, which I can't judge at all.
>>>>
>>>> Cheers,
>>>>
>>>> Konstantin
>>>>
>>>> On Wed, Sep 22, 2021 at 1:34 PM Martijn Visser <ma...@ververica.com>
>>>> wrote:
>>>>
>>>>> Hi all,
>>>>>
>>>>> I would like to start discussing releasing Flink 1.13.3. There are
>>>>> currently 138 tickets already resolved for 1.13.3, a few important
>>> fixes
>>>>> are:
>>>>>
>>>>> * https://issues.apache.org/jira/browse/FLINK-24347 (KafkaSource
>>> cannot
>>>>> checkpoint if the parallelism is higher than the partition number)
>>>>> * https://issues.apache.org/jira/browse/FLINK-24303
>> (SourceCoordinator
>>>>> exception may fail Session Cluster)
>>>>> * https://issues.apache.org/jira/browse/FLINK-24277 (Offset commit
>>> should
>>>>> be disabled if consumer group ID is not specified in KafkaSource)
>>>>> * https://issues.apache.org/jira/browse/FLINK-23802 (Reduce
>>>>> ReadTimeoutExceptions for Kinesis Consumer)
>>>>>
>>>>> There are currently 4 tickets with fix version 1.13.3 that are in
>>> progress:
>>>>>
>>>>> * https://issues.apache.org/jira/browse/FLINK-24315 (Cannot rebuild
>>>>> watcher
>>>>> thread while the K8S API server is unavailable)
>>>>> * https://issues.apache.org/jira/browse/FLINK-23946 (Application
>> mode
>>>>> fails
>>>>> fatally when being shut down)
>>>>> * https://issues.apache.org/jira/browse/FLINK-23519 (Aggregate State
>>>>> Backend Latency by State Level)
>>>>> * https://issues.apache.org/jira/browse/FLINK-21853 (Running HA
>>> per-job
>>>>> cluster (rocks, non-incremental) end-to-end test could not finished
>> in
>>> 900
>>>>> seconds)
>>>>>
>>>>> Can Yangze, David, Yun and Till give an update on the status for
>> those?
>>>>>
>>>>> Are there any other open tickets that we should wait for? Is there a
>>> PMC
>>>>> member who would like to manage the release?
>>>>>
>>>>> Best regards,
>>>>>
>>>>> Martijn Visser | Product Manager
>>>>>
>>>>> martijn@ververica.com
>>>>>
>>>>> <https://www.ververica.com/>
>>>>>
>>>>>
>>>>> Follow us @VervericaData
>>>>>
>>>>> --
>>>>>
>>>>> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
>>>>> Conference
>>>>>
>>>>> Stream Processing | Event Driven | Real Time
>>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> Konstantin Knauf
>>>>
>>>> https://twitter.com/snntrable
>>>>
>>>> https://github.com/knaufk
>>>
>>
Re: [DISCUSS] Releasing Flink 1.13.3
Posted by Leonard Xu <xb...@gmail.com>.
> My conclusion would be that there are no tickets open right now which would
> block a 1.13.3 release. I only need a PMC member who would like to manage
> the release. Anyone?
Hello, Matijn
I am willing to help release 1.13.3 if possible, but maybe I need some assistance from PMC member.
Best,
Leonard
>
> Best regards,
>
> Martijn
>
> On Thu, 23 Sept 2021 at 15:29, Yang Wang <da...@gmail.com> wrote:
>
>> FYI: I have merged FLINK-24315[1].
>>
>> [1]. https://issues.apache.org/jira/browse/FLINK-24315
>>
>> Best,
>> Yang
>>
>> Yangze Guo <ka...@gmail.com> 于2021年9月23日周四 上午11:17写道：
>>
>>> Thanks for driving this discussion, Martijn. +1 for releasing Flink
>> 1.13.3.
>>> In addition to the issues already listed,
>>> https://issues.apache.org/jira/browse/FLINK-24005 is also an important
>>> fix.
>>>
>>> Regarding FLINK-24315, @Yang Wang will help with the review. It is
>>> likely to be merged this week, if not, I don't think it should block
>>> the release.
>>>
>>> Best,
>>> Yangze Guo
>>>
>>>
>>> On Wed, Sep 22, 2021 at 8:44 PM Konstantin Knauf <kn...@apache.org>
>>> wrote:
>>>>
>>>> Hi Martijn,
>>>>
>>>> Thanks for starting the discussion. +1 for a soon Flink 1.13.3. IMHO we
>>>> don't need to block the release on FLINK-23519 (an improvement),
>>>> FLINK-21853 (seems like a Minor issue with a test) or FLINK-23946
>>> (depends
>>>> on https://issues.apache.org/jira/browse/FLINK-23946, which is not
>>> started
>>>> yet). This would leave FLINK-24315, which I can't judge at all.
>>>>
>>>> Cheers,
>>>>
>>>> Konstantin
>>>>
>>>> On Wed, Sep 22, 2021 at 1:34 PM Martijn Visser <ma...@ververica.com>
>>>> wrote:
>>>>
>>>>> Hi all,
>>>>>
>>>>> I would like to start discussing releasing Flink 1.13.3. There are
>>>>> currently 138 tickets already resolved for 1.13.3, a few important
>>> fixes
>>>>> are:
>>>>>
>>>>> * https://issues.apache.org/jira/browse/FLINK-24347 (KafkaSource
>>> cannot
>>>>> checkpoint if the parallelism is higher than the partition number)
>>>>> * https://issues.apache.org/jira/browse/FLINK-24303
>> (SourceCoordinator
>>>>> exception may fail Session Cluster)
>>>>> * https://issues.apache.org/jira/browse/FLINK-24277 (Offset commit
>>> should
>>>>> be disabled if consumer group ID is not specified in KafkaSource)
>>>>> * https://issues.apache.org/jira/browse/FLINK-23802 (Reduce
>>>>> ReadTimeoutExceptions for Kinesis Consumer)
>>>>>
>>>>> There are currently 4 tickets with fix version 1.13.3 that are in
>>> progress:
>>>>>
>>>>> * https://issues.apache.org/jira/browse/FLINK-24315 (Cannot rebuild
>>>>> watcher
>>>>> thread while the K8S API server is unavailable)
>>>>> * https://issues.apache.org/jira/browse/FLINK-23946 (Application
>> mode
>>>>> fails
>>>>> fatally when being shut down)
>>>>> * https://issues.apache.org/jira/browse/FLINK-23519 (Aggregate State
>>>>> Backend Latency by State Level)
>>>>> * https://issues.apache.org/jira/browse/FLINK-21853 (Running HA
>>> per-job
>>>>> cluster (rocks, non-incremental) end-to-end test could not finished
>> in
>>> 900
>>>>> seconds)
>>>>>
>>>>> Can Yangze, David, Yun and Till give an update on the status for
>> those?
>>>>>
>>>>> Are there any other open tickets that we should wait for? Is there a
>>> PMC
>>>>> member who would like to manage the release?
>>>>>
>>>>> Best regards,
>>>>>
>>>>> Martijn Visser | Product Manager
>>>>>
>>>>> martijn@ververica.com
>>>>>
>>>>> <https://www.ververica.com/>
>>>>>
>>>>>
>>>>> Follow us @VervericaData
>>>>>
>>>>> --
>>>>>
>>>>> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
>>>>> Conference
>>>>>
>>>>> Stream Processing | Event Driven | Real Time
>>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> Konstantin Knauf
>>>>
>>>> https://twitter.com/snntrable
>>>>
>>>> https://github.com/knaufk
>>>
>>
Re: [DISCUSS] Releasing Flink 1.13.3
Posted by Martijn Visser <ma...@ververica.com>.
Hi all,
@Konstantin thanks for the extra information, I agree.
@Yangze thanks for mentioning that ticket, that's indeed also an important
fix.
@Yang thanks for the update and merging FLINK-24315.
My conclusion would be that there are no tickets open right now which would
block a 1.13.3 release. I only need a PMC member who would like to manage
the release. Anyone?
Best regards,
Martijn
On Thu, 23 Sept 2021 at 15:29, Yang Wang <da...@gmail.com> wrote:
> FYI: I have merged FLINK-24315[1].
>
> [1]. https://issues.apache.org/jira/browse/FLINK-24315
>
> Best,
> Yang
>
> Yangze Guo <ka...@gmail.com> 于2021年9月23日周四 上午11:17写道：
>
> > Thanks for driving this discussion, Martijn. +1 for releasing Flink
> 1.13.3.
> > In addition to the issues already listed,
> > https://issues.apache.org/jira/browse/FLINK-24005 is also an important
> > fix.
> >
> > Regarding FLINK-24315, @Yang Wang will help with the review. It is
> > likely to be merged this week, if not, I don't think it should block
> > the release.
> >
> > Best,
> > Yangze Guo
> >
> >
> > On Wed, Sep 22, 2021 at 8:44 PM Konstantin Knauf <kn...@apache.org>
> > wrote:
> > >
> > > Hi Martijn,
> > >
> > > Thanks for starting the discussion. +1 for a soon Flink 1.13.3. IMHO we
> > > don't need to block the release on FLINK-23519 (an improvement),
> > > FLINK-21853 (seems like a Minor issue with a test) or FLINK-23946
> > (depends
> > > on https://issues.apache.org/jira/browse/FLINK-23946, which is not
> > started
> > > yet). This would leave FLINK-24315, which I can't judge at all.
> > >
> > > Cheers,
> > >
> > > Konstantin
> > >
> > > On Wed, Sep 22, 2021 at 1:34 PM Martijn Visser <ma...@ververica.com>
> > > wrote:
> > >
> > > > Hi all,
> > > >
> > > > I would like to start discussing releasing Flink 1.13.3. There are
> > > > currently 138 tickets already resolved for 1.13.3, a few important
> > fixes
> > > > are:
> > > >
> > > > * https://issues.apache.org/jira/browse/FLINK-24347 (KafkaSource
> > cannot
> > > > checkpoint if the parallelism is higher than the partition number)
> > > > * https://issues.apache.org/jira/browse/FLINK-24303
> (SourceCoordinator
> > > > exception may fail Session Cluster)
> > > > * https://issues.apache.org/jira/browse/FLINK-24277 (Offset commit
> > should
> > > > be disabled if consumer group ID is not specified in KafkaSource)
> > > > * https://issues.apache.org/jira/browse/FLINK-23802 (Reduce
> > > > ReadTimeoutExceptions for Kinesis Consumer)
> > > >
> > > > There are currently 4 tickets with fix version 1.13.3 that are in
> > progress:
> > > >
> > > > * https://issues.apache.org/jira/browse/FLINK-24315 (Cannot rebuild
> > > > watcher
> > > > thread while the K8S API server is unavailable)
> > > > * https://issues.apache.org/jira/browse/FLINK-23946 (Application
> mode
> > > > fails
> > > > fatally when being shut down)
> > > > * https://issues.apache.org/jira/browse/FLINK-23519 (Aggregate State
> > > > Backend Latency by State Level)
> > > > * https://issues.apache.org/jira/browse/FLINK-21853 (Running HA
> > per-job
> > > > cluster (rocks, non-incremental) end-to-end test could not finished
> in
> > 900
> > > > seconds)
> > > >
> > > > Can Yangze, David, Yun and Till give an update on the status for
> those?
> > > >
> > > > Are there any other open tickets that we should wait for? Is there a
> > PMC
> > > > member who would like to manage the release?
> > > >
> > > > Best regards,
> > > >
> > > > Martijn Visser | Product Manager
> > > >
> > > > martijn@ververica.com
> > > >
> > > > <https://www.ververica.com/>
> > > >
> > > >
> > > > Follow us @VervericaData
> > > >
> > > > --
> > > >
> > > > Join Flink Forward <https://flink-forward.org/> - The Apache Flink
> > > > Conference
> > > >
> > > > Stream Processing | Event Driven | Real Time
> > > >
> > >
> > >
> > > --
> > >
> > > Konstantin Knauf
> > >
> > > https://twitter.com/snntrable
> > >
> > > https://github.com/knaufk
> >
>
Re: [DISCUSS] Releasing Flink 1.13.3
Posted by Yang Wang <da...@gmail.com>.
FYI: I have merged FLINK-24315[1].
[1]. https://issues.apache.org/jira/browse/FLINK-24315
Best,
Yang
Yangze Guo <ka...@gmail.com> 于2021年9月23日周四 上午11:17写道：
> Thanks for driving this discussion, Martijn. +1 for releasing Flink 1.13.3.
> In addition to the issues already listed,
> https://issues.apache.org/jira/browse/FLINK-24005 is also an important
> fix.
>
> Regarding FLINK-24315, @Yang Wang will help with the review. It is
> likely to be merged this week, if not, I don't think it should block
> the release.
>
> Best,
> Yangze Guo
>
>
> On Wed, Sep 22, 2021 at 8:44 PM Konstantin Knauf <kn...@apache.org>
> wrote:
> >
> > Hi Martijn,
> >
> > Thanks for starting the discussion. +1 for a soon Flink 1.13.3. IMHO we
> > don't need to block the release on FLINK-23519 (an improvement),
> > FLINK-21853 (seems like a Minor issue with a test) or FLINK-23946
> (depends
> > on https://issues.apache.org/jira/browse/FLINK-23946, which is not
> started
> > yet). This would leave FLINK-24315, which I can't judge at all.
> >
> > Cheers,
> >
> > Konstantin
> >
> > On Wed, Sep 22, 2021 at 1:34 PM Martijn Visser <ma...@ververica.com>
> > wrote:
> >
> > > Hi all,
> > >
> > > I would like to start discussing releasing Flink 1.13.3. There are
> > > currently 138 tickets already resolved for 1.13.3, a few important
> fixes
> > > are:
> > >
> > > * https://issues.apache.org/jira/browse/FLINK-24347 (KafkaSource
> cannot
> > > checkpoint if the parallelism is higher than the partition number)
> > > * https://issues.apache.org/jira/browse/FLINK-24303 (SourceCoordinator
> > > exception may fail Session Cluster)
> > > * https://issues.apache.org/jira/browse/FLINK-24277 (Offset commit
> should
> > > be disabled if consumer group ID is not specified in KafkaSource)
> > > * https://issues.apache.org/jira/browse/FLINK-23802 (Reduce
> > > ReadTimeoutExceptions for Kinesis Consumer)
> > >
> > > There are currently 4 tickets with fix version 1.13.3 that are in
> progress:
> > >
> > > * https://issues.apache.org/jira/browse/FLINK-24315 (Cannot rebuild
> > > watcher
> > > thread while the K8S API server is unavailable)
> > > * https://issues.apache.org/jira/browse/FLINK-23946 (Application mode
> > > fails
> > > fatally when being shut down)
> > > * https://issues.apache.org/jira/browse/FLINK-23519 (Aggregate State
> > > Backend Latency by State Level)
> > > * https://issues.apache.org/jira/browse/FLINK-21853 (Running HA
> per-job
> > > cluster (rocks, non-incremental) end-to-end test could not finished in
> 900
> > > seconds)
> > >
> > > Can Yangze, David, Yun and Till give an update on the status for those?
> > >
> > > Are there any other open tickets that we should wait for? Is there a
> PMC
> > > member who would like to manage the release?
> > >
> > > Best regards,
> > >
> > > Martijn Visser | Product Manager
> > >
> > > martijn@ververica.com
> > >
> > > <https://www.ververica.com/>
> > >
> > >
> > > Follow us @VervericaData
> > >
> > > --
> > >
> > > Join Flink Forward <https://flink-forward.org/> - The Apache Flink
> > > Conference
> > >
> > > Stream Processing | Event Driven | Real Time
> > >
> >
> >
> > --
> >
> > Konstantin Knauf
> >
> > https://twitter.com/snntrable
> >
> > https://github.com/knaufk
>
Re: [DISCUSS] Releasing Flink 1.13.3
Posted by Yangze Guo <ka...@gmail.com>.
Thanks for driving this discussion, Martijn. +1 for releasing Flink 1.13.3.
In addition to the issues already listed,
https://issues.apache.org/jira/browse/FLINK-24005 is also an important
fix.
Regarding FLINK-24315, @Yang Wang will help with the review. It is
likely to be merged this week, if not, I don't think it should block
the release.
Best,
Yangze Guo
On Wed, Sep 22, 2021 at 8:44 PM Konstantin Knauf <kn...@apache.org> wrote:
>
> Hi Martijn,
>
> Thanks for starting the discussion. +1 for a soon Flink 1.13.3. IMHO we
> don't need to block the release on FLINK-23519 (an improvement),
> FLINK-21853 (seems like a Minor issue with a test) or FLINK-23946 (depends
> on https://issues.apache.org/jira/browse/FLINK-23946, which is not started
> yet). This would leave FLINK-24315, which I can't judge at all.
>
> Cheers,
>
> Konstantin
>
> On Wed, Sep 22, 2021 at 1:34 PM Martijn Visser <ma...@ververica.com>
> wrote:
>
> > Hi all,
> >
> > I would like to start discussing releasing Flink 1.13.3. There are
> > currently 138 tickets already resolved for 1.13.3, a few important fixes
> > are:
> >
> > * https://issues.apache.org/jira/browse/FLINK-24347 (KafkaSource cannot
> > checkpoint if the parallelism is higher than the partition number)
> > * https://issues.apache.org/jira/browse/FLINK-24303 (SourceCoordinator
> > exception may fail Session Cluster)
> > * https://issues.apache.org/jira/browse/FLINK-24277 (Offset commit should
> > be disabled if consumer group ID is not specified in KafkaSource)
> > * https://issues.apache.org/jira/browse/FLINK-23802 (Reduce
> > ReadTimeoutExceptions for Kinesis Consumer)
> >
> > There are currently 4 tickets with fix version 1.13.3 that are in progress:
> >
> > * https://issues.apache.org/jira/browse/FLINK-24315 (Cannot rebuild
> > watcher
> > thread while the K8S API server is unavailable)
> > * https://issues.apache.org/jira/browse/FLINK-23946 (Application mode
> > fails
> > fatally when being shut down)
> > * https://issues.apache.org/jira/browse/FLINK-23519 (Aggregate State
> > Backend Latency by State Level)
> > * https://issues.apache.org/jira/browse/FLINK-21853 (Running HA per-job
> > cluster (rocks, non-incremental) end-to-end test could not finished in 900
> > seconds)
> >
> > Can Yangze, David, Yun and Till give an update on the status for those?
> >
> > Are there any other open tickets that we should wait for? Is there a PMC
> > member who would like to manage the release?
> >
> > Best regards,
> >
> > Martijn Visser | Product Manager
> >
> > martijn@ververica.com
> >
> > <https://www.ververica.com/>
> >
> >
> > Follow us @VervericaData
> >
> > --
> >
> > Join Flink Forward <https://flink-forward.org/> - The Apache Flink
> > Conference
> >
> > Stream Processing | Event Driven | Real Time
> >
>
>
> --
>
> Konstantin Knauf
>
> https://twitter.com/snntrable
>
> https://github.com/knaufk
Re: [DISCUSS] Releasing Flink 1.13.3
Posted by Konstantin Knauf <kn...@apache.org>.
Hi Martijn,
Thanks for starting the discussion. +1 for a soon Flink 1.13.3. IMHO we
don't need to block the release on FLINK-23519 (an improvement),
FLINK-21853 (seems like a Minor issue with a test) or FLINK-23946 (depends
on https://issues.apache.org/jira/browse/FLINK-23946, which is not started
yet). This would leave FLINK-24315, which I can't judge at all.
Cheers,
Konstantin
On Wed, Sep 22, 2021 at 1:34 PM Martijn Visser <ma...@ververica.com>
wrote:
> Hi all,
>
> I would like to start discussing releasing Flink 1.13.3. There are
> currently 138 tickets already resolved for 1.13.3, a few important fixes
> are:
>
> * https://issues.apache.org/jira/browse/FLINK-24347 (KafkaSource cannot
> checkpoint if the parallelism is higher than the partition number)
> * https://issues.apache.org/jira/browse/FLINK-24303 (SourceCoordinator
> exception may fail Session Cluster)
> * https://issues.apache.org/jira/browse/FLINK-24277 (Offset commit should
> be disabled if consumer group ID is not specified in KafkaSource)
> * https://issues.apache.org/jira/browse/FLINK-23802 (Reduce
> ReadTimeoutExceptions for Kinesis Consumer)
>
> There are currently 4 tickets with fix version 1.13.3 that are in progress:
>
> * https://issues.apache.org/jira/browse/FLINK-24315 (Cannot rebuild
> watcher
> thread while the K8S API server is unavailable)
> * https://issues.apache.org/jira/browse/FLINK-23946 (Application mode
> fails
> fatally when being shut down)
> * https://issues.apache.org/jira/browse/FLINK-23519 (Aggregate State
> Backend Latency by State Level)
> * https://issues.apache.org/jira/browse/FLINK-21853 (Running HA per-job
> cluster (rocks, non-incremental) end-to-end test could not finished in 900
> seconds)
>
> Can Yangze, David, Yun and Till give an update on the status for those?
>
> Are there any other open tickets that we should wait for? Is there a PMC
> member who would like to manage the release?
>
> Best regards,
>
> Martijn Visser | Product Manager
>
> martijn@ververica.com
>
> <https://www.ververica.com/>
>
>
> Follow us @VervericaData
>
> --
>
> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
> Conference
>
> Stream Processing | Event Driven | Real Time
>
--
Konstantin Knauf
https://twitter.com/snntrable
https://github.com/knaufk