You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Lu Niu <qq...@gmail.com> on 2021/04/15 20:34:28 UTC

Iterate Operator Checkpoint Failure

Hi, Flink Users

When we migrate from flink 1.9.1 to flink 1.11, we notice job will always
fail on checkpoint if job uses Iterator Operator, no matter we use
unaligned checkpoint or not. Those jobs don't have checkpoint issues in
1.9. Is this a known issue? Thank you!

Best
Lu

Re: Iterate Operator Checkpoint Failure

Posted by Lu Niu <qq...@gmail.com>.

Hi, Fabian

Thanks for replying. I created this ticket. It contains how to reproduce it
using code in flink-example package:
https://issues.apache.org/jira/browse/FLINK-22326

Best
Lu

On Fri, Apr 16, 2021 at 1:25 AM Fabian Paul <fa...@data-artisans.com>
wrote:

> Hi Lu,
>
> Can you provide some more detailed logs of what happened during the
> checkpointing phase? If it is possible please enable debug logs enabled.
>
> It would be also great know whether you have implemented your own Iterator
> Operator or what kind of Flink program you are trying to execute.
>
> Best,
> Fabian
>
> CC user-list
>
> On 15. Apr 2021, at 22:34, Lu Niu <qq...@gmail.com> wrote:
>
> Hi, Flink Users
>
> When we migrate from flink 1.9.1 to flink 1.11, we notice job will always
> fail on checkpoint if job uses Iterator Operator, no matter we use
> unaligned checkpoint or not. Those jobs don't have checkpoint issues in
> 1.9. Is this a known issue? Thank you!
>
> Best
> Lu
>
>
>

Re: Iterate Operator Checkpoint Failure

Posted by Fabian Paul <fa...@data-artisans.com>.

Hi Lu,

Can you provide some more detailed logs of what happened during the checkpointing phase? If it is possible please enable debug logs enabled.

It would be also great know whether you have implemented your own Iterator Operator or what kind of Flink program you are trying to execute.

Best,
Fabian

CC user-list

> On 15. Apr 2021, at 22:34, Lu Niu <qq...@gmail.com> wrote:
> 
> Hi, Flink Users
> 
> When we migrate from flink 1.9.1 to flink 1.11, we notice job will always fail on checkpoint if job uses Iterator Operator, no matter we use unaligned checkpoint or not. Those jobs don't have checkpoint issues in 1.9. Is this a known issue? Thank you!
> 
> Best
> Lu