You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Cam Mach <ca...@gmail.com> on 2020/01/10 00:00:23 UTC

How watermark work

Hello Flink dev and user,

We have a pipeline that read both bounded and unbounded sources and our
understanding is that when the bounded sources complete they should get a
watermark of +inf and then we should be able to take a savepoint and safely
restart the pipeline. However, we have source that never get watermarks and
we are confused as to what we are seeing and what we should expect

[image: Screen Shot 2020-01-08 at 3.23.42 PM.png]

[image: Screen Shot 2020-01-09 at 7.20.42 AM.png]
Thanks,
Cam

Fwd: How watermark work

Posted by Cam Mach <ca...@gmail.com>.

Hello Flink dev and user,

We have a pipeline that read both bounded and unbounded sources and our
understanding is that when the bounded sources complete they should get a
watermark of +inf and then we should be able to take a savepoint and safely
restart the pipeline. However, we have source that never get watermarks and
we are confused as to what we are seeing and what we should expect

[image: Screen Shot 2020-01-08 at 3.23.42 PM.png]

Thanks,
Cam

Fwd: How watermark work

Posted by Cam Mach <ca...@gmail.com>.

Hello Flink dev and user,

We have a pipeline that read both bounded and unbounded sources and our
understanding is that when the bounded sources complete they should get a
watermark of +inf and then we should be able to take a savepoint and safely
restart the pipeline. However, we have source that never get watermarks and
we are confused as to what we are seeing and what we should expect

[image: Screen Shot 2020-01-08 at 3.23.42 PM.png]

Thanks,
Cam