You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user-zh@flink.apache.org by 林影 <br...@gmail.com> on 2022/04/22 09:05:25 UTC

关于Flink1.15文档,有一些小疑惑求助

在Flink 官网savepoint的页面中,出现下面一段话
Starting from Flink 1.15 intermediate savepoints (savepoints other than
created with stop-with-savepoint
<https://nightlies.apache.org/flink/flink-docs-master/docs/ops/state/savepoints/#stopping-a-job-with-savepoint>)
are not used for recovery and do not commit any side effects.

intermediate savepoints具体指的是什么呢?

Re: 关于Flink1.15文档,有一些小疑惑求助

Posted by 林影 <br...@gmail.com>.
谢谢回复。
原来是这样,我原来还以为intermediate savepoints
指代的是checkpoint呢,我们这边的Flink平台正在做从ckp的状态恢复所以才有此一问。

Jiangang Liu <li...@gmail.com> 于2022年4月22日周五 19:52写道:

> intermediate
>
> savepoints指的是非stop-with-savepoint,也就是不停止作业的情况下做savepoint。我的感觉是,这个时候的savepoint不会commit(比如sink写出到外部系统),如果作业失败会从最近一次的checkpoint恢复。如果恰好有一个作业从savepoint恢复,两个作业同时跑,可能会造成结果的重复或者不一致,这个时候最好丢弃掉sink(换uid)。对于只有一个作业运行的情况,比如停了作业再恢复,是不会有问题的。
>
> 林影 <br...@gmail.com> 于2022年4月22日周五 17:05写道:
>
> > 在Flink 官网savepoint的页面中,出现下面一段话
> > Starting from Flink 1.15 intermediate savepoints (savepoints other than
> > created with stop-with-savepoint
> > <
> >
> https://nightlies.apache.org/flink/flink-docs-master/docs/ops/state/savepoints/#stopping-a-job-with-savepoint
> > >)
> > are not used for recovery and do not commit any side effects.
> >
> > intermediate savepoints具体指的是什么呢?
> >
>

Re: 关于Flink1.15文档,有一些小疑惑求助

Posted by Jiangang Liu <li...@gmail.com>.
intermediate
savepoints指的是非stop-with-savepoint,也就是不停止作业的情况下做savepoint。我的感觉是,这个时候的savepoint不会commit(比如sink写出到外部系统),如果作业失败会从最近一次的checkpoint恢复。如果恰好有一个作业从savepoint恢复,两个作业同时跑,可能会造成结果的重复或者不一致,这个时候最好丢弃掉sink(换uid)。对于只有一个作业运行的情况,比如停了作业再恢复,是不会有问题的。

林影 <br...@gmail.com> 于2022年4月22日周五 17:05写道:

> 在Flink 官网savepoint的页面中,出现下面一段话
> Starting from Flink 1.15 intermediate savepoints (savepoints other than
> created with stop-with-savepoint
> <
> https://nightlies.apache.org/flink/flink-docs-master/docs/ops/state/savepoints/#stopping-a-job-with-savepoint
> >)
> are not used for recovery and do not commit any side effects.
>
> intermediate savepoints具体指的是什么呢?
>