You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Congxian Qiu(klion26) (Jira)" <ji...@apache.org> on 2020/08/09 07:17:00 UTC
[jira] [Commented] (FLINK-18744) resume from modified savepoint
dirctionary: No such file or directory
[ https://issues.apache.org/jira/browse/FLINK-18744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173766#comment-17173766 ]
Congxian Qiu(klion26) commented on FLINK-18744:
-----------------------------------------------
The problem here exists, it was caused by FLINK-5763, after FLINK-5763 we assume that all the data and meta were in the same directory. But currently, state process API does not apply a deep copy of the previous data. The workaround, for now, needs to copy the data from the previous directory to the new directory.
I think the problem here can be fixed by FLINK-14942.
> resume from modified savepoint dirctionary: No such file or directory
> ---------------------------------------------------------------------
>
> Key: FLINK-18744
> URL: https://issues.apache.org/jira/browse/FLINK-18744
> Project: Flink
> Issue Type: Bug
> Components: API / State Processor
> Affects Versions: 1.11.0
> Reporter: tao wang
> Priority: Major
>
> If I resume a job from a savepoint which is modified by state processor API, such as loading from /savepoint-path-old and writing to /savepoint-path-new, the job resumed with savepointpath = /savepoint-path-new while throwing an Exception :
> _*/savepoint-path-new/\{some-ui-id} (No such file or directory)*_.
> I think it's an issue because of flink 1.11 use absolute path in savepoint and checkpoint, but state processor API missed this.
> The job will work well with new savepoint(which path is /savepoint-path-new) if I copy all dictionary except `_metadata from` /savepoint-path-old to /savepoint-path-new.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)