You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2022/06/23 09:42:00 UTC
[jira] [Comment Edited] (FLINK-28221) Savepoint may corrupt file metas by repeat commit
[ https://issues.apache.org/jira/browse/FLINK-28221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557973#comment-17557973 ]
Jingsong Lee edited comment on FLINK-28221 at 6/23/22 9:41 AM:
---------------------------------------------------------------
We should store FileStoreCommitImpl's commitUser into state.
was (Author: lzljs3620320):
We should store uuid in state.
> Savepoint may corrupt file metas by repeat commit
> -------------------------------------------------
>
> Key: FLINK-28221
> URL: https://issues.apache.org/jira/browse/FLINK-28221
> Project: Flink
> Issue Type: Bug
> Components: Table Store
> Reporter: Jingsong Lee
> Priority: Major
> Fix For: table-store-0.2.0
>
>
> [https://github.com/apache/flink-table-store/runs/7020439369?check_suite_focus=true]
> Error: Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 46.953 s <<< FAILURE! - in org.apache.flink.table.store.connector.RescaleBucketITCase
> [32285|https://github.com/apache/flink-table-store/runs/7020439369?check_suite_focus=true#step:4:32286]Error: testSuspendAndRecoverAfterRescaleOverwrite Time elapsed: 25.545 s <<< ERROR!
> {code:java}
> Caused by: java.lang.IllegalStateException: Trying to add file {org.apache.flink.table.data.binary.BinaryRowData@9c67b85d, 0, 0, data-4756dfaf-e14e-440e-b211-df2b25f2537a-0.orc} which is already added. Manifest might be corrupted.
> 32416 at org.apache.flink.util.Preconditions.checkState(Preconditions.java:215)
> 32417 at org.apache.flink.table.store.file.operation.AbstractFileStoreScan.plan(AbstractFileStoreScan.java:189)
> 32418 at org.apache.flink.table.store.table.source.TableScan.plan(TableScan.java:99)
> 32419 at org.apache.flink.table.store.connector.source.FileStoreSource.restoreEnumerator(FileStoreSource.java:117)
> 32420 at org.apache.flink.table.store.connector.source.FileStoreSource.createEnumerator(FileStoreSource.java:93)
> 32421 at org.apache.flink.runtime.source.coordinator.SourceCoordinator.start(SourceCoordinator.java:197)
> 32422 ... 33 more {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)