You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by Сергей Парышев <se...@mail.ru.INVALID> on 2024/01/11 10:43:54 UTC

[DISCUSS] [connectors] FileSystem connector - restore from historical checkpoint

Hi devs! I have question about filesystem (parquet) sink  connector. When compaction is enabled and job restoring from historical checkpoint then job canceling with FileNotFoundException: can't find old .uncompacted file, when compaction is disabled and restoring from historical checkpoint fresh files will not deleted. It means that filesystem connector doesn't provide exactly once semantic when max retain checkpoint is greater than 1, right?