You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Flink Jira Bot (Jira)" <ji...@apache.org> on 2021/10/28 10:41:01 UTC
[jira] [Updated] (FLINK-21543) when using FIFO compaction, I found
sst being deleted on the first checkpoint
[ https://issues.apache.org/jira/browse/FLINK-21543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Flink Jira Bot updated FLINK-21543:
-----------------------------------
Labels: auto-deprioritized-major stale-minor (was: auto-deprioritized-major)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help the community manage its development. I see this issues has been marked as Minor but is unassigned and neither itself nor its Sub-Tasks have been updated for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is still Minor, please either assign yourself or give an update. Afterwards, please remove the label or in 7 days the issue will be deprioritized.
> when using FIFO compaction, I found sst being deleted on the first checkpoint
> -----------------------------------------------------------------------------
>
> Key: FLINK-21543
> URL: https://issues.apache.org/jira/browse/FLINK-21543
> Project: Flink
> Issue Type: Bug
> Components: Runtime / State Backends
> Reporter: xiaogang zhou
> Priority: Minor
> Labels: auto-deprioritized-major, stale-minor
> Attachments: LOG (2), image-2021-03-03-11-35-11-458.png, image-2021-03-03-13-09-01-695.png
>
>
> 2021/03/01-18:51:01.202049 7f59042fc700 (Original Log Time 2021/03/01-18:51:01.200883) [/compaction/compaction_picker_fifo.cc:107] [_timer_state/processing_user-timers] FIFO compaction: picking file 1710 with creation time 0 for deletion
>
> the configuration is like
> currentOptions.setCompactionStyle(getCompactionStyle());
> currentOptions.setLevel0FileNumCompactionTrigger(8);
> // currentOptions.setMaxTableFilesSizeFIFO(MemorySize.parse("2gb").getBytes());
> CompactionOptionsFIFO compactionOptionsFIFO = new CompactionOptionsFIFO();
> compactionOptionsFIFO.setMaxTableFilesSize(MemorySize.parse("8gb").getBytes());
> compactionOptionsFIFO.setAllowCompaction(true);
>
> the rocksdb version is
> <dependency>
> <groupId>io.github.myasuka</groupId>
> <artifactId>frocksdbjni</artifactId>
> <version>6.10.2-ververica-3.0</version>
> </dependency>
>
> I think the problem is caused by tableproperty is lost by snapshot. Can any one suggest how i can skip this problem?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)