You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Yu Li (Jira)" <ji...@apache.org> on 2022/08/25 02:33:00 UTC
[jira] [Updated] (FLINK-27517) Introduce rolling file writer to write one record each time for append-only table.
[ https://issues.apache.org/jira/browse/FLINK-27517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yu Li updated FLINK-27517:
--------------------------
Component/s: Table Store
> Introduce rolling file writer to write one record each time for append-only table.
> ----------------------------------------------------------------------------------
>
> Key: FLINK-27517
> URL: https://issues.apache.org/jira/browse/FLINK-27517
> Project: Flink
> Issue Type: Sub-task
> Components: Table Store
> Reporter: Zheng Hu
> Assignee: Zheng Hu
> Priority: Major
> Labels: pull-request-available
> Fix For: table-store-0.2.0
>
>
> Currently, we table store has introduced a `RollingFile` to write an iterator of rows into the underlying files. That's suitable for the memory store flush processing, but for append-only table, it usually don't have any memory store to cache those branch of rows temporarily, the idea approach is writing one record into the columnar writer each time, and the columnar writer will cache them and write into the underlying file in one batch.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)