You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2022/05/06 04:05:00 UTC

[jira] [Assigned] (FLINK-27517) Introduce rolling file writer to write one record each time for append-only table.

     [ https://issues.apache.org/jira/browse/FLINK-27517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jingsong Lee reassigned FLINK-27517:
------------------------------------

    Assignee: Zheng Hu

> Introduce rolling file writer to write one record each time for append-only table.
> ----------------------------------------------------------------------------------
>
>                 Key: FLINK-27517
>                 URL: https://issues.apache.org/jira/browse/FLINK-27517
>             Project: Flink
>          Issue Type: Sub-task
>            Reporter: Zheng Hu
>            Assignee: Zheng Hu
>            Priority: Major
>             Fix For: table-store-0.2.0
>
>
> Currently,  we table store has introduced a `RollingFile` to write an iterator of rows into the underlying files.  That's suitable for the memory store flush processing, but for append-only table, it usually don't have any memory store to cache those branch of rows temporarily, the idea approach is writing one record into the columnar writer each time, and the columnar writer will cache them  and write into the underlying file in one batch.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)