You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Zheng Hu (Jira)" <ji...@apache.org> on 2022/05/06 03:49:00 UTC

[jira] [Created] (FLINK-27517) Introduce rolling file writer to write one record each time for append-only table.

Zheng Hu created FLINK-27517:
--------------------------------

             Summary: Introduce rolling file writer to write one record each time for append-only table.
                 Key: FLINK-27517
                 URL: https://issues.apache.org/jira/browse/FLINK-27517
             Project: Flink
          Issue Type: Sub-task
            Reporter: Zheng Hu


Currently,  we table store has introduced a `RollingFile` to write an iterator of rows into the underlying files.  That's suitable for the memory store flush processing, but for append-only table, it usually don't have any memory store to cache those branch of rows temporarily, the idea approach is writing one record into the columnar writer each time, and the columnar writer will cache them  and write into the underlying file in one batch.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)