You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2022/02/14 08:32:00 UTC

[jira] [Updated] (FLINK-25628) Introduce RecordReader and related classes for table store

     [ https://issues.apache.org/jira/browse/FLINK-25628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jingsong Lee updated FLINK-25628:
---------------------------------
        Parent:     (was: FLINK-25152)
    Issue Type: Bug  (was: Sub-task)

> Introduce RecordReader and related classes for table store
> ----------------------------------------------------------
>
>                 Key: FLINK-25628
>                 URL: https://issues.apache.org/jira/browse/FLINK-25628
>             Project: Flink
>          Issue Type: Bug
>          Components: Table Store
>            Reporter: Jingsong Lee
>            Assignee: Jingsong Lee
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: table-store-0.1.0
>
>
> - Introduce RecordReader interface: The reader that reads the batches of records. 
> - Introduce SortMergeReader: This reader is to read a list of `RecordReader`, which is already sorted by key and sequence number, and perform a sort merge algorithm. `KeyValue` with the same key will also be combined during sort merging.
> - Introduce ConcatRecordReader: This reader is to concatenate a list of `RecordReader` and read them sequentially. The input list is already sorted by key and sequence number, and the key intervals do not overlap each other.
> - Introduce FieldStats: Statistics for each field.
> - Introduce SstPathFactory: Factory which produces new Path for sst files.
> - Introduce SstFile and SstFileMeta: This SstFile includes several `KeyValue`, representing the changes inserted into the file storage.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)