You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Caizhi Weng (Jira)" <ji...@apache.org> on 2021/10/25 09:52:00 UTC

[jira] [Created] (FLINK-24630) Implement row projection in AvroToRowDataConverters#createRowConverter

Caizhi Weng created FLINK-24630:
-----------------------------------

             Summary: Implement row projection in AvroToRowDataConverters#createRowConverter
                 Key: FLINK-24630
                 URL: https://issues.apache.org/jira/browse/FLINK-24630
             Project: Flink
          Issue Type: Improvement
          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
    Affects Versions: 1.15.0
            Reporter: Caizhi Weng


Currently {{AvroToRowDataConverters#createRowConverter}} converts avro records to Flink row data directly without any projection. However users of this method, such as {{AvroFileSystemFormatFactory.RowDataAvroInputFormat}}, need to implement their own projection logic to filter out the columns they needed.

We can hide the logic of implementation in {{AvroToRowDataConverters#createRowConverter}} both for optimization (users do not need to copy the row for this) and for the ease of coding.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)