[jira] [Commented] (BEAM-12306) Add a native ParquetIO.ReadRows transform

["Beam JIRA Bot (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-12306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375875#comment-17375875 ] 

Beam JIRA Bot commented on BEAM-12306:
--------------------------------------

This issue is P2 but has been unassigned without any comment for 60 days so it has been labeled "stale-P2". If this issue is still affecting you, we care! Please comment and remove the label. Otherwise, in 14 days the issue will be moved to P3.

Please see https://beam.apache.org/contribute/jira-priorities/ for a detailed explanation of what these priorities mean.


> Add a native ParquetIO.ReadRows transform
> -----------------------------------------
>
>                 Key: BEAM-12306
>                 URL: https://issues.apache.org/jira/browse/BEAM-12306
>             Project: Beam
>          Issue Type: Improvement
>          Components: dsl-sql, io-java-parquet
>            Reporter: Ismaël Mejía
>            Priority: P2
>              Labels: stale-P2
>
> ParquetIO today uses Avro's GenericRecord to materialize reads from Parquet records, this implies an extra conversion from GenericRecord to Beam's Row. We can 'push' this conversion into the source read process by implementing a RecordMaterializer that builds Rows at read time xtending Parquet's [ReadSupport|https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/api/ReadSupport.java].



--
This message was sent by Atlassian Jira
(v8.3.4#803005)