[GitHub] [beam] damccorm opened a new issue, #20881: Add a native ParquetIO.ReadRows transform

[GitBox <gi...@apache.org>]

damccorm opened a new issue, #20881:
URL: https://github.com/apache/beam/issues/20881

   ParquetIO today uses Avro's GenericRecord to materialize reads from Parquet records, this implies an extra conversion from GenericRecord to Beam's Row. We can 'push' this conversion into the source read process by implementing a RecordMaterializer that builds Rows at read time xtending Parquet's [ReadSupport](https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/api/ReadSupport.java).
   
   Imported from Jira [BEAM-12306](https://issues.apache.org/jira/browse/BEAM-12306). Original Jira may contain additional context.
   Reported by: iemejia.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] gabrywu commented on issue #20881: Add a native ParquetIO.ReadRows transform

["gabrywu (via GitHub)" <gi...@apache.org>]

gabrywu commented on issue #20881:
URL: https://github.com/apache/beam/issues/20881#issuecomment-1669176885

   any updates here?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org