You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Anant Damle (Jira)" <ji...@apache.org> on 2021/02/25 02:48:00 UTC
[jira] [Created] (BEAM-11861) ParquetIO throws Coder not found when
using parseGenericRecord or parseFilesGenericRecord
Anant Damle created BEAM-11861:
----------------------------------
Summary: ParquetIO throws Coder not found when using parseGenericRecord or parseFilesGenericRecord
Key: BEAM-11861
URL: https://issues.apache.org/jira/browse/BEAM-11861
Project: Beam
Issue Type: Bug
Components: io-java-parquet
Affects Versions: 2.28.0
Reporter: Anant Damle
Assignee: Anant Damle
ParquetIO is missing output coder when using a user-specified parsing function with `parseGenericRecord` or `parseFilesGenericRecord` feature for reading Parquet files with unknown schema.
*Workaround:*
Use `setCoder` directly on the output `PCollection`
for example:
{{SerializableFunction<GenericRecord, Foo> parseFn = ...;}}
{{Coder<Foo> fooCoder = ...;}}
{{PCollection<Foo> records = }}{{p}}{{.apply(ParquetIO.parseGenericRecords(parseFn).from(...))}}
{{*.setCoder(fooCoder)*;}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)