You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "Anant Damle (Jira)" <ji...@apache.org> on 2020/10/19 07:17:00 UTC

[jira] [Created] (PARQUET-1928) Interpret Parquet INT96 type as FIXED[12] AVRO Schema

Anant Damle created PARQUET-1928:
------------------------------------

             Summary: Interpret Parquet INT96 type as FIXED[12] AVRO Schema
                 Key: PARQUET-1928
                 URL: https://issues.apache.org/jira/browse/PARQUET-1928
             Project: Parquet
          Issue Type: Bug
          Components: parquet-avro
            Reporter: Anant Damle


Reading Parquet files in Apache Beam using ParquetIO uses `AvroParquetReader` causing it to throw `IllegalArgumentException("INT96 not implemented and is deprecated")`

Customers have large datasets which can't be reprocessed again to convert into a supported type. An easier approach would be to convert into a byte array of 12 bytes, that can then be interpreted by the developer in any way they want to interpret it.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)