You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "Nitish G (Jira)" <ji...@apache.org> on 2022/04/22 16:04:00 UTC

[jira] [Commented] (PARQUET-1928) Interpret Parquet INT96 type as FIXED[12] AVRO Schema

    [ https://issues.apache.org/jira/browse/PARQUET-1928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526525#comment-17526525 ] 

Nitish G commented on PARQUET-1928:
-----------------------------------

Looks like this bug has resurfaced again in 3.0.0 release, Can we please have it investigated ?

Using IntelliJ : 2021.3

Avro and Parquet Viewer : 3.0.0 (6th March 2022)

> Interpret Parquet INT96 type as FIXED[12] AVRO Schema
> -----------------------------------------------------
>
>                 Key: PARQUET-1928
>                 URL: https://issues.apache.org/jira/browse/PARQUET-1928
>             Project: Parquet
>          Issue Type: Bug
>          Components: parquet-avro
>    Affects Versions: 1.11.0
>            Reporter: Anant Damle
>            Assignee: Anant Damle
>            Priority: Minor
>              Labels: patch
>             Fix For: 1.12.0
>
>         Attachments: Screen Shot 2022-04-22 at 12.02.12 PM.png
>
>
> Reading Parquet files in Apache Beam using ParquetIO uses `AvroParquetReader` causing it to throw `IllegalArgumentException("INT96 not implemented and is deprecated")`
> Customers have large datasets which can't be reprocessed again to convert into a supported type. An easier approach would be to convert into a byte array of 12 bytes, that can then be interpreted by the developer in any way they want to interpret it.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)