You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Alex Levenson (JIRA)" <ji...@apache.org> on 2015/08/20 22:53:45 UTC

[jira] [Resolved] (PARQUET-362) Parquet buffered writer is too sensitive regarding unions and unknown fields

     [ https://issues.apache.org/jira/browse/PARQUET-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alex Levenson resolved PARQUET-362.
-----------------------------------
       Resolution: Fixed
    Fix Version/s: 2.0.0

Issue resolved by pull request 262
[https://github.com/apache/parquet-mr/pull/262]

> Parquet buffered writer is too sensitive regarding unions and unknown fields
> ----------------------------------------------------------------------------
>
>                 Key: PARQUET-362
>                 URL: https://issues.apache.org/jira/browse/PARQUET-362
>             Project: Parquet
>          Issue Type: Bug
>          Components: parquet-mr
>    Affects Versions: 1.7.0, 1.8.0, 1.8.1
>            Reporter: Laurent Goujon
>             Fix For: 2.0.0
>
>
> Parquet does prevent records with unknown union fields to be written as it would create a TProtocol violation. But it also prevents records with unions having one their field itself having an unknown field (which is acceptable if it is a struct).
> The recursive check should be removed, and only when a union field is unknown should the record be deemed invalid.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)