You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "Alex Levenson (JIRA)" <ji...@apache.org> on 2015/07/28 21:55:05 UTC

[jira] [Created] (PARQUET-346) ThriftSchemaConverter throws for unknown struct or union type

Alex Levenson created PARQUET-346:
-------------------------------------

             Summary: ThriftSchemaConverter throws for unknown struct or union type
                 Key: PARQUET-346
                 URL: https://issues.apache.org/jira/browse/PARQUET-346
             Project: Parquet
          Issue Type: Bug
          Components: parquet-mr
            Reporter: Alex Levenson


ThriftSchemaConverter should either only be called on ThriftStruct's that have populated structOrUnionType metadata, or should support a mode where this data is unknown w/o throwing an exception.

Currently it is called using the file's metadata here:
https://github.com/apache/parquet-mr/blob/d6f082b9be5d507ff60c6bc83a179cc44015ab97/parquet-thrift/src/main/java/org/apache/parquet/thrift/ThriftRecordConverter.java#L797

One workaround is not not use the file matadata here but rather the schema from the thrift class. The other is to support unknown struct or union types



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)