You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Jacques Nadeau (JIRA)" <ji...@apache.org> on 2015/12/04 18:23:10 UTC
[jira] [Commented] (DRILL-4156) Parquet group converter cannot cope
with ENUM original type values
[ https://issues.apache.org/jira/browse/DRILL-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041797#comment-15041797 ]
Jacques Nadeau commented on DRILL-4156:
---------------------------------------
Can you add a test? Also, it would be good if you had tests for both parquet readers (we should make sure they both work with ENUM).
thanks!
> Parquet group converter cannot cope with ENUM original type values
> -------------------------------------------------------------------
>
> Key: DRILL-4156
> URL: https://issues.apache.org/jira/browse/DRILL-4156
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - Parquet
> Affects Versions: 1.3.0, 1.4.0
> Reporter: Chris Jansen
> Labels: easyfix, newbie, patch
> Attachments: parquet_enum.patch, parquet_enum_v2.patch
>
>
> When importing parquet data written using a Thrift schema, Drill cannot cope with ENUMs. This was fixed elsewhere in DRILL-1775 but not in the DrillParquetGroupConverter class ([see mailing list thread|https://mail-archives.apache.org/mod_mbox/drill-user/201508.mbox/%3CCAK55V=+VjPAehMiJ8U=CRH182k4zvhGfxzfwzNaA9edWZWgXKg@mail.gmail.com%3E]).
> It appears that the ParquetToDrillTypeConverter class was updated to use a varbinary as it's default behaviour, but the DrillParquetGroupConverter class was not updated to do the same.
> {code}
> Caused by: java.lang.UnsupportedOperationException: Unsupported type ENUM
> at org.apache.drill.exec.store.parquet2.DrillParquetGroupConverter.getConverterForType(DrillParquetGroupConverter.java:249)
> at org.apache.drill.exec.store.parquet2.DrillParquetGroupConverter.<init>(DrillParquetGroupConverter.java:154)
> at org.apache.drill.exec.store.parquet2.DrillParquetGroupConverter.<init>(DrillParquetGroupConverter.java:147)
> at org.apache.drill.exec.store.parquet2.DrillParquetGroupConverter.<init>(DrillParquetGroupConverter.java:147)
> at org.apache.drill.exec.store.parquet2.DrillParquetGroupConverter.<init>(DrillParquetGroupConverter.java:147)
> at org.apache.drill.exec.store.parquet2.DrillParquetRecordMaterializer.<init>(DrillParquetRecordMaterializer.java:40)
> at org.apache.drill.exec.store.parquet2.DrillParquetReader.setup(DrillParquetReader.java:267)
> ... 14 more
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)