You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2021/04/26 18:49:00 UTC
[jira] [Commented] (ARROW-12524) [Parquet][C++] Support arrow dense
union type in Parquet
[ https://issues.apache.org/jira/browse/ARROW-12524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17332682#comment-17332682 ]
Joris Van den Bossche commented on ARROW-12524:
-----------------------------------------------
As [~emkornfield] mentioned on the mailing list, there is no concrete plan or someone actively working on it, but contributions in this area would be very welcome.
bq. One of the challenges would be how to represent a Union type in Parquet because to the best of my knowledge parquet doesn't support this type.
I suppose that a sparse union could be represented as a struct array? (and based on the ARROW:schema metadata, we could restore the sparse union type on reading)
But I don't think something similar is possible for _dense_ union? (since that consists of variable-size child arrays)
> [Parquet][C++] Support arrow dense union type in Parquet
> --------------------------------------------------------
>
> Key: ARROW-12524
> URL: https://issues.apache.org/jira/browse/ARROW-12524
> Project: Apache Arrow
> Issue Type: Wish
> Components: C++, Parquet
> Reporter: ZMZ91
> Priority: Major
>
> Dense union type is not supported yet in Parquet [https://github.com/apache/arrow/blob/8e43f23dcc6a9e630516228f110c48b64d13cec6/cpp/src/parquet/arrow/schema.cc#L382] . Is it on schedule to support it nearly? If I'd implement this myself, is there any other codes to take care of? Thanks.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)