You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@parquet.apache.org by "Gang Wu (Jira)" <ji...@apache.org> on 2023/12/09 16:16:00 UTC
[jira] [Resolved] (PARQUET-1647) [Java] support for Arrow's float16
[ https://issues.apache.org/jira/browse/PARQUET-1647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gang Wu resolved PARQUET-1647.
------------------------------
Fix Version/s: 1.14.0
Assignee: Jiashen Zhang
Resolution: Fixed
> [Java] support for Arrow's float16
> ----------------------------------
>
> Key: PARQUET-1647
> URL: https://issues.apache.org/jira/browse/PARQUET-1647
> Project: Parquet
> Issue Type: Improvement
> Components: parquet-format, parquet-thrift
> Reporter: The Alchemist
> Assignee: Jiashen Zhang
> Priority: Minor
> Labels: pull-request-available
> Fix For: 1.14.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> h2. DESCRIPTION
>
> I'm wondering if there's any interest in supporting Arrow's {{float16}} type in Parquet.
> There seem to be one or two {{float16}} / {{halffloat}} tickets here (e.g., PARQUET-1403) but nothing that speaks to adding half-float support to Parquet in-general.
>
> h2. PLANS
> I'm able to spend some time on this, if someone points me in the right direction.
>
> # Add the {{HALFFLOAT}} or {{FLOAT16}} enum (any preferred naming convention?) to [https://github.com/apache/parquet-format/blob/master/src/main/thrift/parquet.thrift#L32]
> # Add {{HALFFLOAT}} to {{org.apache.parquet.schema.PrimitiveType}}
> # Add {{HALFFLOAT}} support to {{org.apache.parquet.arrow.schema.SchemaConverter}}
> # Add encoding for new type at {{org.apache.parquet.column.Encoding}}
> # ??
> If anyone has any interest in this, pointers, or comments, they would be greatly appreciated!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org