[jira] [Comment Edited] (ARROW-17464) [C++] Support float16 in writing/reading parquet

["Anja Boskovic (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-17464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581536#comment-17581536 ] 

Anja Boskovic edited comment on ARROW-17464 at 8/18/22 8:55 PM:
----------------------------------------------------------------

That does seem like a reasonable suggestion! For context, this proposal was directly inspired by this PR: [https://github.com/apache/arrow/pull/12449.]

I am new to this community; how do you suggest I propose standardising the logical type in the Parquet spec? Do I open an issue in the Parquet Jira?


was (Author: JIRAUSER288952):
That does make sense to me! This proposal was directly inspired by this PR: [https://github.com/apache/arrow/pull/12449.]

I am new to this community; how do you suggest I propose standardising the logcal type in the Parquet spec? Do I open an issue in the Parquet Jira?

> [C++] Support float16 in writing/reading parquet
> ------------------------------------------------
>
>                 Key: ARROW-17464
>                 URL: https://issues.apache.org/jira/browse/ARROW-17464
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++, Parquet, Python
>            Reporter: Anja Boskovic
>            Assignee: Anja Boskovic
>            Priority: Major
>              Labels: parquet
>
> Half-float values are not supported in Parquet. Here is a previous issue that talks about that: https://issues.apache.org/jira/browse/PARQUET-1647
> So, this will not work:
> {code:java}
> import pyarrow as pa
> import pyarrow.parquet as pq
> import numpy as np
> arr = pa.array(np.float16([0.1, 2.2, 3]))
> table = pa.table({'a': arr})
> pq.write_table(table, "test_halffloat.parquet") {code}
> {{This is a proposal to store float16 values in Parquet as FixedSizeBinary, and then restore them to float16 when reading them back in.}}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)