[jira] [Created] (PARQUET-1647) [Java] support for Arrow's float16

["The Alchemist (Jira)" <ji...@apache.org>]

The Alchemist created PARQUET-1647:
--------------------------------------

             Summary: [Java] support for Arrow's float16
                 Key: PARQUET-1647
                 URL: https://issues.apache.org/jira/browse/PARQUET-1647
             Project: Parquet
          Issue Type: Improvement
          Components: parquet-format, parquet-thrift
            Reporter: The Alchemist


h2. DESCRIPTION

 

I'm wondering if there's any interest in supporting Arrow's {{float16}} type in Parquet.

There seem to be one or two {{float16}} / {{halffloat}} tickets here (e.g., PARQUET-1403) but nothing that speaks to adding half-float support to Parquet in-general.

 
h2. PLANS

I'm able to spend some time on this, if someone points me  in the right direction.

 
 # Add the {{HALFFLOAT}} or {{FLOAT16}} enum (any preferred naming convention?) to [https://github.com/apache/parquet-format/blob/master/src/main/thrift/parquet.thrift#L32]
 # Add {{HALFFLOAT}} to {{org.apache.parquet.schema.PrimitiveType}}
 # Add {{HALFFLOAT}} support to {{org.apache.parquet.arrow.schema.SchemaConverter}}
 # Add encoding for new type at {{org.apache.parquet.column.Encoding}}
 # ??

If anyone has any interest in this, pointers, or comments, they would be greatly appreciated!



--
This message was sent by Atlassian Jira
(v8.3.2#803003)