[jira] [Created] (PARQUET-2238) Spec and parquet-mr disagree on DELTA_BYTE_ARRAY encoding

["Jan Finis (Jira)" <ji...@apache.org>]

Jan Finis created PARQUET-2238:
----------------------------------

             Summary: Spec and parquet-mr disagree on DELTA_BYTE_ARRAY encoding
                 Key: PARQUET-2238
                 URL: https://issues.apache.org/jira/browse/PARQUET-2238
             Project: Parquet
          Issue Type: Bug
          Components: parquet-format, parquet-mr
            Reporter: Jan Finis


The spec in parquet-format specifies that [DELTA_BYTE_ARRAY is only supported for the physical type BYTE_ARRAY|https://parquet.apache.org/docs/file-format/data-pages/encodings/#delta-length-byte-array-delta_length_byte_array--6]. Yet, [parquet-mr also uses it to encode FIXED_LENGTH_BYTE_ARRAY|https://github.com/apache/parquet-mr/blob/fd1326a8a56174320ea2f36d7c6c4e78105ab108/parquet-column/src/main/java/org/apache/parquet/column/values/factory/DefaultV2ValuesWriterFactory.java#L83].

So, I guess the spec should be updated or the code should be changed to no longer write this encoding for FIXED_LENGTH_BYTE_ARRAY.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)