You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "Nandor Kollar (JIRA)" <ji...@apache.org> on 2018/03/26 12:48:00 UTC

[jira] [Created] (PARQUET-1253) Support for new logical type representation

Nandor Kollar created PARQUET-1253:
--------------------------------------

             Summary: Support for new logical type representation
                 Key: PARQUET-1253
                 URL: https://issues.apache.org/jira/browse/PARQUET-1253
             Project: Parquet
          Issue Type: Improvement
          Components: parquet-mr
            Reporter: Nandor Kollar


Latest parquet-format [introduced|https://github.com/apache/parquet-format/commit/863875e0be3237c6aa4ed71733d54c91a51deabe#diff-0f9d1b5347959e15259da7ba8f4b6252] a new representation for logical types. As of now this is not yet supported in parquet-mr, thus there's no way to use parametrized UTC normalized timestamp data types. When reading and writing Parquet files, besides 'converted_type' parquet-mr should use the new 'logicalType' field in SchemaElement to tell the current logical type annotation. To maintain backward compatibility, the semantic of converted_type shouldn't change.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)