You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Zoltan Ivanfi (JIRA)" <ji...@apache.org> on 2019/01/31 12:54:00 UTC

[jira] [Created] (SPARK-26797) Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one

Zoltan Ivanfi created SPARK-26797:
-------------------------------------

             Summary: Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one
                 Key: SPARK-26797
                 URL: https://issues.apache.org/jira/browse/SPARK-26797
             Project: Spark
          Issue Type: New Feature
          Components: SQL
    Affects Versions: 3.0.0
            Reporter: Zoltan Ivanfi


The 1.11.0 release of parquet-mr will deprecate its logical type API in favour of a newly introduced one. The new API also introduces new subtypes for different timestamp semantics, support for which should be added to Spark in order to read those types correctly.

At this point only a release candidate of parquet-mr 1.11.0 is available, but that already allows implementing and reviewing this change.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org