[GitHub] nandorKollar opened a new pull request #23721: [SPARK-26797][SQL][WIP] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one

[GitBox <gi...@apache.org>]

nandorKollar opened a new pull request #23721: [SPARK-26797][SQL][WIP] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one
URL: https://github.com/apache/spark/pull/23721
 
 
   ## What changes were proposed in this pull request?
   
   A new, more flexible API was introduced in parquet-mr 1.11.0 (based on the the Thrift field in parquet-format available for a while). This change migrated from the old (now deprecated) enum-based OriginalType API to this new logical type API.
   
   In addition to replacing the deprecated API calls, this PR also introduces support for reading the new subtypes for different timestamp semantics.
   
   Since parquet-mr 1.11.0 is not yet released, this is tested against a release candidate. Once it is released, the additional repository should be deleted from pom.xml.
   
   ## How was this patch tested?
   
   Unit tests were added to the PR.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org