[GitHub] [spark] zivanfi commented on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one

[GitBox <gi...@apache.org>]

zivanfi commented on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one
URL: https://github.com/apache/spark/pull/23721#issuecomment-484502195
 
 
   Parquet 1.11 is not released yet, but the release candidate provides [several new features, improvements and bugfixes](https://github.com/apache/parquet-mr/blob/master/CHANGES.md), most notably:
   
   - A new (but backwards- and forwards-compatible) logical type system that allows representation of timestamps with different semantics.
   - Column indexes, which allows pinpointing pages matching query conditions, leading to significant performance improvements in highly selective queries.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org