[GitHub] [incubator-iceberg] electrum edited a comment on issue #166: Update Hive Metastore tables for Spark

[GitBox <gi...@apache.org>]

electrum edited a comment on issue #166: Update Hive Metastore tables for Spark
URL: https://github.com/apache/incubator-iceberg/pull/166#issuecomment-486059290
 
 
   @manishmalhotrawork The Presto Hive connector uses the Hive 3.x libraries, mainly to have access to the latest Parquet version, but that's an internal implementation detail. Today, Presto works with Hive 1.x and 2.x, and we have no plans to drop support for older versions. 
   
   Presto does not yet support Hive 3.x due to backwards incompatible changes around transactional tables, bucketing, security, and timestamps. It seems that Hive 3.x is actually incompatible with every other tool in the ecosystem, including older Hive versions. Spark support seems to be implemented by running the queries in HiveServer2 (rather than native Spark).
   
   One of the reasons why we (Presto developers and community) are so excited about Iceberg is that it frees users from the unwritten convention for Hive tables and provides a strong specification that all the tools in the ecosystem can implement. I'm also personally excited about the ability to replace the metastore with DynamoDB or similar, allowing users to run queries over data stored in cloud object stores without any additional dependencies.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org