You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Elliot West (JIRA)" <ji...@apache.org> on 2018/05/08 09:11:00 UTC

[jira] [Created] (HIVE-19457) Support Iceberg as a table format

Elliot West created HIVE-19457:
----------------------------------

             Summary: Support Iceberg as a table format
                 Key: HIVE-19457
                 URL: https://issues.apache.org/jira/browse/HIVE-19457
             Project: Hive
          Issue Type: New Feature
          Components: Metastore, StorageHandler
            Reporter: Elliot West


From [Netflix/iceberg|https://github.com/Netflix/iceberg]:
{quote}
Iceberg is a new table format for storing large, slow-moving tabular data. It is designed to improve on the de-facto standard table layout built into Hive, Presto, and Spark.
{quote}

Iceberg elegantly solves many data and metadata challenges when handling large datasets, especially when using eventually consistent file stores. By integrating iceberg with Hive we could hope to gain the following:

* Improved performance when reading large numbers of partitions (HMS is no longer a bottleneck).
* Users receiving a consistent view when reading changing datasets (snapshot isolation).
* Strong consistency on eventually consistent file stores without the need for additional infrastructure (data is immutable, eventually consistent ops are avoided; data is always {{PUT}} and {{LIST}} is avoided).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)