[jira] [Created] (IMPALA-10626) Add support for Iceberg's Catalogs API

["Zoltán Borók-Nagy (Jira)" <ji...@apache.org>]

Zoltán Borók-Nagy created IMPALA-10626:
------------------------------------------

             Summary: Add support for Iceberg's Catalogs API
                 Key: IMPALA-10626
                 URL: https://issues.apache.org/jira/browse/IMPALA-10626
             Project: IMPALA
          Issue Type: Bug
          Components: Frontend
            Reporter: Zoltán Borók-Nagy


Some engines (e.g. Spark and Hive) use different table properties for defining catalog properties.

In the main hive configuration they store the following properties:
 * {{iceberg.catalog.<catalog_name>.type = hadoop}}
 * {{iceberg.catalog.<catalog_name>.warehouse = somelocation}}

On the table level they have the following properties:
 * {{iceberg.mr.table.catalog = <catalog_name>}}
 * {{iceberg.mr.table.identifier = <database.table_name>}}

To load tables that use these kind of configurations we should use Iceberg's Catalogs class:

[https://github.com/apache/iceberg/blob/master/mr/src/main/java/org/apache/iceberg/mr/Catalogs.java]

Probably we'll also want to use these properties by default in the future.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org