You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Zoltán Borók-Nagy (Jira)" <ji...@apache.org> on 2021/05/17 13:03:00 UTC
[jira] [Updated] (IMPALA-10626) Add support for Iceberg's Catalogs
API
[ https://issues.apache.org/jira/browse/IMPALA-10626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zoltán Borók-Nagy updated IMPALA-10626:
---------------------------------------
Description:
Some engines (e.g. Spark and Hive) use different table properties for defining catalog properties.
In the main hive configuration they store the following properties:
* {{iceberg.catalog.<catalog_name>.type = hadoop}}
* {{iceberg.catalog.<catalog_name>.warehouse = somelocation}}
On the table level they have the following properties:
* {{iceberg.catalog = <catalog_name>}}
* {{name = <database.table_name>}}
To load tables that use these kind of configurations we should use Iceberg's Catalogs class:
[https://github.com/apache/iceberg/blob/master/mr/src/main/java/org/apache/iceberg/mr/Catalogs.java]
Probably we'll also want to use these properties by default in the future.
was:
Some engines (e.g. Spark and Hive) use different table properties for defining catalog properties.
In the main hive configuration they store the following properties:
* {{iceberg.catalog.<catalog_name>.type = hadoop}}
* {{iceberg.catalog.<catalog_name>.warehouse = somelocation}}
On the table level they have the following properties:
* {{iceberg.mr.table.catalog = <catalog_name>}}
* {{iceberg.mr.table.identifier = <database.table_name>}}
To load tables that use these kind of configurations we should use Iceberg's Catalogs class:
[https://github.com/apache/iceberg/blob/master/mr/src/main/java/org/apache/iceberg/mr/Catalogs.java]
Probably we'll also want to use these properties by default in the future.
> Add support for Iceberg's Catalogs API
> --------------------------------------
>
> Key: IMPALA-10626
> URL: https://issues.apache.org/jira/browse/IMPALA-10626
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Reporter: Zoltán Borók-Nagy
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-iceberg
>
> Some engines (e.g. Spark and Hive) use different table properties for defining catalog properties.
> In the main hive configuration they store the following properties:
> * {{iceberg.catalog.<catalog_name>.type = hadoop}}
> * {{iceberg.catalog.<catalog_name>.warehouse = somelocation}}
> On the table level they have the following properties:
> * {{iceberg.catalog = <catalog_name>}}
> * {{name = <database.table_name>}}
> To load tables that use these kind of configurations we should use Iceberg's Catalogs class:
> [https://github.com/apache/iceberg/blob/master/mr/src/main/java/org/apache/iceberg/mr/Catalogs.java]
> Probably we'll also want to use these properties by default in the future.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org