You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "j3-signalroom (via GitHub)" <gi...@apache.org> on 2024/10/21 00:38:20 UTC
Re: [I] Unable to use GlueCatalog in flink environments without hadoop [iceberg]
j3-signalroom commented on issue #3044:
URL: https://github.com/apache/iceberg/issues/3044#issuecomment-2425331532
> I found this thread while trying to make Flink, Iceberg, and Glue work together without the Hadoop dependencies, so I'm hoping this is useful for someone else in the future. To answer my own question, this seems to work (@tiborkiss gave me an important clue about the null Hadoop config):
>
> ```
> import org.apache.hadoop.conf.Configuration;
> import org.apache.flink.table.catalog.Catalog;
> import org.apache.iceberg.flink.FlinkCatalog;
> import org.apache.iceberg.catalog.Namespace;
> import org.apache.iceberg.flink.CatalogLoader;
>
> /* skipping other pieces */
>
> Configuration hadoopEmpty = new Configuration(false);
> CatalogLoader catalogLoader = CatalogLoader.custom(catalogName, map, hadoopEmpty, impl);
> Catalog flinkCatalog = new FlinkCatalog(catalogName, databaseName, Namespace.empty(), catalogLoader, true);
> tableEnv.registerCatalog(catalogName, flinkCatalog);
> tableEnv.useCatalog(catalogName);
> ```
Thank you for this tip!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org