You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2022/11/07 08:18:21 UTC
[GitHub] [iceberg] XBaith opened a new issue, #6137: Only one Iceberg hive catalog in different cluster is available in a job
XBaith opened a new issue, #6137:
URL: https://github.com/apache/iceberg/issues/6137
### Apache Iceberg version
0.14.1
### Query engine
Spark
### Please describe the bug 🐞
### Backgroud
Migrate Iceberg table to different clusters.
These two HDFS cluster have same `fs.defaultHost`
### issue
I load iceberg hive catalog via `CatalogUtil.buildIcebergCatalog(catalogName, properties, hadoopConf)`, all iceberg operations are available. But when I want to load an another hive catalog which is from different cluster, the `metadata file`was not found for Iceberg.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] XBaith closed issue #6137: Only one Iceberg hive catalog in different cluster is available in a job
Posted by GitBox <gi...@apache.org>.
XBaith closed issue #6137: Only one Iceberg hive catalog in different cluster is available in a job
URL: https://github.com/apache/iceberg/issues/6137
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] XBaith commented on issue #6137: Only one Iceberg hive catalog in different cluster is available in a job
Posted by GitBox <gi...@apache.org>.
XBaith commented on issue #6137:
URL: https://github.com/apache/iceberg/issues/6137#issuecomment-1321546181
We need to disable the Hadoop filesystem cache. Otherwise, Iceberg will always return the first Filesystem we load.
```
conf.set("fs.hdfs.impl.disable.cache", "true")
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org