[GitHub] [iceberg] RussellSpitzer commented on issue #2488: Forbid setting "uri" for SparkSessionCatalog when Hive is used.

[GitBox <gi...@apache.org>]

RussellSpitzer commented on issue #2488:
URL: https://github.com/apache/iceberg/issues/2488#issuecomment-919470004


    1. The issue is that by configuring spark-catalog.uri=... to something different than the default session value isn't that it overrides the value. We instead end up configuring two different metastore connections. One connection to the Spark Delegate metastore and one connection to the Iceberg metastore. During our function calls we switch between these two catalogs which has a lot of unexpected behaviors. For example making a database in one catalog without making it in the other which leads to the error I explained above.
   
    2. Namespace is equivalent to "database" in this context. You can think of them as synonyms.
   
    3. Like I mentioned in one, the underlying issue is that the delegate catalog uses one metastore and the IcebergCatalog uses another. So rather than checking the same metastore for Iceberg and then non Iceberg tables, we first check one catalog for Iceberg and then check a different catalog for non-Iceberg. 
    So if I call "Create Database" this gets run on the Delegate Metastore, so now the delegate metastore has a new database. Now when I try to create an Iceberg table in that database, my requests are all routed to the Iceberg metastore where the database does not exist.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org