[jira] [Created] (IMPALA-14416) JniFrontend.getDbs() could fail in InconsistentMetadataFetchException

["Quanlong Huang (Jira)" <ji...@apache.org>]

Quanlong Huang created IMPALA-14416:
---------------------------------------

             Summary: JniFrontend.getDbs() could fail in InconsistentMetadataFetchException
                 Key: IMPALA-14416
                 URL: https://issues.apache.org/jira/browse/IMPALA-14416
             Project: IMPALA
          Issue Type: Bug
          Components: Frontend
            Reporter: Quanlong Huang
            Assignee: Quanlong Huang


Saw a SHOW DATABASES command failed by InconsistentMetadataFetchException in local catalog mode:
{noformat}
I20250908 20:51:17.859867 60748 Frontend.java:2405] f74a2de0c6f403f2:b983af6600000000] Analyzing query: show databases db: default
...
I20250908 20:51:17.876580 60748 CatalogdMetaProvider.java:1752] f74a2de0c6f403f2:b983af6600000000] Invalidated objects in cache: [list of database names, HMS_METADATA for DB test_drop_db_6d7dba7f_db]
I20250908 20:51:17.876839 60748 jni-util.cc:321] f74a2de0c6f403f2:b983af6600000000] org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching DATABASE failed: DB_NOT_FOUND for TCatalogObject(type:DATABASE, catalog_version:0, db:TDatabase(db_name:test_drop_db_6d7dba7f_db))
        at org.apache.impala.catalog.local.CatalogdMetaProvider.sendRequest(CatalogdMetaProvider.java:515)
        at org.apache.impala.catalog.local.CatalogdMetaProvider.access$100(CatalogdMetaProvider.java:209)
        at org.apache.impala.catalog.local.CatalogdMetaProvider$2.call(CatalogdMetaProvider.java:742)
        at org.apache.impala.catalog.local.CatalogdMetaProvider$2.call(CatalogdMetaProvider.java:737)
        at org.apache.impala.catalog.local.CatalogdMetaProvider.loadWithCaching(CatalogdMetaProvider.java:612)
        at org.apache.impala.catalog.local.CatalogdMetaProvider.loadDb(CatalogdMetaProvider.java:734)
        at org.apache.impala.catalog.local.LocalDb.getMetaStoreDb(LocalDb.java:101)
        at org.apache.impala.catalog.local.LocalDb.toThrift(LocalDb.java:318)
        at org.apache.impala.service.JniFrontend.getDbs(JniFrontend.java:395){noformat}

After getting the list of FeDb in JniFrontend.getDbs(), getting thrift objects for all of them triggers new GetPartialCatalogObject requests to catalogd which could fail if the db is removed concurrently in catalogd.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org