You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Quanlong Huang (Jira)" <ji...@apache.org> on 2025/09/09 09:03:00 UTC

[jira] [Commented] (IMPALA-14416) JniFrontend.getDbs() could fail in InconsistentMetadataFetchException

    [ https://issues.apache.org/jira/browse/IMPALA-14416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18019022#comment-18019022 ] 

Quanlong Huang commented on IMPALA-14416:
-----------------------------------------

This is a similar issue to IMPALA-9441 and IMPALA-13170.

> JniFrontend.getDbs() could fail in InconsistentMetadataFetchException
> ---------------------------------------------------------------------
>
>                 Key: IMPALA-14416
>                 URL: https://issues.apache.org/jira/browse/IMPALA-14416
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Frontend
>            Reporter: Quanlong Huang
>            Assignee: Quanlong Huang
>            Priority: Critical
>         Attachments: catalogd-logs.txt, query_log.txt
>
>
> Saw a SHOW DATABASES command failed by InconsistentMetadataFetchException in local catalog mode: https://jenkins.impala.io/job/ubuntu-20.04-dockerised-tests/3986
> {noformat}
> I20250908 20:51:17.859867 60748 Frontend.java:2405] f74a2de0c6f403f2:b983af6600000000] Analyzing query: show databases db: default
> ...
> I20250908 20:51:17.876580 60748 CatalogdMetaProvider.java:1752] f74a2de0c6f403f2:b983af6600000000] Invalidated objects in cache: [list of database names, HMS_METADATA for DB test_drop_db_6d7dba7f_db]
> I20250908 20:51:17.876839 60748 jni-util.cc:321] f74a2de0c6f403f2:b983af6600000000] org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching DATABASE failed: DB_NOT_FOUND for TCatalogObject(type:DATABASE, catalog_version:0, db:TDatabase(db_name:test_drop_db_6d7dba7f_db))
>         at org.apache.impala.catalog.local.CatalogdMetaProvider.sendRequest(CatalogdMetaProvider.java:515)
>         at org.apache.impala.catalog.local.CatalogdMetaProvider.access$100(CatalogdMetaProvider.java:209)
>         at org.apache.impala.catalog.local.CatalogdMetaProvider$2.call(CatalogdMetaProvider.java:742)
>         at org.apache.impala.catalog.local.CatalogdMetaProvider$2.call(CatalogdMetaProvider.java:737)
>         at org.apache.impala.catalog.local.CatalogdMetaProvider.loadWithCaching(CatalogdMetaProvider.java:612)
>         at org.apache.impala.catalog.local.CatalogdMetaProvider.loadDb(CatalogdMetaProvider.java:734)
>         at org.apache.impala.catalog.local.LocalDb.getMetaStoreDb(LocalDb.java:101)
>         at org.apache.impala.catalog.local.LocalDb.toThrift(LocalDb.java:318)
>         at org.apache.impala.service.JniFrontend.getDbs(JniFrontend.java:395){noformat}
> After getting the list of FeDb in JniFrontend.getDbs(), getting thrift objects for all of them triggers new GetPartialCatalogObject requests to catalogd which could fail if the db is removed concurrently in catalogd.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org