You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Quanlong Huang (Jira)" <ji...@apache.org> on 2024/01/05 14:03:00 UTC
[jira] [Resolved] (IMPALA-12670) CatalogdMetaProvider.getIfPresent() not throwing the underlying InconsistentMetadataFetchException
[ https://issues.apache.org/jira/browse/IMPALA-12670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Quanlong Huang resolved IMPALA-12670.
-------------------------------------
Fix Version/s: Impala 4.4.0
Resolution: Fixed
> CatalogdMetaProvider.getIfPresent() not throwing the underlying InconsistentMetadataFetchException
> --------------------------------------------------------------------------------------------------
>
> Key: IMPALA-12670
> URL: https://issues.apache.org/jira/browse/IMPALA-12670
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Affects Versions: Impala 4.0.0, Impala 3.3.0, Impala 3.4.0, Impala 3.4.1, Impala 4.1.0, Impala 4.2.0, Impala 4.1.1, Impala 4.1.2, Impala 4.3.0
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Blocker
> Fix For: Impala 4.4.0
>
> Attachments: catalogd.INFO.gz, failed-query-profile.txt, impalad.INFO.gz
>
>
> TestConcurrentDdls.test_local_catalog_ddls_with_invalidate_metadata could fail due to InconsistentMetadataFetchException:
> {code:python}
> tests/custom_cluster/test_concurrent_ddls.py:72: in test_local_catalog_ddls_with_invalidate_metadata
> self._run_ddls_with_invalidation(unique_database, sync_ddl=False)
> tests/custom_cluster/test_concurrent_ddls.py:148: in _run_ddls_with_invalidation
> worker[i].get(timeout=100)
> toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/multiprocessing/pool.py:572: in get
> raise self._value
> E AssertionError: ImpalaBeeswaxException:
> E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
> E MESSAGE: RuntimeException: java.util.concurrent.ExecutionException: org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0, table:TTable(db_name:functional, tbl_name:alltypestiny))
> E CAUSED BY: ExecutionException: org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0, table:TTable(db_name:functional, tbl_name:alltypestiny))
> E CAUSED BY: InconsistentMetadataFetchException: Fetching TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0, table:TTable(db_name:functional, tbl_name:alltypestiny))
> E
> E assert <bound method type.is_acceptable_error of <class 'test_concurrent_ddls.TestConcurrentDdls'>>("ImpalaBeeswaxException:\n INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>\n MESSAGE: RuntimeException: ja...ould not find TCatalogObject(type:TABLE, catalog_version:0, table:TTable(db_name:functional, tbl_name:alltypestiny))\n", False)
> E + where <bound method type.is_acceptable_error of <class 'test_concurrent_ddls.TestConcurrentDdls'>> = TestConcurrentDdls.is_acceptable_error
> E + and "ImpalaBeeswaxException:\n INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>\n MESSAGE: RuntimeException: ja...ould not find TCatalogObject(type:TABLE, catalog_version:0, table:TTable(db_name:functional, tbl_name:alltypestiny))\n" = str(ImpalaBeeswaxException()){code}
> The exception in impalad.INFO:
> {noformat}
> I0103 11:19:32.221755 8786 jni-util.cc:302] 3b476356afa44e74:6f637cfa00000000] java.lang.RuntimeException: java.util.concurrent.ExecutionException: org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0, table:TTable(db_name:functional, tbl_name:alltypestiny))
> at org.apache.impala.catalog.local.CatalogdMetaProvider.getIfPresent(CatalogdMetaProvider.java:901)
> at org.apache.impala.catalog.local.CatalogdMetaProvider.getTableIfPresent(CatalogdMetaProvider.java:750)
> at org.apache.impala.catalog.local.LocalDb.getTableIfCached(LocalDb.java:128)
> at org.apache.impala.catalog.local.LocalDb.getTable(LocalDb.java:143)
> at org.apache.impala.analysis.StmtMetadataLoader.getMissingTables(StmtMetadataLoader.java:314)
> at org.apache.impala.analysis.StmtMetadataLoader.loadTables(StmtMetadataLoader.java:169)
> at org.apache.impala.analysis.StmtMetadataLoader.loadTables(StmtMetadataLoader.java:145)
> at org.apache.impala.service.Frontend.doCreateExecRequest(Frontend.java:2348)
> at org.apache.impala.service.Frontend.getTExecRequest(Frontend.java:2110)
> at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1883)
> at org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:169)
> Caused by: java.util.concurrent.ExecutionException: org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0, table:TTable(db_name:functional, tbl_name:alltypestiny))
> at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
> at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
> at org.apache.impala.catalog.local.CatalogdMetaProvider.getIfPresent(CatalogdMetaProvider.java:898)
> ... 10 more
> Caused by: org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0, table:TTable(db_name:functional, tbl_name:alltypestiny))
> at org.apache.impala.catalog.local.CatalogdMetaProvider.sendRequest(CatalogdMetaProvider.java:465)
> at org.apache.impala.catalog.local.CatalogdMetaProvider.access$100(CatalogdMetaProvider.java:199)
> at org.apache.impala.catalog.local.CatalogdMetaProvider$4.call(CatalogdMetaProvider.java:776)
> at org.apache.impala.catalog.local.CatalogdMetaProvider$4.call(CatalogdMetaProvider.java:768)
> at org.apache.impala.catalog.local.CatalogdMetaProvider.loadWithCaching(CatalogdMetaProvider.java:562)
> at org.apache.impala.catalog.local.CatalogdMetaProvider.loadTable(CatalogdMetaProvider.java:764)
> at org.apache.impala.catalog.local.LocalTable.loadTableMetadata(LocalTable.java:152)
> at org.apache.impala.catalog.local.LocalTable.load(LocalTable.java:104)
> at org.apache.impala.catalog.local.LocalDb.getTable(LocalDb.java:147)
> ... 7 more{noformat}
> Other tests in TestConcurrentDdls that use local catalog mode could also hit the same issue, e.g. test_mixed_catalog_ddls_with_invalidate_metadata.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org