You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2020/07/14 00:24:00 UTC
[jira] [Commented] (IMPALA-9848) Coordinator unnecessarily
invalidating locally cached table metadata
[ https://issues.apache.org/jira/browse/IMPALA-9848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17157052#comment-17157052 ]
ASF subversion and git services commented on IMPALA-9848:
---------------------------------------------------------
Commit fc19e70cbc94735c38e64573c1e015878f218281 in impala's branch refs/heads/master from Sahil Takiar
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=fc19e70 ]
IMPALA-5534: Fix and enable experimental failure tests
Moves the test_catalog_hms_failures.py and test_process_failures.py from
the experimental tests to custom cluster tests.
catalog_service/test_hms_failure.py is combined with
custom_cluster/test_catalog_hms_failure.py as well in order to unify all
tests for HMS failures. Several modifications to the tests were
necessary to get them working again, but for the most part, the logic of
the tests remained the same. A few additional fault tolerance tests
(e.g. TestHiveMetaStoreFailure::test_hms_client_retries) were added as
well. The overall goal is to increase the process failure test coverage
for all components: impalads, statestore, catalogd, HMS, etc.
test_restart_catalogd in test_process_failures.py fails due to
IMPALA-9848, so it is skipped for now.
Testing:
* Ran new tests locally
Change-Id: I9dbb98017fb6c40cea349e7c63a35c325cbbc288
Reviewed-on: http://gerrit.cloudera.org:8080/16157
Reviewed-by: Sahil Takiar <st...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> Coordinator unnecessarily invalidating locally cached table metadata
> --------------------------------------------------------------------
>
> Key: IMPALA-9848
> URL: https://issues.apache.org/jira/browse/IMPALA-9848
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog, Frontend
> Reporter: Sahil Takiar
> Assignee: Anurag Mantripragada
> Priority: Major
> Attachments: IMPALA-9848-catalogd.INFO, IMPALA-9848-impalad.INFO
>
>
> The following fails when run locally on master:
> {code:java}
> ./bin/start-impala-cluster.py --catalogd_args='--catalog_topic_mode=minimal' --impalad_args='--use_local_catalog'
> ./bin/impala-shell.sh
> [localhost:21000] default> select count(l_comment) from tpch.lineitem; <--- THIS WORKS
> # kill the catalogd process
> [localhost:21000] default> select count(l_comment) from tpch.lineitem; <--- THIS FAILS
> ERROR: AnalysisException: Failed to load metadata for table: 'tpch.lineitem'
> CAUSED BY: TableLoadingException: Could not load table tpch.lineitem from catalog
> CAUSED BY: TException: org.apache.impala.common.InternalException: Couldn't open transport for localhost:26000 (connect() failed: Connection refused)CAUSED BY: InternalException: Couldn't open transport for localhost:26000 (connect() failed: Connection refused {code}
> The above experiment works with catalog v1 - e.g. if you remove the startup flags in the {{./bin/start-impala-cluster.py}} everything works.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org