You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2018/09/30 07:27:01 UTC

[jira] [Commented] (IMPALA-7599) Make num retries for InconsistentMetadataFetchException configurable

    [ https://issues.apache.org/jira/browse/IMPALA-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16633294#comment-16633294 ] 

ASF subversion and git services commented on IMPALA-7599:
---------------------------------------------------------

Commit 6f7b162154daae4614a6f1da0be920394478b123 in impala's branch refs/heads/master from [~vercego]
[ https://git-wip-us.apache.org/repos/asf?p=impala.git;h=6f7b162 ]

IMPALA-7599: make the number of local cache retries configurable

Under heavy read/write load, the number of retries needed for queries
in order to skip over inconsistent metadata exceptions needs to be set
higher. This change makes the number of retries configurable. It can be
set with the newly added flag --local_catalog_max_fetch_retries.
In addition, this change increases the default from 10 to 40, which was
sufficient when handling several workloads with high read/write load.
Follow-up change for IMPALA-7597 will make use of this configuration
when retrying for cases other than analyzing queries.
Made several fixes to exception messages.

Testing:
- manual tests
- added an e2e test that sets the flag and checks for inconsistent metadata

Change-Id: I4f14d5a8728f3cb07c7710589c44c2cd52478ba8
Reviewed-on: http://gerrit.cloudera.org:8080/11539
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> Make num retries for InconsistentMetadataFetchException configurable
> --------------------------------------------------------------------
>
>                 Key: IMPALA-7599
>                 URL: https://issues.apache.org/jira/browse/IMPALA-7599
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Frontend
>    Affects Versions: Impala 3.1.0
>            Reporter: bharath v
>            Assignee: Vuk Ercegovac
>            Priority: Major
>
> Currently hardcoded to 10 (INCONSISTENT_METADATA_NUM_RETRIES)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org