You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2019/08/06 21:43:00 UTC
[jira] [Commented] (IMPALA-7185) Reduce statestore frequency for
custom cluster tests by default
[ https://issues.apache.org/jira/browse/IMPALA-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901494#comment-16901494 ]
ASF subversion and git services commented on IMPALA-7185:
---------------------------------------------------------
Commit 4fb8e8e324ad3258d24d0ae40946c954b6c21a8d in impala's branch refs/heads/master from Tim Armstrong
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=4fb8e8e ]
IMPALA-8816: reduce custom cluster test runtime in core
This includes some optimisations and a bulk move of tests
to exhaustive.
Move a bunch of custom cluster tests to exhaustive. I selected
these partially based on runtime (i.e. I looked most carefully
at the tests that ran for over a minute) and the likelihood
of them catching a precommit bug. Regression tests for specific
edge cases and tests for parts of the code that are very stable
were prime candidates.
Remove an unnecessary cluster restart in test_breakpad.
Merge test_scheduler_error into test_failpoints to avoid an unnecessary
cluster restart.
Speed up cluster starts by ensuring that the default statestore args are
applied even when _start_impala_cluster() is called directly. This
shaves a couple of seconds off each restart. We made the default args
use a faster update frequency - see IMPALA-7185 - but they did not
take effect in all tests.
Change-Id: Ib2e3e7ebc9695baec4d69183387259958df10f62
Reviewed-on: http://gerrit.cloudera.org:8080/13967
Reviewed-by: Tim Armstrong <ta...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> Reduce statestore frequency for custom cluster tests by default
> ---------------------------------------------------------------
>
> Key: IMPALA-7185
> URL: https://issues.apache.org/jira/browse/IMPALA-7185
> Project: IMPALA
> Issue Type: Improvement
> Components: Infrastructure
> Reporter: Tim Armstrong
> Assignee: Tim Armstrong
> Priority: Major
> Fix For: Impala 2.13.0, Impala 3.1.0
>
>
> It takes several seconds to run the first query after cluster startup because of the statestore propagation delay for the catalog, which adds some real time to custom cluster tests. We should think about lowering the default update interval for those tests to make them start up faster.
> We could just prefix the statestored_args with lower values, allowing individual tests to override if needed.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org