You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Csaba Ringhofer (Jira)" <ji...@apache.org> on 2024/08/09 13:00:02 UTC
[jira] [Created] (IMPALA-13292) Decrease statestore_update_frequency_ms in development environment
Csaba Ringhofer created IMPALA-13292:
----------------------------------------
Summary: Decrease statestore_update_frequency_ms in development environment
Key: IMPALA-13292
URL: https://issues.apache.org/jira/browse/IMPALA-13292
Project: IMPALA
Issue Type: Improvement
Components: Infrastructure
Reporter: Csaba Ringhofer
The current default 2s for statestore_update_frequency_ms adds significant delay to lot of operations. While decreasing it in production environment sounds risky, doing this in the development environment could make it faster.
Decreasing statestore_update_frequency_ms from 2s to 0.5s reduced cluster startup time by 1-2 seconds, which could make custom cluster tests faster. It also significantly speeds up tests that create / drop metastore objects:
impala-py.test -x tests/metadata/test_ddl.py -ktest_create_table_as_select
with default settings:
first run: 32s -> 16s
other runs: 16s -> 8s
The effect less drastic on the first run with catalog_topic_mode=minimal:
first run: 18s-> 12s
other runs: 16s -> 8s
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org