You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@impala.apache.org by st...@apache.org on 2022/03/09 08:03:11 UTC
[impala] branch master updated: IMPALA-11154: Idle Kudu daemons consume too much CPU
This is an automated email from the ASF dual-hosted git repository.
stigahuang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git
The following commit(s) were added to refs/heads/master by this push:
new 7f1ce03 IMPALA-11154: Idle Kudu daemons consume too much CPU
7f1ce03 is described below
commit 7f1ce039be30d5b36a490e8b07728f82f5d4c3de
Author: Zoltan Borok-Nagy <bo...@cloudera.com>
AuthorDate: Mon Feb 28 12:38:18 2022 +0100
IMPALA-11154: Idle Kudu daemons consume too much CPU
Due to KUDU-1973 kudu-tservers produce high CPU consumption (see also
KUDU-3134) when there is a high number of table replicas. This means
that in the Impala dev environment the CPU consumption can be around
15-20% per kudu-tserver (there are 3 kudu-tservers) when all the Kudu
tables are loaded. Setting the value to 3 seconds lowers CPU usage to
~5% per kudu-terver.
Testing:
* ran exhaustive tests
Change-Id: Ieb4de56540f5a7dc860bf6e27d9a5c0e4f4b3d26
Reviewed-on: http://gerrit.cloudera.org:8080/18290
Reviewed-by: Wenzhe Zhou <wz...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
---
.../cluster/node_templates/common/etc/kudu/tserver.conf.tmpl | 9 ++++++++-
1 file changed, 8 insertions(+), 1 deletion(-)
diff --git a/testdata/cluster/node_templates/common/etc/kudu/tserver.conf.tmpl b/testdata/cluster/node_templates/common/etc/kudu/tserver.conf.tmpl
index 810a710..f1bf129 100644
--- a/testdata/cluster/node_templates/common/etc/kudu/tserver.conf.tmpl
+++ b/testdata/cluster/node_templates/common/etc/kudu/tserver.conf.tmpl
@@ -19,4 +19,11 @@
# Enable Kudu transaction.
-enable_txn_system_client_init
--unlock_experimental_flags
\ No newline at end of file
+-unlock_experimental_flags
+
+# Due to KUDU-1973 kudu-tservers produce high CPU consumption (see also KUDU-3134) when
+# there is a high number of table replicas. This means that in the Impala dev
+# environment the CPU consumption can be around 15-20% per kudu-tserver (there are 3
+# kudu-tservers) when all the Kudu tables are loaded. Setting the value to 3 seconds
+# lowers CPU usage to ~5% per kudu-terver.
+--raft_heartbeat_interval_ms=3000