You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@impala.apache.org by jo...@apache.org on 2020/08/11 16:45:39 UTC

[impala] 01/02: Fix concurrency for docker-based tests on 140+GB memory machines

This is an automated email from the ASF dual-hosted git repository.

joemcdonnell pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git

commit 19f16a0f4889a59f7785bb88d059d2d8c335988d
Author: Joe McDonnell <jo...@cloudera.com>
AuthorDate: Sun Aug 9 19:38:42 2020 -0700

    Fix concurrency for docker-based tests on 140+GB memory machines
    
    A prior change increased the suite concurrency for the
    docker-based tests on machines with 140+GB of memory.
    This new rung should also bump the parallel test
    concurrency (i.e. for parallel EE tests). This sets
    the parallel test concurrency to 12 for this rung
    (which is what we use for the 95GB-140GB rung).
    
    Testing:
     - Ran test-with-docker.py on a m5.12xlarge
    
    Change-Id: Ib7299abd585da9ba1a838640dadc0bef9c72a39b
    Reviewed-on: http://gerrit.cloudera.org:8080/16326
    Reviewed-by: Laszlo Gaal <la...@cloudera.com>
    Tested-by: Joe McDonnell <jo...@cloudera.com>
---
 docker/test-with-docker.py | 1 +
 1 file changed, 1 insertion(+)

diff --git a/docker/test-with-docker.py b/docker/test-with-docker.py
index b348d3b..35f64aa 100755
--- a/docker/test-with-docker.py
+++ b/docker/test-with-docker.py
@@ -253,6 +253,7 @@ def _compute_defaults():
   if total_memory_gb >= 140:
     suite_concurrency = 6
     memlimit_gb = 11
+    parallel_test_concurrency = min(cpus, 12)
   elif total_memory_gb >= 95:
     suite_concurrency = 4
     memlimit_gb = 11