[impala] 01/03: IMPALA-10533: Fix TestScratchDir.test_scratch_dirs_mix_local_and_remote_dir_spill_local_only seems flaky

[st...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

stigahuang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git

commit bead2ede1c79fb477d2fb4d2f73703df1e34e97a
Author: Yida Wu <wy...@gmail.com>
AuthorDate: Sun Feb 21 12:00:08 2021 -0800

    IMPALA-10533: Fix TestScratchDir.test_scratch_dirs_mix_local_and_remote_dir_spill_local_only seems flaky
    
    The E2E testcase emulates the situation when there are two types of
    scratch directories, the data only spills to the local one when the
    space of local directory is sufficient. The testcase works fine for
    the debug build, however in the release build, the system runs faster
    and more data is spilled from memory which exceeds the setting of the
    local scratch space limit. To solve this, the size limit of local
    scratch space is changed from 100M to 2GB, so that allows all of the
    spilled data is in the local instead of the remote directory.
    
    Tests:
    Reran test_scratch_dirs_mix_local_and_remote_dir_spill_local_only in
    the release build.
    
    Change-Id: If2dc32196b2554aee9fc94a4ccbbf5803dbcce1d
    Reviewed-on: http://gerrit.cloudera.org:8080/17102
    Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
    Tested-by: Impala Public Jenkins <im...@cloudera.com>
---
 tests/custom_cluster/test_scratch_disk.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/tests/custom_cluster/test_scratch_disk.py b/tests/custom_cluster/test_scratch_disk.py
index 23df692..b1898db 100644
--- a/tests/custom_cluster/test_scratch_disk.py
+++ b/tests/custom_cluster/test_scratch_disk.py
@@ -294,7 +294,7 @@ class TestScratchDir(CustomClusterTestSuite):
        to local in the test'''
     normal_dirs = self.generate_dirs(2)
     normal_dirs[0] = '{0}::{1}'.format(normal_dirs[0], 1)
-    normal_dirs[1] = '{0}:100M:{1}'.format(normal_dirs[1], 0)
+    normal_dirs[1] = '{0}:2GB:{1}'.format(normal_dirs[1], 0)
     normal_dirs.append('hdfs://localhost')
     self._start_impala_cluster([
       '--impalad_args=-logbuflevel=-1 -scratch_dirs={0}'.format(','.join(normal_dirs)),