You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@impala.apache.org by cs...@apache.org on 2019/10/15 11:01:09 UTC

[impala] 01/02: IMPALA-8950: Set overwrite to False by default in fs_client.copy

This is an automated email from the ASF dual-hosted git repository.

csringhofer pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git

commit b0b8f20267f96c902eee5bab85475ee41645bbe3
Author: Sahil Takiar <ta...@gmail.com>
AuthorDate: Thu Oct 10 09:13:21 2019 -0700

    IMPALA-8950: Set overwrite to False by default in fs_client.copy
    
    test_udfs.py and test_load.py are consistently failing on S3 with
    the following error:
    
    E   TypeError: copy() takes exactly 4 arguments (3 given)
    
    The issue is that a new parameter 'overwrite' was added to the method
    'HadoopFsCommandLineClient.copy', but with no default value. This patch
    fixes the issue by adding 'overwrite=False'.
    
    Testing:
    * Ran core tests on S3
    
    Change-Id: I1935e0c92f7402e727ee16596485147cf1a5a516
    Reviewed-on: http://gerrit.cloudera.org:8080/14432
    Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
    Tested-by: Impala Public Jenkins <im...@cloudera.com>
---
 tests/util/hdfs_util.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/tests/util/hdfs_util.py b/tests/util/hdfs_util.py
index b22dec4..81d07e6 100644
--- a/tests/util/hdfs_util.py
+++ b/tests/util/hdfs_util.py
@@ -226,7 +226,7 @@ class HadoopFsCommandLineClient(BaseFilesystem):
     (status, stdout, stderr) = self._hadoop_fs_shell(['-mkdir', '-p', fixed_path])
     return status == 0
 
-  def copy(self, src, dst, overwrite):
+  def copy(self, src, dst, overwrite=False):
     """Copy the source file to the destination. Specifes the '-d' option by default, which
     'Skip[s] creation of temporary file with the suffix ._COPYING_.' to avoid extraneous
     copies on S3. If overwrite is true, the destination file is overwritten, set to false