You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Tim Armstrong (JIRA)" <ji...@apache.org> on 2019/06/26 20:17:00 UTC
[jira] [Resolved] (IMPALA-8315) Error from shutil.rmtree in
ImpalaTestSuite::run_stmt_in_hive()
[ https://issues.apache.org/jira/browse/IMPALA-8315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tim Armstrong resolved IMPALA-8315.
-----------------------------------
Resolution: Fixed
Fix Version/s: Impala 3.3.0
> Error from shutil.rmtree in ImpalaTestSuite::run_stmt_in_hive()
> ---------------------------------------------------------------
>
> Key: IMPALA-8315
> URL: https://issues.apache.org/jira/browse/IMPALA-8315
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 3.3.0
> Reporter: Joe McDonnell
> Assignee: Tim Armstrong
> Priority: Critical
> Labels: broken-build
> Fix For: Impala 3.3.0
>
>
> TestHBaseQueries.test_hbase_col_filter() failed on a centos6 exhaustive build with the following error:
> {noformat}
> query_test/test_hbase_queries.py:89: in test_hbase_col_filter
> self.run_stmt_in_hive(add_data)
> common/impala_test_suite.py:781: in run_stmt_in_hive
> if tmpdir is not None: shutil.rmtree(tmpdir)
> /usr/lib64/python2.6/shutil.py:212: in rmtree
> rmtree(fullname, ignore_errors, onerror)
> /usr/lib64/python2.6/shutil.py:212: in rmtree
> rmtree(fullname, ignore_errors, onerror)
> /usr/lib64/python2.6/shutil.py:212: in rmtree
> rmtree(fullname, ignore_errors, onerror)
> /usr/lib64/python2.6/shutil.py:217: in rmtree
> onerror(os.remove, fullname, sys.exc_info())
> /usr/lib64/python2.6/shutil.py:215: in rmtree
> os.remove(fullname)
> E OSError: [Errno 2] No such file or directory: '/tmp/impala-tests-j2b9bQ/localRunner/jenkins/job_local541814598_0023/job_local541814598_0023.xml'{noformat}
> ImpalaTestSuite::run_stmt_in_hive() creates a temporary directory when in LocalRunner mode to avoid different tests conflicting on the directory name. It creates the temp directory, runs the Hive statement, then removes the directory at the end. The removal is failing here. It looks like there might be a race between pytest running shutil.rmtree() and Hive cleaning up its own files from the statement.
> We might want to use shutil.rmtree(..., ignore_errors=True).
> Seen once.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org