You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Joe McDonnell (Jira)" <ji...@apache.org> on 2026/02/26 19:54:00 UTC
[jira] [Updated] (IMPALA-14790) Various custom cluster tests fail in start-impala-cluster.py with errors in psutil
[ https://issues.apache.org/jira/browse/IMPALA-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joe McDonnell updated IMPALA-14790:
-----------------------------------
Summary: Various custom cluster tests fail in start-impala-cluster.py with errors in psutil (was: TestCustomStatestore.test_subscriber_fail_on_startup_register_failure failed with errors in psutil)
> Various custom cluster tests fail in start-impala-cluster.py with errors in psutil
> ----------------------------------------------------------------------------------
>
> Key: IMPALA-14790
> URL: https://issues.apache.org/jira/browse/IMPALA-14790
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 5.0.0
> Reporter: Joe McDonnell
> Priority: Critical
>
> An upstream Jenkins nightly job hit this issue:
> {noformat}
> custom_cluster/test_custom_statestore.py:178: in test_subscriber_fail_on_startup_register_failure
> assert False, "cluster startup should have failed"
> E AssertionError: cluster startup should have failed
> E assert False
> self = <tests.custom_cluster.test_custom_statestore.TestCustomStatestore object at 0x7fb72d71f010>During handling of the above exception, another exception occurred:
> custom_cluster/test_custom_statestore.py:180: in test_subscriber_fail_on_startup_register_failure
> self._stop_impala_cluster()
> self = <tests.custom_cluster.test_custom_statestore.TestCustomStatestore object at 0x7fb72d71f010>
> common/custom_cluster_test_suite.py:499: in _stop_impala_cluster
> check_call([os.path.join(IMPALA_HOME, 'bin/start-impala-cluster.py'), '--kill_only'])
> cls = <class 'tests.custom_cluster.test_custom_statestore.TestCustomStatestore'>
> ../toolchain/toolchain-packages-gcc10.4.0/python-3.11.14/lib/python3.11/subprocess.py:413: in check_call
> raise CalledProcessError(retcode, cmd)
> E subprocess.CalledProcessError: Command '['/home/ubuntu/Impala/bin/start-impala-cluster.py', '--kill_only']' returned non-zero exit status 1.
> cmd = ['/home/ubuntu/Impala/bin/start-impala-cluster.py', '--kill_only']
> kwargs = {}
> popenargs = (['/home/ubuntu/Impala/bin/start-impala-cluster.py', '--kill_only'],)
> retcode = 1{noformat}
> There is additional output pointing to psutil:
> {noformat}
> Traceback (most recent call last):
> File "/home/ubuntu/Impala/bin/start-impala-cluster.py", line 1230, in <module>
> cluster_ops.kill_all_daemons(force=options.force_kill)
> File "/home/ubuntu/Impala/bin/start-impala-cluster.py", line 790, in kill_all_daemons
> kill_matching_processes(["catalogd", "impalad", "statestored", "admissiond"], force)
> File "/home/ubuntu/Impala/bin/start-impala-cluster.py", line 307, in kill_matching_processes
> process.wait(KILL_TIMEOUT_IN_SECONDS)
> File "/home/ubuntu/Impala/infra/python/env-gcc10.4.0-py3/lib/python3.11/site-packages/psutil/__init__.py", line 1373, in wait
> self._exitcode = self._proc.wait(timeout)
> ^^^^^^^^^^^^^^^^^^^^^^^^
> File "/home/ubuntu/Impala/infra/python/env-gcc10.4.0-py3/lib/python3.11/site-packages/psutil/_pslinux.py", line 1593, in wrapper
> return fun(self, *args, **kwargs)
> ^^^^^^^^^^^^^^^^^^^^^^^^^^
> File "/home/ubuntu/Impala/infra/python/env-gcc10.4.0-py3/lib/python3.11/site-packages/psutil/_pslinux.py", line 1846, in wait
> return _psposix.wait_pid(self.pid, timeout)
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> File "/home/ubuntu/Impala/infra/python/env-gcc10.4.0-py3/lib/python3.11/site-packages/psutil/_psposix.py", line 304, in wait_pid
> return wait_pid_pidfd_open(pid, timeout)
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> File "/home/ubuntu/Impala/infra/python/env-gcc10.4.0-py3/lib/python3.11/site-packages/psutil/_psposix.py", line 182, in wait_pid_pidfd_open
> pidfd = os.pidfd_open(pid, 0)
> ^^^^^^^^^^^^^^^^^^^^^
> OSError: [Errno 22] Invalid argument{noformat}
> This may be due to our recent upgrade of psutil as part of the Python 3.11 change.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org