[jira] [Created] (IMPALA-14790) TestCustomStatestore.test_subscriber_fail_on_startup_register_failure failed with errors in psutil

["Joe McDonnell (Jira)" <ji...@apache.org>]

Joe McDonnell created IMPALA-14790:
--------------------------------------

             Summary: TestCustomStatestore.test_subscriber_fail_on_startup_register_failure failed with errors in psutil
                 Key: IMPALA-14790
                 URL: https://issues.apache.org/jira/browse/IMPALA-14790
             Project: IMPALA
          Issue Type: Bug
          Components: Infrastructure
    Affects Versions: Impala 5.0.0
            Reporter: Joe McDonnell


An upstream Jenkins nightly job hit this issue:
{noformat}
custom_cluster/test_custom_statestore.py:178: in test_subscriber_fail_on_startup_register_failure
    assert False, "cluster startup should have failed"
E   AssertionError: cluster startup should have failed
E   assert False
        self       = <tests.custom_cluster.test_custom_statestore.TestCustomStatestore object at 0x7fb72d71f010>During handling of the above exception, another exception occurred:
custom_cluster/test_custom_statestore.py:180: in test_subscriber_fail_on_startup_register_failure
    self._stop_impala_cluster()
        self       = <tests.custom_cluster.test_custom_statestore.TestCustomStatestore object at 0x7fb72d71f010>
common/custom_cluster_test_suite.py:499: in _stop_impala_cluster
    check_call([os.path.join(IMPALA_HOME, 'bin/start-impala-cluster.py'), '--kill_only'])
        cls        = <class 'tests.custom_cluster.test_custom_statestore.TestCustomStatestore'>
../toolchain/toolchain-packages-gcc10.4.0/python-3.11.14/lib/python3.11/subprocess.py:413: in check_call
    raise CalledProcessError(retcode, cmd)
E   subprocess.CalledProcessError: Command '['/home/ubuntu/Impala/bin/start-impala-cluster.py', '--kill_only']' returned non-zero exit status 1.
        cmd        = ['/home/ubuntu/Impala/bin/start-impala-cluster.py', '--kill_only']
        kwargs     = {}
        popenargs  = (['/home/ubuntu/Impala/bin/start-impala-cluster.py', '--kill_only'],)
        retcode    = 1{noformat}
There is additional output pointing to psutil:
{noformat}
Traceback (most recent call last):
  File "/home/ubuntu/Impala/bin/start-impala-cluster.py", line 1230, in <module>
    cluster_ops.kill_all_daemons(force=options.force_kill)
  File "/home/ubuntu/Impala/bin/start-impala-cluster.py", line 790, in kill_all_daemons
    kill_matching_processes(["catalogd", "impalad", "statestored", "admissiond"], force)
  File "/home/ubuntu/Impala/bin/start-impala-cluster.py", line 307, in kill_matching_processes
    process.wait(KILL_TIMEOUT_IN_SECONDS)
  File "/home/ubuntu/Impala/infra/python/env-gcc10.4.0-py3/lib/python3.11/site-packages/psutil/__init__.py", line 1373, in wait
    self._exitcode = self._proc.wait(timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/Impala/infra/python/env-gcc10.4.0-py3/lib/python3.11/site-packages/psutil/_pslinux.py", line 1593, in wrapper
    return fun(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/Impala/infra/python/env-gcc10.4.0-py3/lib/python3.11/site-packages/psutil/_pslinux.py", line 1846, in wait
    return _psposix.wait_pid(self.pid, timeout)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/Impala/infra/python/env-gcc10.4.0-py3/lib/python3.11/site-packages/psutil/_psposix.py", line 304, in wait_pid
    return wait_pid_pidfd_open(pid, timeout)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/Impala/infra/python/env-gcc10.4.0-py3/lib/python3.11/site-packages/psutil/_psposix.py", line 182, in wait_pid_pidfd_open
    pidfd = os.pidfd_open(pid, 0)
            ^^^^^^^^^^^^^^^^^^^^^
OSError: [Errno 22] Invalid argument{noformat}
This may be due to our recent upgrade of psutil as part of the Python 3.11 change.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)