You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/04/25 22:49:41 UTC

Build failed in Jenkins: beam_PreCommit_Python_Runners_Cron #445

See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/445/display/redirect>

Changes:


------------------------------------------
[...truncated 1.84 MB...]
target/.tox-py39-cython/py39-cython/lib/python3.9/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/target/.tox-py39-cython/py39-cython/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

target/.tox-py39-cython/py39-cython/lib/python3.9/site-packages/pkg_resources/__init__.py:121
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/target/.tox-py39-cython/py39-cython/lib/python3.9/site-packages/pkg_resources/__init__.py>:121: DeprecationWarning: pkg_resources is deprecated as an API
    warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/pytest_py39-cython_no_xdist.xml> -
========== 2 passed, 2 skipped, 1946 deselected, 2 warnings in 1.75s ===========
py39-cython run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
  py39-cython: commands succeeded
  congratulations :)

> Task :sdks:python:test-suites:tox:py39:preCommitPy39

> Task :sdks:python:test-suites:tox:py37:testPy37Cython
....ss... [ 92%]
.s...................................................................... [ 96%]
........................................s.......................s.Exception in thread fn_api_status_handler:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/apache_beam/runners/worker/worker_status.py",> line 177, in <lambda>
    target=lambda: self._serve(), name='fn_api_status_handler')
  File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/apache_beam/runners/worker/worker_status.py",> line 198, in _serve
    for request in self._status_stub.WorkerStatus(self._get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/grpc/_channel.py",> line 475, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/grpc/_channel.py",> line 881, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Cancelling all calls"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40833 {grpc_message:"Cancelling all calls", grpc_status:14, created_time:"2023-04-25T22:49:26.240779442+00:00"}"
>

...... [100%]
=================================== FAILURES ===================================
_ PortableRunnerTestWithSubprocessesAndMultiWorkers.test_multimap_side_input_type_coercion _
[gw5] linux -- Python 3.7.12 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/target/.tox-py37-cython/py37-cython/bin/python>

self = <apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocessesAndMultiWorkers testMethod=test_multimap_side_input_type_coercion>

    def test_multimap_side_input_type_coercion(self):
      with self.create_pipeline() as p:
        main = p | 'main' >> beam.Create(['a', 'b'])
        # The type of this side-input is forced to Any (overriding type
        # inference). Without type coercion to Tuple[Any, Any], the usage of this
        # side-input in AsMultiMap() below should fail.
        side = (
            p | 'side' >> beam.Create([('a', 1), ('b', 2),
                                       ('a', 3)]).with_output_types(typing.Any))
        assert_that(
            main | beam.Map(
                lambda k, d: (k, sorted(d[k])), beam.pvalue.AsMultiMap(side)),
>           equal_to([('a', [1, 3]), ('b', [2])]))

apache_beam/runners/portability/fn_api_runner/fn_runner_test.py:593: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/pipeline.py:601: in __exit__
    self.result.wait_until_finish()
apache_beam/runners/portability/portable_runner.py:614: in wait_until_finish
    raise self._runtime_exception
apache_beam/runners/portability/portable_runner.py:620: in _observe_state
    for state_response in self._state_stream:
target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/grpc/_channel.py:475: in __next__
    return self._next()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.DEADLINE_EXCEEDED
	details = "Deadline Exc...27.0.0.1:58437 {grpc_message:"Deadline Exceeded", grpc_status:4, created_time:"2023-04-25T22:46:46.774840525+00:00"}"
>

    def _next(self) -> Any:
        with self._state.condition:
            if self._state.code is None:
                event_handler = _event_handler(self._state,
                                               self._response_deserializer)
                self._state.due.add(cygrpc.OperationType.receive_message)
                operating = self._call.operate(
                    (cygrpc.ReceiveMessageOperation(_EMPTY_FLAGS),),
                    event_handler)
                if not operating:
                    self._state.due.remove(cygrpc.OperationType.receive_message)
            elif self._state.code is grpc.StatusCode.OK:
                raise StopIteration()
            else:
                raise self
    
            def _response_ready():
                return (self._state.response is not None or
                        (cygrpc.OperationType.receive_message
                         not in self._state.due and
                         self._state.code is not None))
    
            _common.wait(self._state.condition.wait, _response_ready)
            if self._state.response is not None:
                response = self._state.response
                self._state.response = None
                return response
            elif cygrpc.OperationType.receive_message not in self._state.due:
                if self._state.code is grpc.StatusCode.OK:
                    raise StopIteration()
                elif self._state.code is not None:
>                   raise self
E                   grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
E                   	status = StatusCode.DEADLINE_EXCEEDED
E                   	details = "Deadline Exceeded"
E                   	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:58437 {grpc_message:"Deadline Exceeded", grpc_status:4, created_time:"2023-04-25T22:46:46.774840525+00:00"}"
E                   >

target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/grpc/_channel.py:881: _MultiThreadedRendezvous
----------------------------- Captured stderr call -----------------------------
INFO:apache_beam.runners.portability.abstract_job_service:Running job 'job-be80d11b-ba62-4bad-bba4-f719d4d594d7'
INFO:root:Default Python SDK image for environment is apache/beam_python3.7_sdk:2.48.0.dev
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function annotate_downstream_side_inputs at 0x7f87cebe4290> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function fix_side_input_pcoll_coders at 0x7f87cebe43b0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f87cebe48c0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f87cebe4950> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_sdf at 0x7f87cebe4b00> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_gbk at 0x7f87cebe4b90> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sink_flattens at 0x7f87cebe4cb0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function greedily_fuse at 0x7f87cebe4d40> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function read_to_impulse at 0x7f87cebe4dd0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function impulse_to_input at 0x7f87cebe4e60> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f87cebe50e0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function add_impulse_to_dangling_transforms at 0x7f87cebe5200> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function setup_timer_mapping at 0x7f87cebe5050> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function populate_data_channel_coders at 0x7f87cebe5170> ====================
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting control server on port 39749
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting data server on port 39177
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting state server on port 42949
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting logging server on port 41083
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.SubprocessSdkWorkerHandler object at 0x7f87c41ac250> for environment ref_Environment_default_environment_1 (beam:env:harness_subprocess_python:v1, b'<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/target/.tox-py37-cython/py37-cython/bin/python> -m apache_beam.runners.worker.sdk_worker_main')
E0425 22:45:47.006310358 4119886 ev_epoll1_linux.cc:1141]              ASSERTION FAILED: next_worker->state == KICKED
Exception in thread run_worker:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/apache_beam/runners/portability/local_job_service.py",> line 228, in run
    'Worker subprocess exited with return code %s' % p.returncode)
RuntimeError: Worker subprocess exited with return code -6

INFO:__main__:Listening for beam jobs on port 58437.
INFO:__main__:Listening for beam jobs on port 58437.
=============================== warnings summary ===============================
target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/hdfs/config.py:15
target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/hdfs/config.py:15
target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/hdfs/config.py:15
target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/hdfs/config.py:15
target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/hdfs/config.py:15
target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/hdfs/config.py:15
target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/pkg_resources/__init__.py:121
target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/pkg_resources/__init__.py:121
target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/pkg_resources/__init__.py:121
target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/pkg_resources/__init__.py:121
target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/pkg_resources/__init__.py:121
target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/pkg_resources/__init__.py:121
target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/pkg_resources/__init__.py:121
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/pkg_resources/__init__.py>:121: DeprecationWarning: pkg_resources is deprecated as an API
    warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/pytest_py37-cython.xml> -
=========================== short test summary info ============================
FAILED apache_beam/runners/portability/portable_runner_test.py::PortableRunnerTestWithSubprocessesAndMultiWorkers::test_multimap_side_input_type_coercion
===== 1 failed, 1177 passed, 769 skipped, 14 warnings in 431.76s (0:07:11) =====
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-7.3.1, pluggy-1.0.0
cachedir: target/.tox-py37-cython/py37-cython/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python>
configfile: pytest.ini
plugins: xdist-3.2.1, timeout-2.1.0, hypothesis-6.72.4, requests-mock-1.10.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 1949 items / 1946 deselected / 1 skipped / 3 selected

apache_beam/runners/dataflow/dataflow_exercise_streaming_metrics_pipeline_test.py s [ 33%]
                                                                         [ 33%]
apache_beam/runners/portability/stager_test.py ..                        [100%]

=============================== warnings summary ===============================
target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/pkg_resources/__init__.py:121
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/target/.tox-py37-cython/py37-cython/lib/python3.7/site-packages/pkg_resources/__init__.py>:121: DeprecationWarning: pkg_resources is deprecated as an API
    warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/pytest_py37-cython_no_xdist.xml> -
========== 2 passed, 2 skipped, 1946 deselected, 2 warnings in 1.59s ===========
ERROR: InvocationError for command /bin/bash scripts/run_pytest.sh py37-cython apache_beam/runners (exited with code 1)
py37-cython run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   py37-cython: commands failed

> Task :sdks:python:test-suites:tox:py37:testPy37Cython FAILED

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py37:testPy37Cython'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 34m 11s
26 actionable tasks: 20 executed, 4 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
	at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
	at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
	at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
	at java.lang.reflect.WeakCache.get(WeakCache.java:127)
	at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
	at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
	at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
	at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
	at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:750)

Publishing build scan...
https://gradle.com/s/k5bsmi424jqee

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PreCommit_Python_Runners_Cron #446

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/446/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org