You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/03/25 18:45:17 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Direct #2449
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2449/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14160] Parse filesToStage in Java expansion service (#17167)
------------------------------------------
[...truncated 1.21 MB...]
2022/03/25 18:19:57 Job state: STOPPED
2022/03/25 18:19:57 Job state: STARTING
2022/03/25 18:19:57 Job state: RUNNING
2022/03/25 18:19:57 2022-03-25 18:19:56. (16): starting control server on port 35195
2022/03/25 18:19:57 2022-03-25 18:19:56. (17): starting data server on port 42543
2022/03/25 18:19:57 2022-03-25 18:19:56. (18): starting state server on port 41551
2022/03/25 18:19:57 2022-03-25 18:19:56. (19): starting logging server on port 37067
2022/03/25 18:19:57 2022-03-25 18:19:57. (20): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f99781fdf28> for environment NaJsxZPWSDbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.39.0.dev')
2022/03/25 18:19:59 2022-03-25 18:19:59. (21): Attempting to pull image apache/beam_java8_sdk:2.39.0.dev
2022/03/25 18:19:59 2022-03-25 18:19:59. (22): Unable to pull image apache/beam_java8_sdk:2.39.0.dev, defaulting to local image if it exists
2022/03/25 18:20:01 2022-03-25 18:20:01. (23): Waiting for docker to start up. Current status is running
2022/03/25 18:20:01 2022-03-25 18:20:01. (24): Docker container is running. container_id = b'c5c73707b2172cd50bdd830e2bd2675be8de5fcaae324432876fddc79e066d9e', worker_id = worker_16
2022/03/25 18:20:02 2022-03-25 18:20:02. (25): Running ((((NaJsxZPWSDExternal-JdbcIO-ReadRows-JdbcIO-Read-Create-Values-Read-CreateSource--Impulse)+(NaJsxZPWSDExternal-JdbcIO-ReadRows-JdbcIO-Read-Create-Values-Read-CreateSource--ParDo-OutputSingleSource--ParM))+(External/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/PairWithRestriction))+(External/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/SplitAndSizeRestriction))+(NaJsxZPWSDExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output_split/Write)
2022/03/25 18:20:05 2022-03-25 18:20:05. (26): Running ((((((NaJsxZPWSDExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output_split/Read)+(External/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/Process))+(NaJsxZPWSDExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-ParDo-Read--ParMultiDo-Read-))+(NaJsxZPWSDExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Consume-ParDo-Anonymous--Pa))+(NaJsxZPWSDExternal/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)/ParMultiDo(Read).output/Write))+(NaJsxZPWSDExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-View-AsIterable-MapElements))+(NaJsxZPWSDExternal/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/MapElements/Map/ParMultiDo(Anonymous).output/Write)
2022/03/25 18:20:05 2022-03-25 18:20:05. (27): Running (((((NaJsxZPWSDExternal/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)/ParMultiDo(Read).output/Read)+(NaJsxZPWSDExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Identity-ParMultiDo-Anonymo))+(NaJsxZPWSDExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Pair))+(NaJsxZPWSDExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh))+(NaJsxZPWSDExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh2))+(External/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write)
2022/03/25 18:20:05 2022-03-25 18:20:05. (28): Running (((((External/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read)+(NaJsxZPWSDExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh6))+(NaJsxZPWSDExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh8))+(NaJsxZPWSDExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh11))+(NaJsxZPWSDExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Valu))+(NaJsxZPWSDExternal/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous).output/Write)
2022/03/25 18:20:06 2022-03-25 18:20:06. (29): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f99782c5b70> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2022/03/25 18:20:06 2022-03-25 18:20:06. (30): Attempting to pull image apache/beam_go_sdk:dev
2022/03/25 18:20:06 2022-03-25 18:20:06. (31): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2022/03/25 18:20:09 2022-03-25 18:20:09. (32): Waiting for docker to start up. Current status is running
2022/03/25 18:20:09 2022-03-25 18:20:09. (33): Docker container is running. container_id = b'2703b7a86aefd987195f77bf36c28e008610c5837e29369f3fbc792b6d77acfb', worker_id = worker_17
2022/03/25 18:20:10 2022-03-25 18:20:10. (34): Running ((e2)+(e3))+(n3/Write)
2022/03/25 18:20:10 2022-03-25 18:20:10. (35): Running ((((e4)+(e5))+(n5/Write))+(n6/Write))+(n7/Write)
2022/03/25 18:20:10 2022-03-25 18:20:10. (36): Running (e6)+(e7)
2022/03/25 18:20:15 2022-03-25 18:20:15. (37): Successfully completed job in 18.74679946899414 seconds.
2022/03/25 18:20:15 Job state: DONE
--- PASS: TestJDBCIO_PostgresReadWrite (44.21s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 98.196s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:201: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 3.048s
$ cd ../..
$ exit
$ exit
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:35713 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5253 items / 5243 deselected / 10 selected
apache_beam/io/external/generate_sequence_test.py
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
... [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ....... [100%]
=============================== warnings summary ===============================
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
=========== 10 passed, 5243 deselected, 2 warnings in 135.08 seconds ===========
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:35713 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5253 items / 5243 deselected / 10 selected
apache_beam/io/external/generate_sequence_test.py .ss [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ....... [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
============ 8 passed, 2 skipped, 5243 deselected in 107.33 seconds ============
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:35713 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_sql_expansion_service
============================= test session starts ==============================
platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5253 items / 5244 deselected / 9 selected
apache_beam/transforms/sql_test.py ..F...... [100%]
=================================== FAILURES ===================================
_____________________ SqlTransformTest.test_generate_data ______________________
self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_generate_data>
def test_generate_data(self):
with TestPipeline() as p:
out = p | SqlTransform(
"""SELECT
CAST(1 AS INT) AS `id`,
CAST('foo' AS VARCHAR) AS `str`,
CAST(3.14 AS DOUBLE) AS `flt`""")
> assert_that(out, equal_to([(1, "foo", 3.14)]))
apache_beam/transforms/sql_test.py:79:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/pipeline.py:596: in __exit__
self.result = self.run()
apache_beam/testing/test_pipeline.py:116: in run
state = result.wait_until_finish()
apache_beam/runners/portability/portable_runner.py:600: in wait_until_finish
raise self._runtime_exception
apache_beam/runners/portability/portable_runner.py:606: in _observe_state
for state_response in self._state_stream:
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:426: in __next__
return self._next()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exc...0.1:35713","file":"src/core/lib/surface/call.cc","file_line":905,"grpc_message":"Deadline Exceeded","grpc_status":4}"
>
def _next(self):
with self._state.condition:
if self._state.code is None:
event_handler = _event_handler(self._state,
self._response_deserializer)
self._state.due.add(cygrpc.OperationType.receive_message)
operating = self._call.operate(
(cygrpc.ReceiveMessageOperation(_EMPTY_FLAGS),),
event_handler)
if not operating:
self._state.due.remove(cygrpc.OperationType.receive_message)
elif self._state.code is grpc.StatusCode.OK:
raise StopIteration()
else:
raise self
def _response_ready():
return (self._state.response is not None or
(cygrpc.OperationType.receive_message
not in self._state.due and
self._state.code is not None))
_common.wait(self._state.condition.wait, _response_ready)
if self._state.response is not None:
response = self._state.response
self._state.response = None
return response
elif cygrpc.OperationType.receive_message not in self._state.due:
if self._state.code is grpc.StatusCode.OK:
raise StopIteration()
elif self._state.code is not None:
> raise self
E grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
E status = StatusCode.DEADLINE_EXCEEDED
E details = "Deadline Exceeded"
E debug_error_string = "{"created":"@1648232912.119140843","description":"Error received from peer ipv4:127.0.0.1:35713","file":"src/core/lib/surface/call.cc","file_line":905,"grpc_message":"Deadline Exceeded","grpc_status":4}"
E >
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:826: _MultiThreadedRendezvous
----------------------------- Captured stderr call -----------------------------
WARNING:root:Waiting for grpc channel to be ready at localhost:34503.
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
------------------------------ Captured log call -------------------------------
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:34503.
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
WARNING root:portable_runner.py:570 Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
============ 1 failed, 8 passed, 5244 deselected in 516.48 seconds =============
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
self.run()
File "/usr/lib/python3.6/threading.py", line 864, in run
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 565, in read_messages
for message in self._message_stream:
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 426, in __next__
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "{"created":"@1648232912.120113694","description":"Error received from peer ipv4:127.0.0.1:35713","file":"src/core/lib/surface/call.cc","file_line":905,"grpc_message":"Deadline Exceeded","grpc_status":4}"
>
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 998547.
Stopping expansion service pid: 998548.
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 943207
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 38m 28s
233 actionable tasks: 167 executed, 55 from cache, 11 up-to-date
Publishing build scan...
https://gradle.com/s/weawhu5qqodt2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Direct #2450
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2450/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org