You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/03/23 01:02:29 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Direct #2438
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2438/display/redirect?page=changes>
Changes:
[noreply] Revert "[BEAM-14038] Auto-startup for Python expansion service.
[noreply] Minor: Bump timeout for Java PreCommit (#17157)
[noreply] [BEAM-14152] Disable flaky
[noreply] Fixing a small bug in TypedSchemaTransformTest that caused it to flake.
------------------------------------------
[...truncated 1.21 MB...]
2022/03/23 00:26:36 2022-03-23 00:26:36. (10): ==================== <function greedily_fuse at 0x7f2e70fa09d8> ====================
2022/03/23 00:26:36 2022-03-23 00:26:36. (11): ==================== <function read_to_impulse at 0x7f2e70fa0a60> ====================
2022/03/23 00:26:36 2022-03-23 00:26:36. (12): ==================== <function impulse_to_input at 0x7f2e70fa0ae8> ====================
2022/03/23 00:26:36 2022-03-23 00:26:36. (13): ==================== <function sort_stages at 0x7f2e70fa0d08> ====================
2022/03/23 00:26:36 2022-03-23 00:26:36. (14): ==================== <function setup_timer_mapping at 0x7f2e70fa0c80> ====================
2022/03/23 00:26:36 2022-03-23 00:26:36. (15): ==================== <function populate_data_channel_coders at 0x7f2e70fa0d90> ====================
2022/03/23 00:26:36 2022-03-23 00:26:36. (16): starting control server on port 38541
2022/03/23 00:26:36 2022-03-23 00:26:36. (17): starting data server on port 37531
2022/03/23 00:26:36 2022-03-23 00:26:36. (18): starting state server on port 45019
2022/03/23 00:26:36 2022-03-23 00:26:36. (19): starting logging server on port 43537
2022/03/23 00:26:36 2022-03-23 00:26:36. (20): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2e7062edd8> for environment tzoWGNsTKEbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.38.0.dev')
2022/03/23 00:26:36 2022-03-23 00:26:36. (21): Attempting to pull image apache/beam_java8_sdk:2.38.0.dev
2022/03/23 00:26:36 2022-03-23 00:26:36. (22): Unable to pull image apache/beam_java8_sdk:2.38.0.dev, defaulting to local image if it exists
2022/03/23 00:26:40 2022-03-23 00:26:40. (23): Waiting for docker to start up. Current status is running
2022/03/23 00:26:40 2022-03-23 00:26:40. (24): Docker container is running. container_id = b'5e17fde7df52eff7fed43d38622b40305671cdd2f630e1ee3f8d544b99fc0b1a', worker_id = worker_16
2022/03/23 00:26:42 2022-03-23 00:26:42. (25): Running ((((tzoWGNsTKEExternal-JdbcIO-ReadRows-JdbcIO-Read-Create-Values-Read-CreateSource--Impulse)+(tzoWGNsTKEExternal-JdbcIO-ReadRows-JdbcIO-Read-Create-Values-Read-CreateSource--ParDo-OutputSingleSource--ParM))+(External/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/PairWithRestriction))+(External/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/SplitAndSizeRestriction))+(tzoWGNsTKEExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output_split/Write)
2022/03/23 00:26:46 2022-03-23 00:26:46. (26): Running ((((((tzoWGNsTKEExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output_split/Read)+(External/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/Process))+(tzoWGNsTKEExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-ParDo-Read--ParMultiDo-Read-))+(tzoWGNsTKEExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Consume-ParDo-Anonymous--Pa))+(tzoWGNsTKEExternal/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)/ParMultiDo(Read).output/Write))+(tzoWGNsTKEExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-View-AsIterable-MapElements))+(tzoWGNsTKEExternal/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/MapElements/Map/ParMultiDo(Anonymous).output/Write)
2022/03/23 00:26:47 2022-03-23 00:26:47. (27): Running (((((tzoWGNsTKEExternal/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)/ParMultiDo(Read).output/Read)+(tzoWGNsTKEExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Identity-ParMultiDo-Anonymo))+(tzoWGNsTKEExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Pair))+(tzoWGNsTKEExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh))+(tzoWGNsTKEExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh2))+(External/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write)
2022/03/23 00:26:47 2022-03-23 00:26:47. (28): Running (((((External/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read)+(tzoWGNsTKEExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh6))+(tzoWGNsTKEExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh8))+(tzoWGNsTKEExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh11))+(tzoWGNsTKEExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Valu))+(tzoWGNsTKEExternal/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous).output/Write)
2022/03/23 00:26:48 2022-03-23 00:26:48. (29): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2e70549f28> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2022/03/23 00:26:48 2022-03-23 00:26:48. (30): Attempting to pull image apache/beam_go_sdk:dev
2022/03/23 00:26:49 2022-03-23 00:26:49. (31): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2022/03/23 00:26:51 2022-03-23 00:26:51. (32): Waiting for docker to start up. Current status is running
2022/03/23 00:26:51 2022-03-23 00:26:51. (33): Docker container is running. container_id = b'ddc294cae764b536beb5d82a94cc233c0cd19819a7372631ddaaedb076788df1', worker_id = worker_19
2022/03/23 00:26:52 2022-03-23 00:26:52. (34): Running ((e2)+(e3))+(n3/Write)
2022/03/23 00:26:53 2022-03-23 00:26:53. (35): Running ((((e4)+(e5))+(n6/Write))+(n5/Write))+(n7/Write)
2022/03/23 00:26:53 2022-03-23 00:26:53. (36): Running (e6)+(e7)
2022/03/23 00:26:56 2022-03-23 00:26:56. (37): Successfully completed job in 20.03839945793152 seconds.
2022/03/23 00:26:56 Job state: DONE
--- PASS: TestJDBCIO_PostgresReadWrite (52.22s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 125.603s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:201: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 3.051s
$ cd ../..
$ exit
$ exit
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:39261 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
collected 5253 items / 5243 deselected / 10 selected
apache_beam/io/external/generate_sequence_test.py ... [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py .F..... [100%]
=================================== FAILURES ===================================
________________ ValidateRunnerXlangTest.test_combine_globally _________________
self = <apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest testMethod=test_combine_globally>
test_pipeline = None
@pytest.mark.xlang_transforms
def test_combine_globally(self, test_pipeline=None):
CrossLanguageTestPipelines().run_combine_globally(
> test_pipeline or self.create_pipeline())
apache_beam/transforms/validate_runner_xlang_test.py:274:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/transforms/validate_runner_xlang_test.py:182: in run_combine_globally
assert_that(res, equal_to([6]))
apache_beam/pipeline.py:596: in __exit__
self.result = self.run()
apache_beam/testing/test_pipeline.py:116: in run
state = result.wait_until_finish()
apache_beam/runners/portability/portable_runner.py:600: in wait_until_finish
raise self._runtime_exception
apache_beam/runners/portability/portable_runner.py:606: in _observe_state
for state_response in self._state_stream:
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:426: in __next__
return self._next()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exc...0.1:39261","file":"src/core/lib/surface/call.cc","file_line":903,"grpc_message":"Deadline Exceeded","grpc_status":4}"
>
def _next(self):
with self._state.condition:
if self._state.code is None:
event_handler = _event_handler(self._state,
self._response_deserializer)
self._state.due.add(cygrpc.OperationType.receive_message)
operating = self._call.operate(
(cygrpc.ReceiveMessageOperation(_EMPTY_FLAGS),),
event_handler)
if not operating:
self._state.due.remove(cygrpc.OperationType.receive_message)
elif self._state.code is grpc.StatusCode.OK:
raise StopIteration()
else:
raise self
def _response_ready():
return (self._state.response is not None or
(cygrpc.OperationType.receive_message
not in self._state.due and
self._state.code is not None))
_common.wait(self._state.condition.wait, _response_ready)
if self._state.response is not None:
response = self._state.response
self._state.response = None
return response
elif cygrpc.OperationType.receive_message not in self._state.due:
if self._state.code is grpc.StatusCode.OK:
raise StopIteration()
elif self._state.code is not None:
> raise self
E grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
E status = StatusCode.DEADLINE_EXCEEDED
E details = "Deadline Exceeded"
E debug_error_string = "{"created":"@1647995528.230188377","description":"Error received from peer ipv4:127.0.0.1:39261","file":"src/core/lib/surface/call.cc","file_line":903,"grpc_message":"Deadline Exceeded","grpc_status":4}"
E >
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:826: _MultiThreadedRendezvous
----------------------------- Captured stderr call -----------------------------
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
WARNING root:portable_runner.py:570 Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
=============================== warnings summary ===============================
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
====== 1 failed, 9 passed, 5243 deselected, 2 warnings in 339.06 seconds =======
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
self.run()
File "/usr/lib/python3.6/threading.py", line 864, in run
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 565, in read_messages
for message in self._message_stream:
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 426, in __next__
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "{"created":"@1647995528.232131833","description":"Error received from peer ipv4:127.0.0.1:39261","file":"src/core/lib/surface/call.cc","file_line":903,"grpc_message":"Deadline Exceeded","grpc_status":4}"
>
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:39261 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5253 items / 5243 deselected / 10 selected
apache_beam/io/external/generate_sequence_test.py .ss [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ....... [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
============ 8 passed, 2 skipped, 5243 deselected in 108.73 seconds ============
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:39261 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_sql_expansion_service
============================= test session starts ==============================
platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5253 items / 5244 deselected / 9 selected
apache_beam/transforms/sql_test.py ......... [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
================= 9 passed, 5244 deselected in 407.09 seconds ==================
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 4033083.
Stopping expansion service pid: 4033084.
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 4001846
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 53m 1s
233 actionable tasks: 163 executed, 59 from cache, 11 up-to-date
Publishing build scan...
https://gradle.com/s/5ynflqlybevzs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Direct #2440
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2440/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #2439
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2439/display/redirect?page=changes>
Changes:
[chamikaramj] Disable BigQueryIOStorageWriteIT for general Java post-commit
[noreply] [BEAM-14116] Catch MonitoringInfoMetricName null keys or values in the
[noreply] [BEAM-14129] Restructure SubscriptionPartitionLoader to use a manual SDF
[noreply] [BEAM-13015] Avoid repeated weighing of StateKey in
[noreply] Add option to add modules to JDK add-open (#17110)
[noreply] [BEAM-13015] Clarify ownership of the list for state caching across
------------------------------------------
[...truncated 1.24 MB...]
2022/03/23 06:33:46 2022-03-23 06:33:46. (14): ==================== <function setup_timer_mapping at 0x7f7b196d1c80> ====================
2022/03/23 06:33:46 2022-03-23 06:33:46. (15): ==================== <function populate_data_channel_coders at 0x7f7b196d1d90> ====================
2022/03/23 06:33:46 2022-03-23 06:33:46. (16): starting control server on port 40475
2022/03/23 06:33:46 2022-03-23 06:33:46. (17): starting data server on port 43925
2022/03/23 06:33:46 2022-03-23 06:33:46. (18): starting state server on port 40819
2022/03/23 06:33:46 2022-03-23 06:33:46. (19): starting logging server on port 36291
2022/03/23 06:33:46 2022-03-23 06:33:46. (20): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f7b18473358> for environment reSPeRvYWdbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.38.0.dev')
2022/03/23 06:33:46 2022-03-23 06:33:46. (21): Attempting to pull image apache/beam_java8_sdk:2.38.0.dev
2022/03/23 06:33:48 2022-03-23 06:33:48. (22): Unable to pull image apache/beam_java8_sdk:2.38.0.dev, defaulting to local image if it exists
2022/03/23 06:33:51 2022-03-23 06:33:51. (23): Waiting for docker to start up. Current status is running
2022/03/23 06:33:51 2022-03-23 06:33:51. (24): Docker container is running. container_id = b'daf71e46903779975dc4701a78d09f11eeed658fa19b8daa4160db0072c0ad1d', worker_id = worker_16
2022/03/23 06:33:52 2022-03-23 06:33:52. (25): Running ((((reSPeRvYWdExternal-JdbcIO-ReadRows-JdbcIO-Read-Create-Values-Read-CreateSource--Impulse)+(reSPeRvYWdExternal-JdbcIO-ReadRows-JdbcIO-Read-Create-Values-Read-CreateSource--ParDo-OutputSingleSource--ParM))+(External/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/PairWithRestriction))+(External/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/SplitAndSizeRestriction))+(reSPeRvYWdExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output_split/Write)
2022/03/23 06:34:03 2022-03-23 06:34:03. (26): Running ((((((reSPeRvYWdExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output_split/Read)+(External/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/Process))+(reSPeRvYWdExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-ParDo-Read--ParMultiDo-Read-))+(reSPeRvYWdExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Consume-ParDo-Anonymous--Pa))+(reSPeRvYWdExternal/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)/ParMultiDo(Read).output/Write))+(reSPeRvYWdExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-View-AsIterable-MapElements))+(reSPeRvYWdExternal/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/MapElements/Map/ParMultiDo(Anonymous).output/Write)
2022/03/23 06:34:06 2022-03-23 06:34:06. (27): Running (((((reSPeRvYWdExternal/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)/ParMultiDo(Read).output/Read)+(reSPeRvYWdExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Identity-ParMultiDo-Anonymo))+(reSPeRvYWdExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Pair))+(reSPeRvYWdExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh))+(reSPeRvYWdExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh2))+(External/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write)
2022/03/23 06:34:06 2022-03-23 06:34:06. (28): Running (((((External/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read)+(reSPeRvYWdExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh6))+(reSPeRvYWdExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh8))+(reSPeRvYWdExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Resh11))+(reSPeRvYWdExternal-JdbcIO-ReadRows-JdbcIO-Read-JdbcIO-ReadAll-JdbcIO-Reparallelize-Reshuffle-ViaRandomKey-Valu))+(reSPeRvYWdExternal/JdbcIO.ReadRows/JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous).output/Write)
2022/03/23 06:34:07 2022-03-23 06:34:07. (29): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f7b18483be0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2022/03/23 06:34:09 2022-03-23 06:34:09. (30): Attempting to pull image apache/beam_go_sdk:dev
2022/03/23 06:34:10 2022-03-23 06:34:10. (31): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2022/03/23 06:34:39 2022-03-23 06:34:39. (32): Waiting for docker to start up. Current status is running
2022/03/23 06:34:39 2022-03-23 06:34:39. (33): Docker container is running. container_id = b'76c07704c833da18aa3aebe7634fd40857a73c9f86fd28d9d6474f8e77e9feb3', worker_id = worker_17
2022/03/23 06:34:41 2022-03-23 06:34:41. (34): Running ((e2)+(e3))+(n3/Write)
2022/03/23 06:34:41 2022-03-23 06:34:41. (35): Running ((((e4)+(e5))+(n5/Write))+(n6/Write))+(n7/Write)
2022/03/23 06:34:41 2022-03-23 06:34:41. (36): Running (e6)+(e7)
2022/03/23 06:35:15 2022-03-23 06:35:15. (37): Successfully completed job in 88.68113946914673 seconds.
2022/03/23 06:35:15 Job state: DONE
--- PASS: TestJDBCIO_PostgresReadWrite (148.39s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 264.852s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:201: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 3.080s
$ cd ../..
$ exit
$ exit
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:39249 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
collected 5253 items / 5243 deselected / 10 selected
apache_beam/io/external/generate_sequence_test.py F.. [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ....... [100%]
=================================== FAILURES ===================================
_______________ XlangGenerateSequenceTest.test_generate_sequence _______________
self = <apache_beam.io.external.generate_sequence_test.XlangGenerateSequenceTest testMethod=test_generate_sequence>
def test_generate_sequence(self):
port = os.environ.get('EXPANSION_PORT')
address = 'localhost:%s' % port
try:
with TestPipeline() as p:
res = (
p
| GenerateSequence(start=1, stop=10, expansion_service=address))
> assert_that(res, equal_to(list(range(1, 10))))
apache_beam/io/external/generate_sequence_test.py:53:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/pipeline.py:596: in __exit__
self.result = self.run()
apache_beam/testing/test_pipeline.py:116: in run
state = result.wait_until_finish()
apache_beam/runners/portability/portable_runner.py:600: in wait_until_finish
raise self._runtime_exception
apache_beam/runners/portability/portable_runner.py:606: in _observe_state
for state_response in self._state_stream:
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:426: in __next__
return self._next()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exc...0.1:39249","file":"src/core/lib/surface/call.cc","file_line":903,"grpc_message":"Deadline Exceeded","grpc_status":4}"
>
def _next(self):
with self._state.condition:
if self._state.code is None:
event_handler = _event_handler(self._state,
self._response_deserializer)
self._state.due.add(cygrpc.OperationType.receive_message)
operating = self._call.operate(
(cygrpc.ReceiveMessageOperation(_EMPTY_FLAGS),),
event_handler)
if not operating:
self._state.due.remove(cygrpc.OperationType.receive_message)
elif self._state.code is grpc.StatusCode.OK:
raise StopIteration()
else:
raise self
def _response_ready():
return (self._state.response is not None or
(cygrpc.OperationType.receive_message
not in self._state.due and
self._state.code is not None))
_common.wait(self._state.condition.wait, _response_ready)
if self._state.response is not None:
response = self._state.response
self._state.response = None
return response
elif cygrpc.OperationType.receive_message not in self._state.due:
if self._state.code is grpc.StatusCode.OK:
raise StopIteration()
elif self._state.code is not None:
> raise self
E grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
E status = StatusCode.DEADLINE_EXCEEDED
E details = "Deadline Exceeded"
E debug_error_string = "{"created":"@1648017773.021027784","description":"Error received from peer ipv4:127.0.0.1:39249","file":"src/core/lib/surface/call.cc","file_line":903,"grpc_message":"Deadline Exceeded","grpc_status":4}"
E >
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:826: _MultiThreadedRendezvous
----------------------------- Captured stderr call -----------------------------
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
WARNING root:portable_runner.py:570 Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
=============================== warnings summary ===============================
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
====== 1 failed, 9 passed, 5243 deselected, 2 warnings in 540.76 seconds =======
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
self.run()
File "/usr/lib/python3.6/threading.py", line 864, in run
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 565, in read_messages
for message in self._message_stream:
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 426, in __next__
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "{"created":"@1648017773.023020472","description":"Error received from peer ipv4:127.0.0.1:39249","file":"src/core/lib/surface/call.cc","file_line":903,"grpc_message":"Deadline Exceeded","grpc_status":4}"
>
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:39249 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5253 items / 5243 deselected / 10 selected
apache_beam/io/external/generate_sequence_test.py .ss [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ....... [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
============ 8 passed, 2 skipped, 5243 deselected in 183.36 seconds ============
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:39249 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_sql_expansion_service
============================= test session starts ==============================
platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5253 items / 5244 deselected / 9 selected
apache_beam/transforms/sql_test.py ......... [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
================= 9 passed, 5244 deselected in 718.83 seconds ==================
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1577990.
Stopping expansion service pid: 1577991.
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1559158
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 54s
233 actionable tasks: 182 executed, 40 from cache, 11 up-to-date
Publishing build scan...
https://gradle.com/s/o4fd2ieuiujf2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org