You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/06/19 00:42:41 UTC

Build failed in Jenkins: beam_PostCommit_XVR_Direct #1351

See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1351/display/redirect?page=changes>

Changes:

[heejong] [BEAM-12389] fix xlang validate runner test flakiness

[noreply] Fix job configuration additional_bq_parameters reference link

[noreply] Merge pull request #14745 from [BEAM-11359] Removed temporary dataset

[noreply] Merge pull request #14690 from [BEAM-12445] Moving streaming inserts

[noreply] [BEAM-12074] Make sure all GroupBy operations have docstrings (#14963)


------------------------------------------
[...truncated 1.25 MB...]
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
ERROR    root:portable_runner.py:570 Error running pipeline.
                                     Traceback (most recent call last):
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/local_job_service.py",> line 274, in _run_job
                                         self._pipeline_proto)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 206, in run_via_runner_api
                                         return self.run_stages(stage_context, stages)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 385, in run_stages
                                         runner_execution_context, bundle_context_manager)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 653, in _run_stage
                                         bundle_manager))
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 770, in _run_bundle
                                         data_input, data_output, input_timers, expected_timer_output)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1120, in process_bundle
                                         raise RuntimeError(result.error)
                                     RuntimeError: Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 285, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
============ 2 failed, 7 passed, 4753 deselected in 243.88 seconds =============

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 28021.
Stopping expansion service pid: 28024.

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 13889

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 42m 10s
168 actionable tasks: 163 executed, 1 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/nfzunarlgqirw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_XVR_Direct #1366

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1366/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #1364

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1364/display/redirect>

Changes:


------------------------------------------
[...truncated 1.23 MB...]
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
ERROR    root:portable_runner.py:570 Error running pipeline.
                                     Traceback (most recent call last):
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/local_job_service.py",> line 274, in _run_job
                                         self._pipeline_proto)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 206, in run_via_runner_api
                                         return self.run_stages(stage_context, stages)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 385, in run_stages
                                         runner_execution_context, bundle_context_manager)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 653, in _run_stage
                                         bundle_manager))
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 770, in _run_bundle
                                         data_input, data_output, input_timers, expected_timer_output)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1120, in process_bundle
                                         raise RuntimeError(result.error)
                                     RuntimeError: Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 285, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
============ 2 failed, 7 passed, 4757 deselected in 165.85 seconds =============

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 29631.
Stopping expansion service pid: 29634.

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 25701

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 28m 25s
168 actionable tasks: 121 executed, 43 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/ies2fnmqkmu2e

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #1363

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1363/display/redirect>

Changes:


------------------------------------------
[...truncated 1.23 MB...]
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
ERROR    root:portable_runner.py:570 Error running pipeline.
                                     Traceback (most recent call last):
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/local_job_service.py",> line 274, in _run_job
                                         self._pipeline_proto)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 206, in run_via_runner_api
                                         return self.run_stages(stage_context, stages)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 385, in run_stages
                                         runner_execution_context, bundle_context_manager)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 653, in _run_stage
                                         bundle_manager))
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 770, in _run_bundle
                                         data_input, data_output, input_timers, expected_timer_output)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1120, in process_bundle
                                         raise RuntimeError(result.error)
                                     RuntimeError: Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 285, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
============ 2 failed, 7 passed, 4757 deselected in 193.93 seconds =============

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 15886.
Stopping expansion service pid: 15889.

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 25921

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 35m 11s
168 actionable tasks: 121 executed, 43 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/ryfm6mfuo3meu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #1362

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1362/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Support AsMultimap for legacy runners.

[noreply] [BEAM-12514] fixed table_ref parsing when table_reference is a

[noreply] Added changelog for BEAM-12514

[Robert Bradshaw] Better default windowing for zero-input PTransforms.

[Robert Bradshaw] Coder cleanups.


------------------------------------------
[...truncated 65.47 KB...]
Executing <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/container/build/reports/dependency-license/index.json>        --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/container/build/target/java_third_party_licenses>        --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> 
INFO:root:Pulling license for 208 dependencies using 16 threads.

> Task :sdks:java:container:java8:copyDockerfileDependencies

> Task :sdks:python:sdist
RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2.py>
RefactoringTool: No changes to <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/schema_pb2.py>
RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2.py>
RefactoringTool: Files that were modified:
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_grpc.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2_grpc.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2_grpc.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/beam_interactive_api_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2_grpc.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2_grpc.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_grpc.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/endpoints_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/schema_pb2.py>
RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2.py>
INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2_urns.py>
INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_urns.py>
INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2_urns.py>
INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_urns.py>
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md


> Task :sdks:java:extensions:sql:compileJava FROM-CACHE
> Task :sdks:java:extensions:sql:classes
> Task :sdks:java:extensions:sql:jar
> Task :sdks:java:extensions:sql:zetasql:compileJava FROM-CACHE
> Task :sdks:java:extensions:sql:zetasql:classes UP-TO-DATE

> Task :sdks:go:resolveBuildDependencies
Resolving github.com/magiconair/properties: commit='49d762b9817ba1c2e9d0c69183c2b4a8b8f1d934', urls=[https://github.com/magiconair/properties.git, git@github.com:magiconair/properties.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/mitchellh/go-homedir: commit='b8bc1bf767474819792c23f32d8286a45736f1c6', urls=[https://github.com/mitchellh/go-homedir.git, git@github.com:mitchellh/go-homedir.git]
Resolving github.com/mitchellh/mapstructure: commit='a4e142e9c047c904fa2f1e144d9a84e6133024bc', urls=[https://github.com/mitchellh/mapstructure.git, git@github.com:mitchellh/mapstructure.git]
Resolving github.com/nightlyone/lockfile: commit='0ad87eef1443f64d3d8c50da647e2b1552851124', urls=[https://github.com/nightlyone/lockfile, git@github.com:nightlyone/lockfile.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/openzipkin/zipkin-go: commit='3741243b287094fda649c7f0fa74bd51f37dc122', urls=[https://github.com/openzipkin/zipkin-go.git, git@github.com:openzipkin/zipkin-go.git]
Resolving github.com/pelletier/go-toml: commit='acdc4509485b587f5e675510c4f2c63e90ff68a8', urls=[https://github.com/pelletier/go-toml.git, git@github.com:pelletier/go-toml.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/pierrec/lz4: commit='ed8d4cc3b461464e69798080a0092bd028910298', urls=[https://github.com/pierrec/lz4.git, git@github.com:pierrec/lz4.git]
Resolving github.com/pierrec/xxHash: commit='a0006b13c722f7f12368c00a3d3c2ae8a999a0c6', urls=[https://github.com/pierrec/xxHash.git, git@github.com:pierrec/xxHash.git]
Resolving github.com/pkg/errors: commit='30136e27e2ac8d167177e8a583aa4c3fea5be833', urls=[https://github.com/pkg/errors.git, git@github.com:pkg/errors.git]
Resolving github.com/pkg/sftp: commit='22e9c1ccc02fc1b9fa3264572e49109b68a86947', urls=[https://github.com/pkg/sftp.git, git@github.com:pkg/sftp.git]
Resolving github.com/prometheus/client_golang: commit='9bb6ab929dcbe1c8393cd9ef70387cb69811bd1c', urls=[https://github.com/prometheus/client_golang.git, git@github.com:prometheus/client_golang.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]

> Task :sdks:java:extensions:sql:zetasql:jar
> Task :sdks:java:extensions:sql:expansion-service:compileJava FROM-CACHE
> Task :sdks:java:extensions:sql:expansion-service:classes UP-TO-DATE
> Task :sdks:java:testing:expansion-service:buildTestExpansionServiceJar FROM-CACHE
> Task :sdks:python:container:py36:copyDockerfileDependencies

> Task :sdks:go:resolveBuildDependencies
Resolving github.com/prometheus/procfs: commit='cb4147076ac75738c9a7d279075a253c0cc5acbd', urls=[https://github.com/prometheus/procfs.git, git@github.com:prometheus/procfs.git]
Resolving github.com/rcrowley/go-metrics: commit='8732c616f52954686704c8645fe1a9d59e9df7c1', urls=[https://github.com/rcrowley/go-metrics.git, git@github.com:rcrowley/go-metrics.git]
Resolving github.com/cpuguy83/go-md2man: commit='dc9f53734905c233adfc09fd4f063dce63ce3daf', urls=[https://github.com/cpuguy83/go-md2man.git, git@github.com:cpuguy83/go-md2man.git]
Resolving cached github.com/cpuguy83/go-md2man: commit='dc9f53734905c233adfc09fd4f063dce63ce3daf', urls=[https://github.com/cpuguy83/go-md2man.git, git@github.com:cpuguy83/go-md2man.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/spf13/afero: commit='bb8f1927f2a9d3ab41c9340aa034f6b803f4359c', urls=[https://github.com/spf13/afero.git, git@github.com:spf13/afero.git]
Resolving github.com/spf13/cast: commit='acbeb36b902d72a7a4c18e8f3241075e7ab763e4', urls=[https://github.com/spf13/cast.git, git@github.com:spf13/cast.git]
Resolving github.com/spf13/cobra: commit='93959269ad99e80983c9ba742a7e01203a4c0e4f', urls=[https://github.com/spf13/cobra.git, git@github.com:spf13/cobra.git]
Resolving github.com/spf13/jwalterweatherman: commit='7c0cea34c8ece3fbeb2b27ab9b59511d360fb394', urls=[https://github.com/spf13/jwalterweatherman.git, git@github.com:spf13/jwalterweatherman.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/spf13/viper: commit='aafc9e6bc7b7bb53ddaa75a5ef49a17d6e654be5', urls=[https://github.com/spf13/viper.git, git@github.com:spf13/viper.git]
Resolving github.com/stathat/go: commit='74669b9f388d9d788c97399a0824adbfee78400e', urls=[https://github.com/stathat/go.git, git@github.com:stathat/go.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/xordataexchange/crypt: commit='b2862e3d0a775f18c7cfe02273500ae307b61218', urls=[https://github.com/xordataexchange/crypt.git, git@github.com:xordataexchange/crypt.git]
Resolving go.opencensus.io: commit='3fb168f674736c026e623310bfccb0691e6dec8a', urls=[https://github.com/census-instrumentation/opencensus-go]
Resolving golang.org/x/crypto: commit='d9133f5469342136e669e85192a26056b587f503', urls=[https://go.googlesource.com/crypto]

> Task :sdks:java:container:pullLicenses
INFO:root:pull_licenses_java.py succeed. It took 4.512954 seconds with 16 threads.
Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh

> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses NO-SOURCE

> Task :sdks:python:installGcpTest
Processing ./build/apache-beam.tar.gz

> Task :sdks:java:extensions:sql:expansion-service:shadowJar FROM-CACHE

> Task :sdks:go:resolveBuildDependencies
Resolving golang.org/x/debug: commit='95515998a8a4bd7448134b2cb5971dbeb12e0b77', urls=[https://go.googlesource.com/debug]
Resolving golang.org/x/net: commit='2fb46b16b8dda405028c50f7c7f0f9dd1fa6bfb1', urls=[https://go.googlesource.com/net]
Resolving golang.org/x/oauth2: commit='5d25da1a8d43b66f2898c444f899c7bcfd6a407e', urls=[https://go.googlesource.com/oauth2]
Resolving golang.org/x/sync: commit='fd80eb99c8f653c847d294a001bdf2a3a6f768f5', urls=[https://go.googlesource.com/sync]
Resolving golang.org/x/sys: commit='fde4db37ae7ad8191b03d30d27f258b5291ae4e3', urls=[https://go.googlesource.com/sys]

> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses

> Task :release:go-licenses:py:dockerRun
+ go-licenses save github.com/apache/beam/sdks/python/container --save_path=/output/licenses
+ tee /output/licenses/list.csv
+ go-licenses csv github.com/apache/beam/sdks/python/container

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerSetup
Waiting for server to start up...
Server started at port 40841

> Task :release:go-licenses:java:dockerRun
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
+ chmod -R a+w /output/licenses

> Task :sdks:go:resolveBuildDependencies
Resolving golang.org/x/text: commit='23ae387dee1f90d29a23c0e87ee0b46038fbed0e', urls=[https://go.googlesource.com/text]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]

> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses

> Task :release:go-licenses:py:dockerRun
github.com/apache/beam/sdks/python/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/nightlyone/lockfile,https://github.com/nightlyone/lockfile/blob/master/LICENSE,MIT
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses

> Task :release:go-licenses:py:createLicenses
> Task :sdks:python:container:py36:copyGolangLicenses

> Task :sdks:go:resolveBuildDependencies
Resolving google.golang.org/api: commit='0324d5e90dc7753607860272666845fad9ceb97e', urls=[https://code.googlesource.com/google-api-go-client]
Resolving google.golang.org/genproto: commit='4d944d34d83c502a5f761500a14d8842648415c3', urls=[https://github.com/google/go-genproto]
Resolving google.golang.org/grpc: commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58', urls=[https://github.com/grpc/grpc-go]
Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]

> Task :sdks:go:installDependencies
> Task :sdks:go:buildLinuxAmd64
> Task :sdks:go:goBuild

> Task :sdks:python:container:resolveBuildDependencies
Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go>

> Task :sdks:java:container:resolveBuildDependencies
Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go>

> Task :sdks:python:container:installDependencies
> Task :sdks:java:container:installDependencies
> Task :sdks:python:container:buildDarwinAmd64
> Task :sdks:java:container:buildLinuxAmd64
> Task :sdks:java:container:goBuild
> Task :sdks:java:container:java8:copySdkHarnessLauncher
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:python:container:buildLinuxAmd64
> Task :sdks:python:container:goBuild
> Task :sdks:python:container:py36:copyLauncherDependencies
> Task :sdks:python:container:py36:dockerPrepare
> Task :sdks:java:container:java8:docker
> Task :sdks:python:container:py36:docker
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerSetup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 38m 39s
168 actionable tasks: 121 executed, 43 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/kg6aure3gumrc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #1361

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1361/display/redirect?page=changes>

Changes:

[samuelw] [BEAM-12144] Change windmill grpc streams to reevaluate isReady and

[noreply] [BEAM-12260] Java - Backport Firestore connector's ramp-up throttling to

[noreply] [BEAM-9547] Add get implementation (#15030)


------------------------------------------
[...truncated 1.23 MB...]
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
ERROR    root:portable_runner.py:570 Error running pipeline.
                                     Traceback (most recent call last):
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/local_job_service.py",> line 274, in _run_job
                                         self._pipeline_proto)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 206, in run_via_runner_api
                                         return self.run_stages(stage_context, stages)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 385, in run_stages
                                         runner_execution_context, bundle_context_manager)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 653, in _run_stage
                                         bundle_manager))
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 770, in _run_bundle
                                         data_input, data_output, input_timers, expected_timer_output)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1120, in process_bundle
                                         raise RuntimeError(result.error)
                                     RuntimeError: Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 285, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
============ 2 failed, 7 passed, 4757 deselected in 189.30 seconds =============

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 24907.
Stopping expansion service pid: 24910.

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2745

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 35m 48s
168 actionable tasks: 123 executed, 41 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/52pvmijnu54cu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #1360

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1360/display/redirect>

Changes:


------------------------------------------
[...truncated 1.23 MB...]
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
ERROR    root:portable_runner.py:570 Error running pipeline.
                                     Traceback (most recent call last):
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/local_job_service.py",> line 274, in _run_job
                                         self._pipeline_proto)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 206, in run_via_runner_api
                                         return self.run_stages(stage_context, stages)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 385, in run_stages
                                         runner_execution_context, bundle_context_manager)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 653, in _run_stage
                                         bundle_manager))
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 770, in _run_bundle
                                         data_input, data_output, input_timers, expected_timer_output)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1120, in process_bundle
                                         raise RuntimeError(result.error)
                                     RuntimeError: Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 285, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
============ 2 failed, 7 passed, 4756 deselected in 161.64 seconds =============

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 15688.
Stopping expansion service pid: 15691.

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 19621

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 32m 8s
168 actionable tasks: 121 executed, 43 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/cge7ht4akw3qa

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #1359

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1359/display/redirect>

Changes:


------------------------------------------
[...truncated 89.30 KB...]
Collecting google-cloud-dlp<2,>=0.12.0
  Using cached google_cloud_dlp-1.0.0-py2.py3-none-any.whl (169 kB)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.0-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.1-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
  Using cached google_cloud_vision-1.0.0-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-profiler<4,>=3.0.4
  Using cached google_cloud_profiler-3.0.4-cp36-cp36m-linux_x86_64.whl
Collecting azure-storage-blob>=12.3.2
  Using cached azure_storage_blob-12.8.1-py2.py3-none-any.whl (345 kB)
Collecting azure-core>=1.7.0
  Using cached azure_core-1.15.0-py2.py3-none-any.whl (138 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from azure-core>=1.7.0->apache-beam==2.32.0.dev0) (1.16.0)
Collecting msrest>=0.6.18
  Using cached msrest-0.6.21-py2.py3-none-any.whl (85 kB)
Collecting cryptography>=2.1.4
  Using cached cryptography-3.4.7-cp36-abi3-manylinux2014_x86_64.whl (3.2 MB)
Collecting jmespath<1.0.0,>=0.7.1
  Using cached jmespath-0.10.0-py2.py3-none-any.whl (24 kB)
Collecting botocore<1.21.0,>=1.20.97
  Using cached botocore-1.20.97-py2.py3-none-any.whl (7.6 MB)
Collecting s3transfer<0.5.0,>=0.4.0
  Using cached s3transfer-0.4.2-py2.py3-none-any.whl (79 kB)
Collecting urllib3<1.27,>=1.25.4
  Using cached urllib3-1.26.5-py2.py3-none-any.whl (138 kB)
Collecting cffi>=1.12
  Using cached cffi-1.14.5-cp36-cp36m-manylinux1_x86_64.whl (401 kB)
Collecting pycparser
  Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Collecting fasteners>=0.14
  Using cached fasteners-0.16.3-py2.py3-none-any.whl (28 kB)
Collecting rsa<5,>=3.1.4
  Using cached rsa-4.7.2-py3-none-any.whl (34 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from google-auth<2,>=1.18.0->apache-beam==2.32.0.dev0) (57.0.0)
Collecting pyasn1-modules>=0.2.1
  Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting google-api-core[grpc]<2.0.0dev,>=1.29.0
  Using cached google_api_core-1.30.0-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.32.0.dev0) (20.9)
Collecting proto-plus>=1.10.0
  Using cached proto_plus-1.18.1-py3-none-any.whl (42 kB)
Collecting google-resumable-media<2.0dev,>=0.6.0
  Using cached google_resumable_media-1.3.1-py2.py3-none-any.whl (75 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
  Using cached googleapis_common_protos-1.53.0-py2.py3-none-any.whl (198 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
  Using cached grpc_google_iam_v1-0.12.3-py3-none-any.whl
Collecting google-auth-httplib2
  Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-api-python-client!=1.12.0,!=2.0.2
  Using cached google_api_python_client-2.9.0-py2.py3-none-any.whl (7.0 MB)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Collecting google-crc32c<2.0dev,>=1.0
  Using cached google_crc32c-1.1.2-cp36-cp36m-manylinux2014_x86_64.whl (38 kB)
Collecting docopt
  Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing<3,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from httplib2<0.20.0,>=0.8->apache-beam==2.32.0.dev0) (2.4.7)
Collecting pbr>=0.11
  Using cached pbr-5.6.0-py2.py3-none-any.whl (111 kB)
Collecting isodate>=0.6.0
  Using cached isodate-0.6.0-py2.py3-none-any.whl (45 kB)
Collecting requests-oauthlib>=0.5.0
  Using cached requests_oauthlib-1.3.0-py2.py3-none-any.whl (23 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2021.5.30-py2.py3-none-any.whl (145 kB)
Collecting pyasn1>=0.1.7
  Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Requirement already satisfied: pluggy<1.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.32.0.dev0) (0.13.1)
Collecting wcwidth
  Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting more-itertools>=4.0.0
  Using cached more_itertools-8.8.0-py3-none-any.whl (48 kB)
Collecting atomicwrites>=1.0
  Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Requirement already satisfied: importlib-metadata>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.32.0.dev0) (2.1.1)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.32.0.dev0) (1.10.0)
Collecting attrs>=17.4.0
  Using cached attrs-21.2.0-py2.py3-none-any.whl (53 kB)
Requirement already satisfied: zipp>=0.5 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from importlib-metadata>=0.12->pytest<5.0,>=4.4.0->apache-beam==2.32.0.dev0) (3.4.1)
Collecting execnet>=1.1
  Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
  Using cached pytest_forked-1.3.0-py2.py3-none-any.whl (4.7 kB)
Collecting chardet<5,>=3.0.2
  Using cached chardet-4.0.0-py2.py3-none-any.whl (178 kB)
Collecting idna<3,>=2.5
  Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting oauthlib>=3.0.0
  Using cached oauthlib-3.1.1-py2.py3-none-any.whl (146 kB)
Collecting greenlet!=0.4.17
  Using cached greenlet-1.1.0-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (155 kB)
Collecting wrapt
  Using cached wrapt-1.12.1-cp36-cp36m-linux_x86_64.whl
Collecting deprecation
  Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker
  Using cached docker-5.0.0-py2.py3-none-any.whl (146 kB)
Collecting websocket-client>=0.32.0
  Using cached websocket_client-1.1.0-py2.py3-none-any.whl (68 kB)
Building wheels for collected packages: apache-beam
  Building wheel for apache-beam (setup.py): started
  Building wheel for apache-beam (setup.py): finished with status 'done'
  Created wheel for apache-beam: filename=apache_beam-2.32.0.dev0-py3-none-any.whl size=2499970 sha256=ade11cb3b7584c8c1034a3f131cdd8fda28bbbd8382cbb6af3409a3c6ecd9a95
  Stored in directory: /home/jenkins/.cache/pip/wheels/17/a0/ae/813f9bdd135d96171d60dd94dd231a1f529a546b1deb1d2eca
Successfully built apache-beam
Installing collected packages: pyasn1, urllib3, rsa, pycparser, pyasn1-modules, idna, chardet, certifi, cachetools, wcwidth, requests, pytz, python-dateutil, oauthlib, more-itertools, jmespath, httplib2, googleapis-common-protos, google-auth, cffi, attrs, atomicwrites, websocket-client, uritemplate, requests-oauthlib, pytest, numpy, isodate, grpcio-gcp, google-crc32c, google-auth-httplib2, google-api-core, docopt, botocore, wrapt, typing-extensions, s3transfer, pytest-forked, pymongo, pydot, pyarrow, proto-plus, pbr, orjson, oauth2client, nose, msrest, hdfs, grpc-google-iam-v1, greenlet, google-resumable-media, google-cloud-core, google-api-python-client, fasteners, fastavro, execnet, docker, dill, deprecation, dataclasses, cryptography, crcmod, azure-core, avro-python3, testcontainers, tenacity, sqlalchemy, requests-mock, pyyaml, pytest-xdist, pytest-timeout, pyhamcrest, psycopg2-binary, parameterized, pandas, nose-xunitmp, mock, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-pubsub, google-cloud-profiler, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery, google-apitools, freezegun, boto3, azure-storage-blob, apache-beam

> Task :sdks:go:resolveBuildDependencies
Resolving golang.org/x/text: commit='23ae387dee1f90d29a23c0e87ee0b46038fbed0e', urls=[https://go.googlesource.com/text]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]

> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses

> Task :release:go-licenses:py:dockerRun
+ go-licenses save github.com/apache/beam/sdks/python/container --save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/python/container
+ tee /output/licenses/list.csv
github.com/nightlyone/lockfile,https://github.com/nightlyone/lockfile/blob/master/LICENSE,MIT
github.com/apache/beam/sdks/python/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses

> Task :sdks:python:installGcpTest
Successfully installed apache-beam-2.32.0.dev0 atomicwrites-1.4.0 attrs-21.2.0 avro-python3-1.9.2.1 azure-core-1.15.0 azure-storage-blob-12.8.1 boto3-1.17.97 botocore-1.20.97 cachetools-4.2.2 certifi-2021.5.30 cffi-1.14.5 chardet-4.0.0 crcmod-1.7 cryptography-3.4.7 dataclasses-0.8 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.0 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.1 fasteners-0.16.3 freezegun-1.1.0 google-api-core-1.30.0 google-api-python-client-2.9.0 google-apitools-0.5.31 google-auth-1.31.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.20.0 google-cloud-bigtable-1.7.0 google-cloud-core-1.7.0 google-cloud-datastore-1.15.3 google-cloud-dlp-1.0.0 google-cloud-language-1.3.0 google-cloud-profiler-3.0.4 google-cloud-pubsub-1.7.0 google-cloud-spanner-1.19.1 google-cloud-videointelligence-1.16.1 google-cloud-vision-1.0.0 google-crc32c-1.1.2 google-resumable-media-1.3.1 googleapis-common-protos-1.53.0 greenlet-1.1.0 grpc-google-iam-v1-0.12.3 grpcio-gcp-0.2.2 hdfs-2.6.0 httplib2-0.19.1 idna-2.10 isodate-0.6.0 jmespath-0.10.0 mock-2.0.0 more-itertools-8.8.0 msrest-0.6.21 nose-1.3.7 nose-xunitmp-0.4.1 numpy-1.19.5 oauth2client-4.1.3 oauthlib-3.1.1 orjson-3.5.3 pandas-1.1.5 parameterized-0.7.5 pbr-5.6.0 proto-plus-1.18.1 psycopg2-binary-2.9.1 pyarrow-4.0.1 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.20 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.11.4 pytest-4.6.11 pytest-forked-1.3.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.1 pytz-2021.1 pyyaml-5.4.1 requests-2.25.1 requests-mock-1.9.3 requests-oauthlib-1.3.0 rsa-4.7.2 s3transfer-0.4.2 sqlalchemy-1.4.18 tenacity-5.1.5 testcontainers-3.4.1 typing-extensions-3.7.4.3 uritemplate-3.0.1 urllib3-1.26.5 wcwidth-0.2.5 websocket-client-1.1.0 wrapt-1.12.1

> Task :release:go-licenses:java:dockerRun
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerSetup
Waiting for server to start up...
Server started at port 43207

> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :release:go-licenses:py:createLicenses
> Task :sdks:python:container:py36:copyGolangLicenses

> Task :sdks:go:resolveBuildDependencies
Resolving google.golang.org/api: commit='0324d5e90dc7753607860272666845fad9ceb97e', urls=[https://code.googlesource.com/google-api-go-client]
Resolving google.golang.org/genproto: commit='4d944d34d83c502a5f761500a14d8842648415c3', urls=[https://github.com/google/go-genproto]
Resolving google.golang.org/grpc: commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58', urls=[https://github.com/grpc/grpc-go]
Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]

> Task :sdks:go:installDependencies
> Task :sdks:go:buildLinuxAmd64
> Task :sdks:go:goBuild

> Task :sdks:python:container:resolveBuildDependencies
Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go>

> Task :sdks:java:container:resolveBuildDependencies
Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go>

> Task :sdks:python:container:installDependencies
> Task :sdks:java:container:installDependencies
> Task :sdks:java:container:buildLinuxAmd64
> Task :sdks:java:container:goBuild
> Task :sdks:python:container:buildDarwinAmd64
> Task :sdks:java:container:java8:copySdkHarnessLauncher
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:python:container:buildLinuxAmd64
> Task :sdks:python:container:goBuild
> Task :sdks:python:container:py36:copyLauncherDependencies
> Task :sdks:python:container:py36:dockerPrepare
> Task :sdks:java:container:java8:docker
> Task :sdks:python:container:py36:docker
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerSetup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 34m 14s
168 actionable tasks: 121 executed, 43 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/hrmmolgiv537a

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #1358

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1358/display/redirect>

Changes:


------------------------------------------
[...truncated 1.23 MB...]
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
ERROR    root:portable_runner.py:570 Error running pipeline.
                                     Traceback (most recent call last):
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/local_job_service.py",> line 274, in _run_job
                                         self._pipeline_proto)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 206, in run_via_runner_api
                                         return self.run_stages(stage_context, stages)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 385, in run_stages
                                         runner_execution_context, bundle_context_manager)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 653, in _run_stage
                                         bundle_manager))
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 770, in _run_bundle
                                         data_input, data_output, input_timers, expected_timer_output)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1120, in process_bundle
                                         raise RuntimeError(result.error)
                                     RuntimeError: Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 285, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
============ 2 failed, 7 passed, 4756 deselected in 171.53 seconds =============

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 7453.
Stopping expansion service pid: 7456.

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 23002

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 29m 46s
168 actionable tasks: 121 executed, 43 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/r3flu6anradv2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #1357

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1357/display/redirect>

Changes:


------------------------------------------
[...truncated 1.23 MB...]
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
ERROR    root:portable_runner.py:570 Error running pipeline.
                                     Traceback (most recent call last):
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/local_job_service.py",> line 274, in _run_job
                                         self._pipeline_proto)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 206, in run_via_runner_api
                                         return self.run_stages(stage_context, stages)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 385, in run_stages
                                         runner_execution_context, bundle_context_manager)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 653, in _run_stage
                                         bundle_manager))
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 770, in _run_bundle
                                         data_input, data_output, input_timers, expected_timer_output)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1120, in process_bundle
                                         raise RuntimeError(result.error)
                                     RuntimeError: Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 285, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
============ 2 failed, 7 passed, 4756 deselected in 193.07 seconds =============

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 15525.
Stopping expansion service pid: 15528.

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 26863

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 33m 40s
168 actionable tasks: 122 executed, 42 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/2w4dft22ovkpc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #1356

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1356/display/redirect>

Changes:


------------------------------------------
[...truncated 1.23 MB...]
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
ERROR    root:portable_runner.py:570 Error running pipeline.
                                     Traceback (most recent call last):
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/local_job_service.py",> line 274, in _run_job
                                         self._pipeline_proto)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 206, in run_via_runner_api
                                         return self.run_stages(stage_context, stages)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 385, in run_stages
                                         runner_execution_context, bundle_context_manager)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 653, in _run_stage
                                         bundle_manager))
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 770, in _run_bundle
                                         data_input, data_output, input_timers, expected_timer_output)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1120, in process_bundle
                                         raise RuntimeError(result.error)
                                     RuntimeError: Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 285, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
============ 2 failed, 7 passed, 4756 deselected in 168.05 seconds =============

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 6340.
Stopping expansion service pid: 6343.

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 19697

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 33m 20s
168 actionable tasks: 121 executed, 43 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/gcnxpwmznyxgq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #1355

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1355/display/redirect>

Changes:


------------------------------------------
[...truncated 1.23 MB...]
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
ERROR    root:portable_runner.py:570 Error running pipeline.
                                     Traceback (most recent call last):
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/local_job_service.py",> line 274, in _run_job
                                         self._pipeline_proto)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 206, in run_via_runner_api
                                         return self.run_stages(stage_context, stages)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 385, in run_stages
                                         runner_execution_context, bundle_context_manager)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 653, in _run_stage
                                         bundle_manager))
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 770, in _run_bundle
                                         data_input, data_output, input_timers, expected_timer_output)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1120, in process_bundle
                                         raise RuntimeError(result.error)
                                     RuntimeError: Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 285, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
============ 2 failed, 7 passed, 4756 deselected in 204.96 seconds =============

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 24135.
Stopping expansion service pid: 24138.

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3185

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 34m 2s
168 actionable tasks: 121 executed, 43 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/yfgh2xpqs4dka

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #1354

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1354/display/redirect?page=changes>

Changes:

[noreply] [BEAM-11289] [Java] Integrate Google Cloud Recommendations AI


------------------------------------------
[...truncated 1.23 MB...]
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
ERROR    root:portable_runner.py:570 Error running pipeline.
                                     Traceback (most recent call last):
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/local_job_service.py",> line 274, in _run_job
                                         self._pipeline_proto)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 206, in run_via_runner_api
                                         return self.run_stages(stage_context, stages)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 385, in run_stages
                                         runner_execution_context, bundle_context_manager)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 653, in _run_stage
                                         bundle_manager))
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 770, in _run_bundle
                                         data_input, data_output, input_timers, expected_timer_output)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1120, in process_bundle
                                         raise RuntimeError(result.error)
                                     RuntimeError: Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 285, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
============ 2 failed, 7 passed, 4756 deselected in 214.02 seconds =============

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 4135.
Stopping expansion service pid: 4138.

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 14142

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 34m 23s
168 actionable tasks: 121 executed, 43 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/zrgkutntu2tdq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #1353

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1353/display/redirect>

Changes:


------------------------------------------
[...truncated 1.24 MB...]
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 770, in _run_bundle
                                         data_input, data_output, input_timers, expected_timer_output)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1120, in process_bundle
                                         raise RuntimeError(result.error)
                                     RuntimeError: Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 285, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
_________________ SqlTransformTest.test_zetasql_generate_data __________________

self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_zetasql_generate_data>

    def test_zetasql_generate_data(self):
      with TestPipeline() as p:
        out = p | SqlTransform(
            """SELECT
              CAST(1 AS INT64) AS `int`,
              CAST('foo' AS STRING) AS `str`,
              CAST(3.14  AS FLOAT64) AS `flt`""",
            dialect="zetasql")
>       assert_that(out, equal_to([(1, "foo", 3.14)]))

apache_beam/transforms/sql_test.py:160: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/pipeline.py:585: in __exit__
    self.result = self.run()
apache_beam/testing/test_pipeline.py:116: in run
    state = result.wait_until_finish()
apache_beam/runners/portability/portable_runner.py:600: in wait_until_finish
    raise self._runtime_exception
apache_beam/runners/portability/portable_runner.py:606: in _observe_state
    for state_response in self._state_stream:
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:426: in __next__
    return self._next()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.DEADLINE_EXCEEDED
	details = "Deadline Exc....1:38517","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Deadline Exceeded","grpc_status":4}"
>

    def _next(self):
        with self._state.condition:
            if self._state.code is None:
                event_handler = _event_handler(self._state,
                                               self._response_deserializer)
                self._state.due.add(cygrpc.OperationType.receive_message)
                operating = self._call.operate(
                    (cygrpc.ReceiveMessageOperation(_EMPTY_FLAGS),),
                    event_handler)
                if not operating:
                    self._state.due.remove(cygrpc.OperationType.receive_message)
            elif self._state.code is grpc.StatusCode.OK:
                raise StopIteration()
            else:
                raise self
    
            def _response_ready():
                return (self._state.response is not None or
                        (cygrpc.OperationType.receive_message
                         not in self._state.due and
                         self._state.code is not None))
    
            _common.wait(self._state.condition.wait, _response_ready)
            if self._state.response is not None:
                response = self._state.response
                self._state.response = None
                return response
            elif cygrpc.OperationType.receive_message not in self._state.due:
                if self._state.code is grpc.StatusCode.OK:
                    raise StopIteration()
                elif self._state.code is not None:
>                   raise self
E                   grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
E                   	status = StatusCode.DEADLINE_EXCEEDED
E                   	details = "Deadline Exceeded"
E                   	debug_error_string = "{"created":"@1624105330.707879933","description":"Error received from peer ipv4:127.0.0.1:38517","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Deadline Exceeded","grpc_status":4}"
E                   >

../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:826: _MultiThreadedRendezvous
----------------------------- Captured stderr call -----------------------------
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
------------------------------ Captured log call -------------------------------
WARNING  root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
WARNING  root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
WARNING  root:portable_runner.py:570 Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
============ 3 failed, 6 passed, 4756 deselected in 282.74 seconds =============
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
  File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.6/threading.py", line 864, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 565, in read_messages
    for message in self._message_stream:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.DEADLINE_EXCEEDED
	details = "Deadline Exceeded"
	debug_error_string = "{"created":"@1624105330.708834287","description":"Error received from peer ipv4:127.0.0.1:38517","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Deadline Exceeded","grpc_status":4}"
>


> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 23558.
Stopping expansion service pid: 23561.

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 18303

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 35m 25s
168 actionable tasks: 121 executed, 43 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/frjdiltozphdg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #1352

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1352/display/redirect?page=changes>

Changes:

[noreply] [BEAM-12495] Fail early when attempting to group multiple columns with

[noreply] Minor: Fix WontImplementMethod typo (#15018)


------------------------------------------
[...truncated 1.23 MB...]
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
ERROR    root:portable_runner.py:570 Error running pipeline.
                                     Traceback (most recent call last):
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/local_job_service.py",> line 274, in _run_job
                                         self._pipeline_proto)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 206, in run_via_runner_api
                                         return self.run_stages(stage_context, stages)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 385, in run_stages
                                         runner_execution_context, bundle_context_manager)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 653, in _run_stage
                                         bundle_manager))
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 770, in _run_bundle
                                         data_input, data_output, input_timers, expected_timer_output)
                                       File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1120, in process_bundle
                                         raise RuntimeError(result.error)
                                     RuntimeError: Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 285, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
                                     
                                     During handling of the above exception, another exception occurred:
                                     
                                     Traceback (most recent call last):
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
                                         response = task()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
                                         lambda: self.create_worker().do_instruction(request), request)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 602, in do_instruction
                                         getattr(request, request_type), request.instruction_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 633, in process_bundle
                                         instruction_id, request.process_bundle_descriptor_id)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py", line 462, in get
                                         self.data_channel_factory)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 862, in __init__
                                         self.ops = self.create_execution_tree(self.process_bundle_descriptor)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 919, in create_execution_tree
                                         descriptor.transforms, key=topological_height, reverse=True)])
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 918, in <listcomp>
                                         get_operation(transform_id))) for transform_id in sorted(
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in get_operation
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 900, in <dictcomp>
                                         pcoll_id in descriptor.transforms[transform_id].outputs.items()
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 898, in <listcomp>
                                         tag: [get_operation(op) for op in pcoll_consumers[pcoll_id]]
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 806, in wrapper
                                         result = cache[args] = func(*args)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 903, in get_operation
                                         transform_id, transform_consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1192, in create_operation
                                         return creator(self, transform_id, transform_proto, payload, consumers)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1540, in create_par_do
                                         parameter)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1576, in _create_pardo_operation
                                         dofn_data = pickler.loads(serialized_fn)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/internal/pickler.py", line 289, in loads
                                         return dill.loads(s)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 275, in loads
                                         return load(file, ignore, **kwds)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 270, in load
                                         return Unpickler(file, ignore=ignore, **kwds).load()
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 472, in load
                                         obj = StockUnpickler.load(self)
                                       File "/usr/local/lib/python3.6/site-packages/dill/_dill.py", line 827, in _import_module
                                         return getattr(__import__(module, None, None, [obj]), obj)
                                       File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/sql_test.py", line 26, in <module>
                                         import pytest
                                     ModuleNotFoundError: No module named 'pytest'
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
============ 2 failed, 7 passed, 4756 deselected in 205.68 seconds =============

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 10509.
Stopping expansion service pid: 10512.

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 21398

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 34m 27s
168 actionable tasks: 121 executed, 43 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/dmie6t4dpcevy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org