You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/02/01 18:59:25 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Direct #2254
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2254/display/redirect>
Changes:
------------------------------------------
[...truncated 882.72 KB...]
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ejDeUBJzJt" is_bounded:BOUNDED windowing_strategy_id:"w0@ejDeUBJzJt"}} windowing_strategies:{key:"w0@ejDeUBJzJt" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ejDeUBJzJt" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY OnTimeBehavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ejDeUBJzJt" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07role_id\x1a\x02\x10\x03\x12$abc5e222-ab8f-4f6f-800a-a58bb0f45675"}}} coders:{key:"c1@ejDeUBJzJt" value:{spec:{urn:"beam:coder:global_window:v1"}}} environments:{key:"go" value:{}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_jdbc_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$853bc92e-cc52-429e-bf30-f534bebcedce\x12`\x03\x01\x04\x05rolesV\n\x02\xf0\x03\x15org.postgresql.Driver*jdbc:postgresql://localhost:33293/postjdbc\x07newuser\x08password"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ejDeUBJzJt"
expansion failed
caused by:
java.lang.UnsupportedOperationException: Unknown urn: beam:transform:org.apache.beam:schemaio_jdbc_write:v1
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:506)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:591)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:220)
at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:340)
at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_jdbc_write:v1 against localhost:57059 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ejDeUBJzJt" is_bounded:BOUNDED windowing_strategy_id:"w0@ejDeUBJzJt"}} windowing_strategies:{key:"w0@ejDeUBJzJt" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ejDeUBJzJt" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY OnTimeBehavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ejDeUBJzJt" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07role_id\x1a\x02\x10\x03\x12$abc5e222-ab8f-4f6f-800a-a58bb0f45675"}}} coders:{key:"c1@ejDeUBJzJt" value:{spec:{urn:"beam:coder:global_window:v1"}}} environments:{key:"go" value:{}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_jdbc_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$853bc92e-cc52-429e-bf30-f534bebcedce\x12`\x03\x01\x04\x05rolesV\n\x02\xf0\x03\x15org.postgresql.Driver*jdbc:postgresql://localhost:33293/postjdbc\x07newuser\x08password"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ejDeUBJzJt"
expansion failed
caused by:
java.lang.UnsupportedOperationException: Unknown urn: beam:transform:org.apache.beam:schemaio_jdbc_write:v1
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:506)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:591)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:220)
at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:340)
at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
goroutine 50 [running]:
testing.tRunner.func1.2(0xe57600, 0xc00011c640)
/home/jenkins/sdk/go1.16.12/src/testing/testing.go:1143 +0x332
testing.tRunner.func1(0xc000103b00)
/home/jenkins/sdk/go1.16.12/src/testing/testing.go:1146 +0x4b6
panic(0xe57600, 0xc00011c640)
/home/jenkins/sdk/go1.16.12/src/runtime/panic.go:965 +0x1b9
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage(0xc0003e6ba0, 0xc000624820, 0xfa25f3, 0x35, 0xc00048c000, 0xbc, 0xbc, 0x7ffc86b0942e, 0xf, 0xc00029fb38, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/pkg/beam/xlang.go>:162 +0x1f7
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/jdbcio.Write(0xc0003e6b80, 0xc000624820, 0x7ffc86b0942e, 0xf, 0xf74760, 0x5, 0xf84bb9, 0x15, 0xc00019e4e0, 0x2a, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/pkg/beam/io/xlang/jdbcio/jdbc.go>:129 +0x4c7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc.writeRows(0xc0003e6ae0, 0xc000624820, 0x7ffc86b0942e, 0xf, 0xf74760, 0x5, 0xf84bb9, 0x15, 0xc00019e4e0, 0x2a, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc.go>:39 +0x1be
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc.WritePipeline(0x7ffc86b0942e, 0xf, 0xf74760, 0x5, 0xf84bb9, 0x15, 0xc00019e4e0, 0x2a, 0xf76d45, 0x7, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc.go>:49 +0x20d
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc.TestJDBCIO_BasicReadWrite(0xc000103b00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go>:104 +0x227
testing.tRunner(0xc000103b00, 0xfb89f0)
/home/jenkins/sdk/go1.16.12/src/testing/testing.go:1193 +0xef
created by testing.(*T).Run
/home/jenkins/sdk/go1.16.12/src/testing/testing.go:1238 +0x2b3
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 21.851s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:184: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 3.031s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ exit 1
$ exit 1
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:39249 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5179 items / 5169 deselected / 10 selected
apache_beam/io/external/generate_sequence_test.py .
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
.. [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ....... [100%]
=============================== warnings summary ===============================
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
=========== 10 passed, 5169 deselected, 2 warnings in 123.52 seconds ===========
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:39249 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5179 items / 5169 deselected / 10 selected
apache_beam/io/external/generate_sequence_test.py .ss [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ....... [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
============ 8 passed, 2 skipped, 5169 deselected in 61.65 seconds =============
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:39249 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_sql_expansion_service
============================= test session starts ==============================
platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5179 items / 5170 deselected / 9 selected
apache_beam/transforms/sql_test.py ..F...... [100%]
=================================== FAILURES ===================================
_____________________ SqlTransformTest.test_generate_data ______________________
self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_generate_data>
def test_generate_data(self):
with TestPipeline() as p:
out = p | SqlTransform(
"""SELECT
CAST(1 AS INT) AS `id`,
CAST('foo' AS VARCHAR) AS `str`,
> CAST(3.14 AS DOUBLE) AS `flt`""")
apache_beam/transforms/sql_test.py:86:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/transforms/ptransform.py:614: in __ror__
result = p.apply(self, pvalueish, label)
apache_beam/pipeline.py:708: in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
apache_beam/runners/runner.py:185: in apply
return m(transform, input, options)
apache_beam/runners/runner.py:215: in apply_PTransform
return transform.expand(input)
apache_beam/transforms/external.py:509: in expand
response = service.Expand(request)
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:946: in __call__
return _end_unary_response_blocking(state, call, False, None)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
state = <grpc._channel._RPCState object at 0x7fad04715198>
call = <grpc._cython.cygrpc.SegregatedCall object at 0x7fad04773ac8>
with_call = False, deadline = None
def _end_unary_response_blocking(state, call, with_call, deadline):
if state.code is grpc.StatusCode.OK:
if with_call:
rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
return state.response, rendezvous
else:
return state.response
else:
> raise _InactiveRpcError(state)
E grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
E status = StatusCode.UNIMPLEMENTED
E details = "Method not found: org.apache.beam.model.expansion.v1.ExpansionService/Expand"
E debug_error_string = "{"created":"@1643740784.647194851","description":"Error received from peer ipv6:[::1]:46309","file":"src/core/lib/surface/call.cc","file_line":1074,"grpc_message":"Method not found: org.apache.beam.model.expansion.v1.ExpansionService/Expand","grpc_status":12}"
E >
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:849: _InactiveRpcError
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
============ 1 failed, 8 passed, 5170 deselected in 253.16 seconds =============
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 235562.
Stopping expansion service pid: 235563.
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 169342
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 170
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 39m 53s
200 actionable tasks: 139 executed, 52 from cache, 9 up-to-date
Publishing build scan...
https://gradle.com/s/v4mphzuyfooni
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Direct #2257
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2257/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #2256
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2256/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13574] Large Wordcount (#16455)
[noreply] [BEAM-13293] Refactor JDBC IO Go Wrapper (#16686)
------------------------------------------
[...truncated 484.19 KB...]
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mRemoving intermediate container 92c004228c84
---> bda16d2c96f5
Step 14/31 : RUN pip check || (echo "Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate" && exit 1)
---> Running in 2c9d86281ed1
No broken requirements found.
Removing intermediate container 2c9d86281ed1
---> 978c2a2acde6
Step 15/31 : RUN pip freeze --all
---> Running in d7186b046d72
absl-py==0.15.0
apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz
astunparse==1.6.3
atomicwrites==1.4.0
attrs==21.4.0
beautifulsoup4==4.10.0
bs4==0.0.1
cached-property==1.5.2
cachetools==4.2.4
certifi==2021.10.8
charset-normalizer==2.0.10
clang==5.0
click==8.0.3
cloudpickle==2.0.0
crcmod==1.7
Cython==0.29.26
dataclasses==0.8
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.7
fasteners==0.16.3
flatbuffers==1.12
freezegun==1.1.0
future==0.18.2
gast==0.4.0
google-api-core==1.31.5
google-api-python-client==2.33.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.31.0
google-cloud-bigquery-storage==2.10.1
google-cloud-bigtable==1.7.0
google-cloud-core==1.7.2
google-cloud-datastore==1.15.3
google-cloud-dlp==3.4.0
google-cloud-language==1.3.0
google-cloud-profiler==3.0.6
google-cloud-pubsub==2.9.0
google-cloud-pubsublite==1.2.0
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.1
google-cloud-videointelligence==1.16.1
google-cloud-vision==1.0.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.1.0
googleapis-common-protos==1.54.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.3
grpcio==1.43.0
grpcio-gcp==0.2.2
grpcio-status==1.43.0
guppy3==3.1.2
h5py==3.1.0
hdfs==2.6.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.8.3
joblib==1.1.0
keras==2.6.0
Keras-Preprocessing==1.1.2
libcst==0.3.23
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
mypy-extensions==0.4.3
nltk==3.6.7
nose==1.3.7
numpy==1.19.5
oauth2client==4.1.3
oauthlib==3.1.1
opt-einsum==3.3.0
orjson==3.6.1
overrides==6.1.0
packaging==21.3
pandas==1.1.5
parameterized==0.7.5
pbr==5.8.0
pip==21.2.4
pluggy==0.13.1
proto-plus==1.19.8
protobuf==3.19.1
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==6.0.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.0
pytz==2021.3
PyYAML==6.0
regex==2021.11.10
requests==2.27.0
requests-mock==1.9.3
requests-oauthlib==1.3.0
rsa==4.8
scikit-learn==0.24.2
scipy==1.5.4
setuptools==57.5.0
six==1.15.0
soupsieve==2.3.1
SQLAlchemy==1.4.29
tenacity==5.1.5
tensorboard==2.6.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.0
tensorflow==2.6.2
tensorflow-estimator==2.6.0
termcolor==1.1.0
testcontainers==3.4.2
threadpoolctl==3.0.0
tqdm==4.62.3
typing-extensions==3.7.4.3
typing-inspect==0.7.1
typing-utils==0.1.0
uritemplate==4.1.1
urllib3==1.26.7
wcwidth==0.2.5
websocket-client==1.2.3
Werkzeug==2.0.2
wheel==0.37.0
wrapt==1.12.1
zipp==3.6.0
Removing intermediate container d7186b046d72
---> fa1ad84374e5
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
---> 302dc5aa34a1
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
---> 8f21cd48249d
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
---> b48eb23293e7
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 1ccc5cbd9efa
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 86a1a636602c
Removing intermediate container 86a1a636602c
---> f866be3af7d9
Step 21/31 : FROM beam as third_party_licenses
---> f866be3af7d9
Step 22/31 : ARG pull_licenses
---> Running in d7b3d2f5ab67
Removing intermediate container d7b3d2f5ab67
---> 62582e3ff51e
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
---> 971b672a4c68
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> e54d8a81aa31
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 13bc2dcc139d
Removing intermediate container 13bc2dcc139d
---> c820b966a672
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
---> f9260ecc391e
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 5840fd6cfefd
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.6/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.6/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.6/site-packages (from tenacity) (1.15.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22924 sha256=31dc925a8d359210997daaa6844037835d64eb8239bce412f42951c207452b69
Stored in directory: /root/.cache/pip/wheels/f3/65/67/71f473ec87ea4554d1bdfb1b5128cfe1414c2b113b72a1ee8e
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 134 dependencies
[0mRemoving intermediate container 5840fd6cfefd
---> 6e281e8bc3a1
Step 28/31 : FROM beam
---> f866be3af7d9
Step 29/31 : ARG pull_licenses
---> Running in 8b359c74f425
Removing intermediate container 8b359c74f425
---> 4e5b62900af7
Step 30/31 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> 15441c3a7c79
Step 31/31 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 6826a040faf7
Removing intermediate container 6826a040faf7
---> dfd432f3dde9
Successfully built dfd432f3dde9
Successfully tagged apache/beam_python3.6_sdk:2.37.0.dev
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:container:pullLicenses'.
> Process 'command './license_scripts/license_script.sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 13m 46s
188 actionable tasks: 127 executed, 52 from cache, 9 up-to-date
Publishing build scan...
https://gradle.com/s/sloh5mpji5ebi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #2255
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2255/display/redirect?page=changes>
Changes:
[career] [BEAM-13734] Support cache directories that use GCS buckets
[noreply] Merge pull request #16655 from [BEAM-12164]: Add retry protection to
[noreply] Merge pull request #16586 from [BEAM-13731] FhirIO: Add support for
[noreply] [BEAM-13011] Adds a link to Multi-language Pipelines Tips wiki page
[noreply] [BEAM-12572] Run python examples on multiple runners (#16154)
------------------------------------------
[...truncated 478.44 KB...]
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mRemoving intermediate container 83e6df698ec9
---> e43debdf7e63
Step 14/31 : RUN pip check || (echo "Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate" && exit 1)
---> Running in e9e48b8d144a
No broken requirements found.
Removing intermediate container e9e48b8d144a
---> e081fb553474
Step 15/31 : RUN pip freeze --all
---> Running in a70b1320525c
absl-py==0.15.0
apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz
astunparse==1.6.3
atomicwrites==1.4.0
attrs==21.4.0
beautifulsoup4==4.10.0
bs4==0.0.1
cached-property==1.5.2
cachetools==4.2.4
certifi==2021.10.8
charset-normalizer==2.0.10
clang==5.0
click==8.0.3
cloudpickle==2.0.0
crcmod==1.7
Cython==0.29.26
dataclasses==0.8
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.7
fasteners==0.16.3
flatbuffers==1.12
freezegun==1.1.0
future==0.18.2
gast==0.4.0
google-api-core==1.31.5
google-api-python-client==2.33.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.31.0
google-cloud-bigquery-storage==2.10.1
google-cloud-bigtable==1.7.0
google-cloud-core==1.7.2
google-cloud-datastore==1.15.3
google-cloud-dlp==3.4.0
google-cloud-language==1.3.0
google-cloud-profiler==3.0.6
google-cloud-pubsub==2.9.0
google-cloud-pubsublite==1.2.0
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.1
google-cloud-videointelligence==1.16.1
google-cloud-vision==1.0.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.1.0
googleapis-common-protos==1.54.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.3
grpcio==1.43.0
grpcio-gcp==0.2.2
grpcio-status==1.43.0
guppy3==3.1.2
h5py==3.1.0
hdfs==2.6.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.8.3
joblib==1.1.0
keras==2.6.0
Keras-Preprocessing==1.1.2
libcst==0.3.23
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
mypy-extensions==0.4.3
nltk==3.6.7
nose==1.3.7
numpy==1.19.5
oauth2client==4.1.3
oauthlib==3.1.1
opt-einsum==3.3.0
orjson==3.6.1
overrides==6.1.0
packaging==21.3
pandas==1.1.5
parameterized==0.7.5
pbr==5.8.0
pip==21.2.4
pluggy==0.13.1
proto-plus==1.19.8
protobuf==3.19.1
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==6.0.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.0
pytz==2021.3
PyYAML==6.0
regex==2021.11.10
requests==2.27.0
requests-mock==1.9.3
requests-oauthlib==1.3.0
rsa==4.8
scikit-learn==0.24.2
scipy==1.5.4
setuptools==57.5.0
six==1.15.0
soupsieve==2.3.1
SQLAlchemy==1.4.29
tenacity==5.1.5
tensorboard==2.6.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.0
tensorflow==2.6.2
tensorflow-estimator==2.6.0
termcolor==1.1.0
testcontainers==3.4.2
threadpoolctl==3.0.0
tqdm==4.62.3
typing-extensions==3.7.4.3
typing-inspect==0.7.1
typing-utils==0.1.0
uritemplate==4.1.1
urllib3==1.26.7
wcwidth==0.2.5
websocket-client==1.2.3
Werkzeug==2.0.2
wheel==0.37.0
wrapt==1.12.1
zipp==3.6.0
Removing intermediate container a70b1320525c
---> 02b4d49b059d
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
---> 815493d8ba04
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
---> 60ff06861650
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
---> 790d89457a6e
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 1d38bf7e1a81
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in e961c33e0426
Removing intermediate container e961c33e0426
---> b562a4d342e1
Step 21/31 : FROM beam as third_party_licenses
---> b562a4d342e1
Step 22/31 : ARG pull_licenses
---> Running in 479b51564c10
Removing intermediate container 479b51564c10
---> de9c5672c86b
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
---> a34da5b3212e
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 84c5508c5710
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in a6cd1414d08c
Removing intermediate container a6cd1414d08c
---> 45d43cc12066
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
---> 79c8c672710f
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in c5bdc12436eb
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.6/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.6/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.6/site-packages (from tenacity) (1.15.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22924 sha256=c63773495cbe2c82cbc508a225fa96971a8c4d0506fca0a1e265810208ce24cc
Stored in directory: /root/.cache/pip/wheels/f3/65/67/71f473ec87ea4554d1bdfb1b5128cfe1414c2b113b72a1ee8e
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0m[91mINFO:root:Successfully pulled licenses for 134 dependencies
[0mSkip pulling license for bs4
Removing intermediate container c5bdc12436eb
---> 4b9c1fb41f93
Step 28/31 : FROM beam
---> b562a4d342e1
Step 29/31 : ARG pull_licenses
---> Running in 26f3572ba4f8
Removing intermediate container 26f3572ba4f8
---> 3a02abbc650c
Step 30/31 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> 600c4875d9c1
Step 31/31 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 2d55fad86168
Removing intermediate container 2d55fad86168
---> 424b013e598a
Successfully built 424b013e598a
Successfully tagged apache/beam_python3.6_sdk:2.37.0.dev
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:container:pullLicenses'.
> Process 'command './license_scripts/license_script.sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 12m 18s
188 actionable tasks: 127 executed, 52 from cache, 9 up-to-date
Publishing build scan...
https://gradle.com/s/hsq3qys5ygslc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org