You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/12/08 17:23:40 UTC
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJava_Dataflow #1255
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1255/display/redirect?page=changes>
Changes:
[noreply] [Tour Of Beam] Playground Router GRPC API host (#24542)
------------------------------------------
[...truncated 541.57 KB...]
google-cloud-bigquery==3.4.0
google-cloud-bigquery-storage==2.16.2
google-cloud-bigtable==1.7.3
google-cloud-core==2.3.2
google-cloud-datastore==1.15.5
google-cloud-dlp==3.9.2
google-cloud-firestore==2.7.2
google-cloud-language==1.3.2
google-cloud-profiler==3.1.0
google-cloud-pubsub==2.13.11
google-cloud-pubsublite==1.6.0
google-cloud-recommendations-ai==0.7.1
google-cloud-spanner==3.24.0
google-cloud-storage==2.7.0
google-cloud-videointelligence==1.16.3
google-cloud-vision==3.1.4
google-crc32c==1.5.0
google-pasta==0.2.0
google-python-cloud-debugger==3.1
google-resumable-media==2.4.0
googleapis-common-protos==1.57.0
greenlet==2.0.1
grpc-google-iam-v1==0.12.4
grpcio==1.51.1
grpcio-status==1.48.2
guppy3==3.1.2
h5py==3.7.0
hdfs==2.7.0
httplib2==0.20.4
hypothesis==6.60.0
idna==3.4
importlib-metadata==5.1.0
iniconfig==1.1.1
joblib==1.2.0
keras==2.11.0
libclang==14.0.6
Markdown==3.4.1
MarkupSafe==2.1.1
mmh3==3.0.0
mock==2.0.0
msgpack==1.0.4
nltk==3.7
nose==1.3.7
numpy==1.21.6
oauth2client==4.1.3
oauthlib==3.2.2
objsize==0.6.1
opt-einsum==3.3.0
orjson==3.8.3
overrides==6.5.0
packaging==21.3
pandas==1.3.5
parameterized==0.8.1
pbr==5.11.0
pip==22.3.1
pluggy==1.0.0
proto-plus==1.22.1
protobuf==3.19.6
psycopg2-binary==2.9.5
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.13.0
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.2.0
pytest-forked==1.4.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.6
PyYAML==6.0
regex==2022.10.31
requests==2.28.1
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.0.2
scipy==1.7.3
setuptools==65.6.3
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.44
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.11.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.11.0
tensorflow-estimator==2.11.0
tensorflow-io-gcs-filesystem==0.28.0
termcolor==2.1.1
testcontainers==3.7.1
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.13
websocket-client==1.4.2
Werkzeug==2.2.2
wheel==0.38.4
wrapt==1.14.1
zipp==3.11.0
zstandard==0.19.0
Removing intermediate container c2db7e5292ce
---> 8413e0d5bbb4
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
---> 85e604cd7648
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
---> e3f63b455a09
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
---> 429b37569906
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 2b12ee1008d9
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 6be1b8f21cc5
Removing intermediate container 6be1b8f21cc5
---> 464bcb8bdac4
Step 22/32 : FROM beam as third_party_licenses
---> 464bcb8bdac4
Step 23/32 : ARG pull_licenses
---> Running in 3ebb9c6821ee
Removing intermediate container 3ebb9c6821ee
---> 3eb28107bc17
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
---> a2ce1d6833ec
Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 5cb3dc52838c
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in e4437099ec54
Removing intermediate container e4437099ec54
---> 9d4de0b6f28b
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
---> 9b368ae79745
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 21e38bb2dccb
Collecting pip-licenses<4.0.0
Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.7/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.7/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.7/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=17390da9a0b6cda9018416ea68c42341377058148a526fa92be67556b5495361
Stored in directory: /root/.cache/pip/wheels/06/7f/53/a4d4981283f05f4678f6765305901f2f43911384b5bddfe8d9
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 142 dependencies
[0mRemoving intermediate container 21e38bb2dccb
---> e3b7b4a1518b
Step 29/32 : FROM beam
---> 464bcb8bdac4
Step 30/32 : ARG pull_licenses
---> Running in d8fee07a69a6
Removing intermediate container d8fee07a69a6
---> cd95153ff8ed
Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> 6aab3734358a
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 8d41a26c9a6b
Removing intermediate container 8d41a26c9a6b
---> 98325176c3bf
Successfully built 98325176c3bf
Successfully tagged apache/beam_python3.7_sdk:2.45.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208165244]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fd7683f485d4af7c64c358d005e9b76c506073d646a9f0fabba5f255660f96c5]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208165244] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fd7683f485d4af7c64c358d005e9b76c506073d646a9f0fabba5f255660f96c5])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fd7683f485d4af7c64c358d005e9b76c506073d646a9f0fabba5f255660f96c5
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fd7683f485d4af7c64c358d005e9b76c506073d646a9f0fabba5f255660f96c5].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208165244]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9e3b874514dd0c6b692faaedcb127530ba15663d5da1aa2992411b5567193380]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208165244] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9e3b874514dd0c6b692faaedcb127530ba15663d5da1aa2992411b5567193380])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9e3b874514dd0c6b692faaedcb127530ba15663d5da1aa2992411b5567193380
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9e3b874514dd0c6b692faaedcb127530ba15663d5da1aa2992411b5567193380].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 31m 8s
139 actionable tasks: 95 executed, 38 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/qacqpmaadfg7a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_PythonUsingJava_Dataflow #1260
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1260/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJava_Dataflow #1259
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1259/display/redirect?page=changes>
Changes:
[noreply] interface{} -> any for registration (#24600)
[noreply] Restrict tox to be in 3.x version (#24601)
[noreply] [Playground] support for Kafka-enabled examples (#24459)
------------------------------------------
[...truncated 546.94 KB...]
File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 1507, in apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 837, in apache_beam.runners.common.PerWindowInvoker.invoke_process
File "apache_beam/runners/common.py", line 983, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1897, in <lambda>
wrapper = lambda x, *args, **kwargs: [fn(x, *args, **kwargs)]
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/testing/util.py",> line 191, in _equal
raise BeamAssertException(msg)
apache_beam.testing.util.BeamAssertException: Failed assert: [1, 2, 3, 4, 5, 6, 7, 8, 9] == [127], unexpected elements [127], missing elements [1, 2, 3, 4, 5, 6, 7, 8, 9] [while running 'assert_that/Match']
FAILED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 837, in apache_beam.runners.common.PerWindowInvoker.invoke_process
File "apache_beam/runners/common.py", line 983, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1897, in <lambda>
wrapper = lambda x, *args, **kwargs: [fn(x, *args, **kwargs)]
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/testing/util.py",> line 191, in _equal
raise BeamAssertException(msg)
apache_beam.testing.util.BeamAssertException: Failed assert: [1, 2, 3, 4, 5, 6, 7, 8, 9] == [127], unexpected elements [127], missing elements [1, 2, 3, 4, 5, 6, 7, 8, 9]
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 63, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
File "dataflow_worker/shuffle_operations.py", line 65, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
File "dataflow_worker/shuffle_operations.py", line 79, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
File "dataflow_worker/shuffle_operations.py", line 80, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
File "dataflow_worker/shuffle_operations.py", line 84, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
File "apache_beam/runners/worker/operations.py", line 528, in apache_beam.runners.worker.operations.Operation.output
File "apache_beam/runners/worker/operations.py", line 237, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "dataflow_worker/shuffle_operations.py", line 261, in dataflow_worker.shuffle_operations.BatchGroupAlsoByWindowsOperation.process
File "dataflow_worker/shuffle_operations.py", line 268, in dataflow_worker.shuffle_operations.BatchGroupAlsoByWindowsOperation.process
File "apache_beam/runners/worker/operations.py", line 528, in apache_beam.runners.worker.operations.Operation.output
File "apache_beam/runners/worker/operations.py", line 237, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 1507, in apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 837, in apache_beam.runners.common.PerWindowInvoker.invoke_process
File "apache_beam/runners/common.py", line 983, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1897, in <lambda>
wrapper = lambda x, *args, **kwargs: [fn(x, *args, **kwargs)]
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/testing/util.py",> line 191, in _equal
raise BeamAssertException(msg)
apache_beam.testing.util.BeamAssertException: Failed assert: [1, 2, 3, 4, 5, 6, 7, 8, 9] == [127], unexpected elements [127], missing elements [1, 2, 3, 4, 5, 6, 7, 8, 9] [while running 'assert_that/Match']
FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start
File "dataflow_worker/native_operations.py", line 40, in dataflow_worker.native_operations.NativeReadOperation.start
File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start
File "dataflow_worker/native_operations.py", line 48, in dataflow_worker.native_operations.NativeReadOperation.start
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/inmemory.py", line 108, in __iter__
yield self._source.coder.decode(value)
File "/usr/local/lib/python3.7/site-packages/apache_beam/coders/coders.py", line 475, in decode
return self.get_impl().decode(encoded)
File "apache_beam/coders/coder_impl.py", line 239, in apache_beam.coders.coder_impl.StreamCoderImpl.decode
File "apache_beam/coders/coder_impl.py", line 241, in apache_beam.coders.coder_impl.StreamCoderImpl.decode
File "apache_beam/coders/coder_impl.py", line 586, in apache_beam.coders.coder_impl.FastPrimitivesCoderImpl.decode_from_stream
ValueError: Unknown type tag 7f
FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start
File "dataflow_worker/native_operations.py", line 40, in dataflow_worker.native_operations.NativeReadOperation.start
File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start
File "dataflow_worker/native_operations.py", line 48, in dataflow_worker.native_operations.NativeReadOperation.start
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/inmemory.py", line 108, in __iter__
yield self._source.coder.decode(value)
File "/usr/local/lib/python3.7/site-packages/apache_beam/coders/coders.py", line 475, in decode
return self.get_impl().decode(encoded)
File "apache_beam/coders/coder_impl.py", line 239, in apache_beam.coders.coder_impl.StreamCoderImpl.decode
File "apache_beam/coders/coder_impl.py", line 241, in apache_beam.coders.coder_impl.StreamCoderImpl.decode
File "apache_beam/coders/coder_impl.py", line 1016, in apache_beam.coders.coder_impl.AbstractComponentCoderImpl.decode_from_stream
File "apache_beam/coders/coder_impl.py", line 1210, in apache_beam.coders.coder_impl.SequenceCoderImpl.decode_from_stream
File "apache_beam/coders/coder_impl.py", line 274, in apache_beam.coders.coder_impl.CallbackCoderImpl.decode_from_stream
File "/usr/local/lib/python3.7/site-packages/apache_beam/coders/coders.py", line 432, in decode
return value.decode('utf-8')
UnicodeDecodeError: 'utf-8' codec can't decode byte 0x90 in position 8: invalid start byte
FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start
File "dataflow_worker/native_operations.py", line 40, in dataflow_worker.native_operations.NativeReadOperation.start
File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start
File "dataflow_worker/native_operations.py", line 48, in dataflow_worker.native_operations.NativeReadOperation.start
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/inmemory.py", line 108, in __iter__
yield self._source.coder.decode(value)
File "/usr/local/lib/python3.7/site-packages/apache_beam/coders/coders.py", line 475, in decode
return self.get_impl().decode(encoded)
File "apache_beam/coders/coder_impl.py", line 239, in apache_beam.coders.coder_impl.StreamCoderImpl.decode
File "apache_beam/coders/coder_impl.py", line 241, in apache_beam.coders.coder_impl.StreamCoderImpl.decode
File "apache_beam/coders/coder_impl.py", line 1016, in apache_beam.coders.coder_impl.AbstractComponentCoderImpl.decode_from_stream
File "apache_beam/coders/coder_impl.py", line 274, in apache_beam.coders.coder_impl.CallbackCoderImpl.decode_from_stream
File "/usr/local/lib/python3.7/site-packages/apache_beam/coders/coders.py", line 432, in decode
return value.decode('utf-8')
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xdf in position 0: invalid continuation byte
FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start
File "dataflow_worker/native_operations.py", line 40, in dataflow_worker.native_operations.NativeReadOperation.start
File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start
File "dataflow_worker/native_operations.py", line 48, in dataflow_worker.native_operations.NativeReadOperation.start
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/inmemory.py", line 108, in __iter__
yield self._source.coder.decode(value)
File "/usr/local/lib/python3.7/site-packages/apache_beam/coders/coders.py", line 475, in decode
return self.get_impl().decode(encoded)
File "apache_beam/coders/coder_impl.py", line 239, in apache_beam.coders.coder_impl.StreamCoderImpl.decode
File "apache_beam/coders/coder_impl.py", line 241, in apache_beam.coders.coder_impl.StreamCoderImpl.decode
File "apache_beam/coders/coder_impl.py", line 586, in apache_beam.coders.coder_impl.FastPrimitivesCoderImpl.decode_from_stream
ValueError: Unknown type tag 7f
FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start
File "dataflow_worker/native_operations.py", line 40, in dataflow_worker.native_operations.NativeReadOperation.start
File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start
File "dataflow_worker/native_operations.py", line 48, in dataflow_worker.native_operations.NativeReadOperation.start
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/inmemory.py", line 108, in __iter__
yield self._source.coder.decode(value)
File "/usr/local/lib/python3.7/site-packages/apache_beam/coders/coders.py", line 432, in decode
return value.decode('utf-8')
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xdf in position 1: invalid continuation byte
============ 10 failed, 5 skipped, 9 warnings in 1097.15s (0:18:17) ============
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221209165239
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e37f79082146e56eb68a9c7dcb58108c801db5592c5f5e6422027b3479af5808
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221209165239]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e37f79082146e56eb68a9c7dcb58108c801db5592c5f5e6422027b3479af5808]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221209165239] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e37f79082146e56eb68a9c7dcb58108c801db5592c5f5e6422027b3479af5808])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e37f79082146e56eb68a9c7dcb58108c801db5592c5f5e6422027b3479af5808
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e37f79082146e56eb68a9c7dcb58108c801db5592c5f5e6422027b3479af5808
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e37f79082146e56eb68a9c7dcb58108c801db5592c5f5e6422027b3479af5808].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221209165239
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7d92c4650f95b65011cfa516cc608bdd9fb4cb2de84639a96914bc38875fb68
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221209165239]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7d92c4650f95b65011cfa516cc608bdd9fb4cb2de84639a96914bc38875fb68]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221209165239] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7d92c4650f95b65011cfa516cc608bdd9fb4cb2de84639a96914bc38875fb68])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7d92c4650f95b65011cfa516cc608bdd9fb4cb2de84639a96914bc38875fb68
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7d92c4650f95b65011cfa516cc608bdd9fb4cb2de84639a96914bc38875fb68
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7d92c4650f95b65011cfa516cc608bdd9fb4cb2de84639a96914bc38875fb68].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1604604.
Stopping expansion service pid: 1604605.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 30m 31s
139 actionable tasks: 95 executed, 38 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/v3zwuixjwzrp6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJava_Dataflow #1258
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1258/display/redirect>
Changes:
------------------------------------------
[...truncated 549.53 KB...]
google-cloud-bigquery==3.4.0
google-cloud-bigquery-storage==2.16.2
google-cloud-bigtable==1.7.3
google-cloud-core==2.3.2
google-cloud-datastore==1.15.5
google-cloud-dlp==3.9.2
google-cloud-firestore==2.7.2
google-cloud-language==1.3.2
google-cloud-profiler==3.1.0
google-cloud-pubsub==2.13.11
google-cloud-pubsublite==1.6.0
google-cloud-recommendations-ai==0.7.1
google-cloud-spanner==3.24.0
google-cloud-storage==2.7.0
google-cloud-videointelligence==1.16.3
google-cloud-vision==3.1.4
google-crc32c==1.5.0
google-pasta==0.2.0
google-python-cloud-debugger==3.1
google-resumable-media==2.4.0
googleapis-common-protos==1.57.0
greenlet==2.0.1
grpc-google-iam-v1==0.12.4
grpcio==1.51.1
grpcio-status==1.48.2
guppy3==3.1.2
h5py==3.7.0
hdfs==2.7.0
httplib2==0.20.4
hypothesis==6.60.0
idna==3.4
importlib-metadata==5.1.0
iniconfig==1.1.1
joblib==1.2.0
keras==2.11.0
libclang==14.0.6
Markdown==3.4.1
MarkupSafe==2.1.1
mmh3==3.0.0
mock==2.0.0
msgpack==1.0.4
nltk==3.7
nose==1.3.7
numpy==1.21.6
oauth2client==4.1.3
oauthlib==3.2.2
objsize==0.6.1
opt-einsum==3.3.0
orjson==3.8.3
overrides==6.5.0
packaging==21.3
pandas==1.3.5
parameterized==0.8.1
pbr==5.11.0
pip==22.3.1
pluggy==1.0.0
proto-plus==1.22.1
protobuf==3.19.6
psycopg2-binary==2.9.5
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.13.0
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.2.0
pytest-forked==1.4.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.6
PyYAML==6.0
regex==2022.10.31
requests==2.28.1
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.0.2
scipy==1.7.3
setuptools==65.6.3
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.44
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.11.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.11.0
tensorflow-estimator==2.11.0
tensorflow-io-gcs-filesystem==0.28.0
termcolor==2.1.1
testcontainers==3.7.1
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.13
websocket-client==1.4.2
Werkzeug==2.2.2
wheel==0.38.4
wrapt==1.14.1
zipp==3.11.0
zstandard==0.19.0
Removing intermediate container e6d8939c7ebf
---> e10b5553cdb1
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
---> 595224d49fb6
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
---> 520fe79d3e23
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
---> 7c767dabd449
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> e334d8f55c8a
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 7a764af24f9d
Removing intermediate container 7a764af24f9d
---> 83f46724ebc1
Step 22/32 : FROM beam as third_party_licenses
---> 83f46724ebc1
Step 23/32 : ARG pull_licenses
---> Running in cb578f3473bf
Removing intermediate container cb578f3473bf
---> ea2b5335383d
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
---> f1dc438c7a97
Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 84eb2db103ce
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 1917d56f5b93
Removing intermediate container 1917d56f5b93
---> ecd2e8158c1a
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
---> 9b590f09bb28
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 2a5cd4915557
Collecting pip-licenses<4.0.0
Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.7/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.7/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.7/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=de9eac06fc6855d2e551733c9817148a1fa21ce66067f52b24f6c004e639f1a2
Stored in directory: /root/.cache/pip/wheels/06/7f/53/a4d4981283f05f4678f6765305901f2f43911384b5bddfe8d9
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 142 dependencies
[0mRemoving intermediate container 2a5cd4915557
---> a4bc1e41c622
Step 29/32 : FROM beam
---> 83f46724ebc1
Step 30/32 : ARG pull_licenses
---> Running in 763889b566c9
Removing intermediate container 763889b566c9
---> a31290a10707
Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> f2969615e869
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in ac9ada62f7cf
Removing intermediate container ac9ada62f7cf
---> 39ee566274e9
Successfully built 39ee566274e9
Successfully tagged apache/beam_python3.7_sdk:2.45.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221209105242]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:400e74ba53bd7fadb482c8bc072da50f5c32e458932fde11b290652431c5b4d7]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221209105242] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:400e74ba53bd7fadb482c8bc072da50f5c32e458932fde11b290652431c5b4d7])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:400e74ba53bd7fadb482c8bc072da50f5c32e458932fde11b290652431c5b4d7
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:400e74ba53bd7fadb482c8bc072da50f5c32e458932fde11b290652431c5b4d7].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221209105242]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:82a7bf4b20aa4ddb17834769fefe9bb9668e3f7ba2510e2039edcb2fdf64b5a7]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221209105242] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:82a7bf4b20aa4ddb17834769fefe9bb9668e3f7ba2510e2039edcb2fdf64b5a7])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:82a7bf4b20aa4ddb17834769fefe9bb9668e3f7ba2510e2039edcb2fdf64b5a7
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:82a7bf4b20aa4ddb17834769fefe9bb9668e3f7ba2510e2039edcb2fdf64b5a7].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 33m 35s
139 actionable tasks: 99 executed, 34 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/kyfb75r3tlago
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJava_Dataflow #1257
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1257/display/redirect?page=changes>
Changes:
[Kenneth Knowles] Turn rawtype checking back on for core Java SDK
[Kenneth Knowles] Eliminate null errors from JdbcIO
[noreply] docs(fix): Filter.whereFieldName(s?) ->
[hiandyzhang] ElasticsearchIO: Lower log level in flushBatch to avoid noisy log
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-10 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/>
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git --version # 'git version 2.25.1'
> git fetch --tags --force --progress -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --force --progress -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 58b4d46655d94374f3d3564752dc12eb98b95456 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 58b4d46655d94374f3d3564752dc12eb98b95456 # timeout=10
Commit message: "Merge pull request #24574: Turn rawtype checking back on for core Java SDK"
> git rev-list --no-walk e8814846f5bbd15ca63da587d2b004fc0613742f # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_XVR_PythonUsingJava_Dataflow] $ /bin/bash -xe /tmp/jenkins6996887193198331996.sh
+ echo '*** RUN CROSS-LANGUAGE DATAFLOW PYTHON WITH JAVA EXTERNAL TRANSFORMS USING PYTHON 3.7 ***'
*** RUN CROSS-LANGUAGE DATAFLOW PYTHON WITH JAVA EXTERNAL TRANSFORMS USING PYTHON 3.7 ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/gradlew> --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PpythonVersion=3.7 :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
Starting a Gradle Daemon, 2 busy Daemons could not be reused, use --status for details
Configuration on demand is an incubating feature.
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :buildSrc:assemble
> Task :buildSrc:spotlessGroovy FROM-CACHE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle FROM-CACHE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins FROM-CACHE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.19.3
go install golang.org/dl/go1.19.3@latest: no matching versions for query "latest"
FAILURE: Build failed with an exception.
* What went wrong:
Could not determine the dependencies of task ':sdks:java:container:goBuild'.
> Could not create task ':sdks:java:container:goPrepare'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 18s
10 actionable tasks: 4 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/tbd7rmseqpchg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJava_Dataflow #1256
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1256/display/redirect?page=changes>
Changes:
[Kenneth Knowles] Exclude IOs already split from Java Precommit job
[Kenneth Knowles] Move expansion services into appropriate precommits
[Kenneth Knowles] Split more IOs out of Java precommit
[Kenneth Knowles] Fix trigger paths for separated IOs
[noreply] Bump golang.org/x/net from 0.3.0 to 0.4.0 in /sdks (#24587)
[noreply] Replaced finalize with DoFn Teardown in Neo4jIO (#24571)
[Kenneth Knowles] Simplify bug report templates
[Kenneth Knowles] Fix bugs in issue template yml
[noreply] Fix issue templates (#24597)
[noreply] [#24024] Stop wrapping light weight functions with Contextful as they
[noreply] Sample window size as well (#24388)
[noreply] Implement Kafka Write Schema Transform (#24495)
------------------------------------------
[...truncated 541.83 KB...]
google-cloud-bigquery==3.4.0
google-cloud-bigquery-storage==2.16.2
google-cloud-bigtable==1.7.3
google-cloud-core==2.3.2
google-cloud-datastore==1.15.5
google-cloud-dlp==3.9.2
google-cloud-firestore==2.7.2
google-cloud-language==1.3.2
google-cloud-profiler==3.1.0
google-cloud-pubsub==2.13.11
google-cloud-pubsublite==1.6.0
google-cloud-recommendations-ai==0.7.1
google-cloud-spanner==3.24.0
google-cloud-storage==2.7.0
google-cloud-videointelligence==1.16.3
google-cloud-vision==3.1.4
google-crc32c==1.5.0
google-pasta==0.2.0
google-python-cloud-debugger==3.1
google-resumable-media==2.4.0
googleapis-common-protos==1.57.0
greenlet==2.0.1
grpc-google-iam-v1==0.12.4
grpcio==1.51.1
grpcio-status==1.48.2
guppy3==3.1.2
h5py==3.7.0
hdfs==2.7.0
httplib2==0.20.4
hypothesis==6.60.0
idna==3.4
importlib-metadata==5.1.0
iniconfig==1.1.1
joblib==1.2.0
keras==2.11.0
libclang==14.0.6
Markdown==3.4.1
MarkupSafe==2.1.1
mmh3==3.0.0
mock==2.0.0
msgpack==1.0.4
nltk==3.7
nose==1.3.7
numpy==1.21.6
oauth2client==4.1.3
oauthlib==3.2.2
objsize==0.6.1
opt-einsum==3.3.0
orjson==3.8.3
overrides==6.5.0
packaging==21.3
pandas==1.3.5
parameterized==0.8.1
pbr==5.11.0
pip==22.3.1
pluggy==1.0.0
proto-plus==1.22.1
protobuf==3.19.6
psycopg2-binary==2.9.5
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.13.0
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.2.0
pytest-forked==1.4.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.6
PyYAML==6.0
regex==2022.10.31
requests==2.28.1
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.0.2
scipy==1.7.3
setuptools==65.6.3
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.44
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.11.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.11.0
tensorflow-estimator==2.11.0
tensorflow-io-gcs-filesystem==0.28.0
termcolor==2.1.1
testcontainers==3.7.1
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.13
websocket-client==1.4.2
Werkzeug==2.2.2
wheel==0.38.4
wrapt==1.14.1
zipp==3.11.0
zstandard==0.19.0
Removing intermediate container e6d90b55fe0f
---> 31c762c90728
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
---> 68a47fb1a5ef
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
---> f1fb405981a3
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
---> 6dc66c425ae6
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 120d6f52d78b
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 4f7027c74b02
Removing intermediate container 4f7027c74b02
---> aebfc9867cd6
Step 22/32 : FROM beam as third_party_licenses
---> aebfc9867cd6
Step 23/32 : ARG pull_licenses
---> Running in d073da4d2721
Removing intermediate container d073da4d2721
---> 3f0fd6fb4fc7
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
---> b728d6d14121
Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> cb293cafc78d
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 24393df6a4ae
Removing intermediate container 24393df6a4ae
---> 751dd8ebcdad
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
---> e8f154f1435a
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in b6eebf80ced1
Collecting pip-licenses<4.0.0
Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.7/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.7/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.7/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=01582e23f6ed77353520bb3c5fd61db690d95fcbed062b7e66b57666a06d1ac9
Stored in directory: /root/.cache/pip/wheels/06/7f/53/a4d4981283f05f4678f6765305901f2f43911384b5bddfe8d9
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 142 dependencies
[0mRemoving intermediate container b6eebf80ced1
---> f9c78d72a777
Step 29/32 : FROM beam
---> aebfc9867cd6
Step 30/32 : ARG pull_licenses
---> Running in 62af50d3d85b
Removing intermediate container 62af50d3d85b
---> a2c86375127e
Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> 59c1ff159b5c
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in d4d983512a95
Removing intermediate container d4d983512a95
---> d5f55220b5e8
Successfully built d5f55220b5e8
Successfully tagged apache/beam_python3.7_sdk:2.45.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208225231]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ffaeee658545a7ca9a09ad2e1dce4a961d917e8a75197b8460e3bcf609e03b4f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208225231] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ffaeee658545a7ca9a09ad2e1dce4a961d917e8a75197b8460e3bcf609e03b4f])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ffaeee658545a7ca9a09ad2e1dce4a961d917e8a75197b8460e3bcf609e03b4f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ffaeee658545a7ca9a09ad2e1dce4a961d917e8a75197b8460e3bcf609e03b4f].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208225231]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2b7629d260e9b28a9ed5af79ebe7f25593f6fa7a32325acd1e84b8762b3d5aab]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208225231] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2b7629d260e9b28a9ed5af79ebe7f25593f6fa7a32325acd1e84b8762b3d5aab])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2b7629d260e9b28a9ed5af79ebe7f25593f6fa7a32325acd1e84b8762b3d5aab
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2b7629d260e9b28a9ed5af79ebe7f25593f6fa7a32325acd1e84b8762b3d5aab].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 30m 27s
139 actionable tasks: 102 executed, 31 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/oj6dh5cqg2zty
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org