You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/12/08 17:23:40 UTC

Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJava_Dataflow #1255

See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1255/display/redirect?page=changes>

Changes:

[noreply] [Tour Of Beam] Playground Router GRPC API host (#24542)


------------------------------------------
[...truncated 541.57 KB...]
google-cloud-bigquery==3.4.0
google-cloud-bigquery-storage==2.16.2
google-cloud-bigtable==1.7.3
google-cloud-core==2.3.2
google-cloud-datastore==1.15.5
google-cloud-dlp==3.9.2
google-cloud-firestore==2.7.2
google-cloud-language==1.3.2
google-cloud-profiler==3.1.0
google-cloud-pubsub==2.13.11
google-cloud-pubsublite==1.6.0
google-cloud-recommendations-ai==0.7.1
google-cloud-spanner==3.24.0
google-cloud-storage==2.7.0
google-cloud-videointelligence==1.16.3
google-cloud-vision==3.1.4
google-crc32c==1.5.0
google-pasta==0.2.0
google-python-cloud-debugger==3.1
google-resumable-media==2.4.0
googleapis-common-protos==1.57.0
greenlet==2.0.1
grpc-google-iam-v1==0.12.4
grpcio==1.51.1
grpcio-status==1.48.2
guppy3==3.1.2
h5py==3.7.0
hdfs==2.7.0
httplib2==0.20.4
hypothesis==6.60.0
idna==3.4
importlib-metadata==5.1.0
iniconfig==1.1.1
joblib==1.2.0
keras==2.11.0
libclang==14.0.6
Markdown==3.4.1
MarkupSafe==2.1.1
mmh3==3.0.0
mock==2.0.0
msgpack==1.0.4
nltk==3.7
nose==1.3.7
numpy==1.21.6
oauth2client==4.1.3
oauthlib==3.2.2
objsize==0.6.1
opt-einsum==3.3.0
orjson==3.8.3
overrides==6.5.0
packaging==21.3
pandas==1.3.5
parameterized==0.8.1
pbr==5.11.0
pip==22.3.1
pluggy==1.0.0
proto-plus==1.22.1
protobuf==3.19.6
psycopg2-binary==2.9.5
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.13.0
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.2.0
pytest-forked==1.4.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.6
PyYAML==6.0
regex==2022.10.31
requests==2.28.1
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.0.2
scipy==1.7.3
setuptools==65.6.3
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.44
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.11.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.11.0
tensorflow-estimator==2.11.0
tensorflow-io-gcs-filesystem==0.28.0
termcolor==2.1.1
testcontainers==3.7.1
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.13
websocket-client==1.4.2
Werkzeug==2.2.2
wheel==0.38.4
wrapt==1.14.1
zipp==3.11.0
zstandard==0.19.0
Removing intermediate container c2db7e5292ce
 ---> 8413e0d5bbb4
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
 ---> 85e604cd7648
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
 ---> e3f63b455a09
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
 ---> 429b37569906
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
 ---> 2b12ee1008d9
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in 6be1b8f21cc5
Removing intermediate container 6be1b8f21cc5
 ---> 464bcb8bdac4
Step 22/32 : FROM beam as third_party_licenses
 ---> 464bcb8bdac4
Step 23/32 : ARG pull_licenses
 ---> Running in 3ebb9c6821ee
Removing intermediate container 3ebb9c6821ee
 ---> 3eb28107bc17
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
 ---> a2ce1d6833ec
Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
 ---> 5cb3dc52838c
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in e4437099ec54
Removing intermediate container e4437099ec54
 ---> 9d4de0b6f28b
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
 ---> 9b368ae79745
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<4.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi
 ---> Running in 21e38bb2dccb
Collecting pip-licenses<4.0.0
  Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.7/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.7/site-packages (5.1.5)
Collecting PTable
  Downloading PTable-0.9.2.tar.gz (31 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.7/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
  Building wheel for PTable (setup.py): started
  Building wheel for PTable (setup.py): finished with status 'done'
  Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=17390da9a0b6cda9018416ea68c42341377058148a526fa92be67556b5495361
  Stored in directory: /root/.cache/pip/wheels/06/7f/53/a4d4981283f05f4678f6765305901f2f43911384b5bddfe8d9
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Skip pulling license for  bs4
INFO:root:Successfully pulled licenses for 142 dependencies
Removing intermediate container 21e38bb2dccb
 ---> e3b7b4a1518b
Step 29/32 : FROM beam
 ---> 464bcb8bdac4
Step 30/32 : ARG pull_licenses
 ---> Running in d8fee07a69a6
Removing intermediate container d8fee07a69a6
 ---> cd95153ff8ed
Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
 ---> 6aab3734358a
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then       rm -rf /opt/apache/beam/third_party_licenses ;     fi
 ---> Running in 8d41a26c9a6b
Removing intermediate container 8d41a26c9a6b
 ---> 98325176c3bf
Successfully built 98325176c3bf
Successfully tagged apache/beam_python3.7_sdk:2.45.0.dev

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker


> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE

> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208165244]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fd7683f485d4af7c64c358d005e9b76c506073d646a9f0fabba5f255660f96c5]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208165244] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fd7683f485d4af7c64c358d005e9b76c506073d646a9f0fabba5f255660f96c5])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fd7683f485d4af7c64c358d005e9b76c506073d646a9f0fabba5f255660f96c5
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fd7683f485d4af7c64c358d005e9b76c506073d646a9f0fabba5f255660f96c5].

> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208165244]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9e3b874514dd0c6b692faaedcb127530ba15663d5da1aa2992411b5567193380]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208165244] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9e3b874514dd0c6b692faaedcb127530ba15663d5da1aa2992411b5567193380])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9e3b874514dd0c6b692faaedcb127530ba15663d5da1aa2992411b5567193380
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9e3b874514dd0c6b692faaedcb127530ba15663d5da1aa2992411b5567193380].

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 31m 8s
139 actionable tasks: 95 executed, 38 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/qacqpmaadfg7a

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_XVR_PythonUsingJava_Dataflow #1260

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1260/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJava_Dataflow #1259

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1259/display/redirect?page=changes>

Changes:

[noreply] interface{} -> any for registration (#24600)

[noreply] Restrict tox to be in 3.x version (#24601)

[noreply] [Playground] support for Kafka-enabled examples (#24459)


------------------------------------------
[...truncated 546.94 KB...]
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1507, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 837, in apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 983, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1897, in <lambda>
    wrapper = lambda x, *args, **kwargs: [fn(x, *args, **kwargs)]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/testing/util.py",> line 191, in _equal
    raise BeamAssertException(msg)
apache_beam.testing.util.BeamAssertException: Failed assert: [1, 2, 3, 4, 5, 6, 7, 8, 9] == [127], unexpected elements [127], missing elements [1, 2, 3, 4, 5, 6, 7, 8, 9] [while running 'assert_that/Match']
FAILED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 837, in apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 983, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1897, in <lambda>
    wrapper = lambda x, *args, **kwargs: [fn(x, *args, **kwargs)]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/testing/util.py",> line 191, in _equal
    raise BeamAssertException(msg)
apache_beam.testing.util.BeamAssertException: Failed assert: [1, 2, 3, 4, 5, 6, 7, 8, 9] == [127], unexpected elements [127], missing elements [1, 2, 3, 4, 5, 6, 7, 8, 9]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
    work_executor.execute()
  File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 208, in execute
    op.start()
  File "dataflow_worker/shuffle_operations.py", line 63, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
  File "dataflow_worker/shuffle_operations.py", line 65, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
  File "dataflow_worker/shuffle_operations.py", line 79, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
  File "dataflow_worker/shuffle_operations.py", line 80, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
  File "dataflow_worker/shuffle_operations.py", line 84, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
  File "apache_beam/runners/worker/operations.py", line 528, in apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 237, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "dataflow_worker/shuffle_operations.py", line 261, in dataflow_worker.shuffle_operations.BatchGroupAlsoByWindowsOperation.process
  File "dataflow_worker/shuffle_operations.py", line 268, in dataflow_worker.shuffle_operations.BatchGroupAlsoByWindowsOperation.process
  File "apache_beam/runners/worker/operations.py", line 528, in apache_beam.runners.worker.operations.Operation.output
  File "apache_beam/runners/worker/operations.py", line 237, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1491, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 623, in apache_beam.runners.common.SimpleInvoker.invoke_process
  File "apache_beam/runners/common.py", line 1581, in apache_beam.runners.common._OutputHandler.handle_process_outputs
  File "apache_beam/runners/common.py", line 1694, in apache_beam.runners.common._OutputHandler._write_value_to_tag
  File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
  File "apache_beam/runners/worker/operations.py", line 907, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/worker/operations.py", line 908, in apache_beam.runners.worker.operations.DoOperation.process
  File "apache_beam/runners/common.py", line 1419, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 1507, in apache_beam.runners.common.DoFnRunner._reraise_augmented
  File "apache_beam/runners/common.py", line 1417, in apache_beam.runners.common.DoFnRunner.process
  File "apache_beam/runners/common.py", line 837, in apache_beam.runners.common.PerWindowInvoker.invoke_process
  File "apache_beam/runners/common.py", line 983, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1897, in <lambda>
    wrapper = lambda x, *args, **kwargs: [fn(x, *args, **kwargs)]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/testing/util.py",> line 191, in _equal
    raise BeamAssertException(msg)
apache_beam.testing.util.BeamAssertException: Failed assert: [1, 2, 3, 4, 5, 6, 7, 8, 9] == [127], unexpected elements [127], missing elements [1, 2, 3, 4, 5, 6, 7, 8, 9] [while running 'assert_that/Match']
FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
    work_executor.execute()
  File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 208, in execute
    op.start()
  File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start
  File "dataflow_worker/native_operations.py", line 40, in dataflow_worker.native_operations.NativeReadOperation.start
  File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start
  File "dataflow_worker/native_operations.py", line 48, in dataflow_worker.native_operations.NativeReadOperation.start
  File "/usr/local/lib/python3.7/site-packages/dataflow_worker/inmemory.py", line 108, in __iter__
    yield self._source.coder.decode(value)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/coders/coders.py", line 475, in decode
    return self.get_impl().decode(encoded)
  File "apache_beam/coders/coder_impl.py", line 239, in apache_beam.coders.coder_impl.StreamCoderImpl.decode
  File "apache_beam/coders/coder_impl.py", line 241, in apache_beam.coders.coder_impl.StreamCoderImpl.decode
  File "apache_beam/coders/coder_impl.py", line 586, in apache_beam.coders.coder_impl.FastPrimitivesCoderImpl.decode_from_stream
ValueError: Unknown type tag 7f
FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
    work_executor.execute()
  File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 208, in execute
    op.start()
  File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start
  File "dataflow_worker/native_operations.py", line 40, in dataflow_worker.native_operations.NativeReadOperation.start
  File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start
  File "dataflow_worker/native_operations.py", line 48, in dataflow_worker.native_operations.NativeReadOperation.start
  File "/usr/local/lib/python3.7/site-packages/dataflow_worker/inmemory.py", line 108, in __iter__
    yield self._source.coder.decode(value)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/coders/coders.py", line 475, in decode
    return self.get_impl().decode(encoded)
  File "apache_beam/coders/coder_impl.py", line 239, in apache_beam.coders.coder_impl.StreamCoderImpl.decode
  File "apache_beam/coders/coder_impl.py", line 241, in apache_beam.coders.coder_impl.StreamCoderImpl.decode
  File "apache_beam/coders/coder_impl.py", line 1016, in apache_beam.coders.coder_impl.AbstractComponentCoderImpl.decode_from_stream
  File "apache_beam/coders/coder_impl.py", line 1210, in apache_beam.coders.coder_impl.SequenceCoderImpl.decode_from_stream
  File "apache_beam/coders/coder_impl.py", line 274, in apache_beam.coders.coder_impl.CallbackCoderImpl.decode_from_stream
  File "/usr/local/lib/python3.7/site-packages/apache_beam/coders/coders.py", line 432, in decode
    return value.decode('utf-8')
UnicodeDecodeError: 'utf-8' codec can't decode byte 0x90 in position 8: invalid start byte
FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
    work_executor.execute()
  File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 208, in execute
    op.start()
  File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start
  File "dataflow_worker/native_operations.py", line 40, in dataflow_worker.native_operations.NativeReadOperation.start
  File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start
  File "dataflow_worker/native_operations.py", line 48, in dataflow_worker.native_operations.NativeReadOperation.start
  File "/usr/local/lib/python3.7/site-packages/dataflow_worker/inmemory.py", line 108, in __iter__
    yield self._source.coder.decode(value)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/coders/coders.py", line 475, in decode
    return self.get_impl().decode(encoded)
  File "apache_beam/coders/coder_impl.py", line 239, in apache_beam.coders.coder_impl.StreamCoderImpl.decode
  File "apache_beam/coders/coder_impl.py", line 241, in apache_beam.coders.coder_impl.StreamCoderImpl.decode
  File "apache_beam/coders/coder_impl.py", line 1016, in apache_beam.coders.coder_impl.AbstractComponentCoderImpl.decode_from_stream
  File "apache_beam/coders/coder_impl.py", line 274, in apache_beam.coders.coder_impl.CallbackCoderImpl.decode_from_stream
  File "/usr/local/lib/python3.7/site-packages/apache_beam/coders/coders.py", line 432, in decode
    return value.decode('utf-8')
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xdf in position 0: invalid continuation byte
FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
    work_executor.execute()
  File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 208, in execute
    op.start()
  File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start
  File "dataflow_worker/native_operations.py", line 40, in dataflow_worker.native_operations.NativeReadOperation.start
  File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start
  File "dataflow_worker/native_operations.py", line 48, in dataflow_worker.native_operations.NativeReadOperation.start
  File "/usr/local/lib/python3.7/site-packages/dataflow_worker/inmemory.py", line 108, in __iter__
    yield self._source.coder.decode(value)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/coders/coders.py", line 475, in decode
    return self.get_impl().decode(encoded)
  File "apache_beam/coders/coder_impl.py", line 239, in apache_beam.coders.coder_impl.StreamCoderImpl.decode
  File "apache_beam/coders/coder_impl.py", line 241, in apache_beam.coders.coder_impl.StreamCoderImpl.decode
  File "apache_beam/coders/coder_impl.py", line 586, in apache_beam.coders.coder_impl.FastPrimitivesCoderImpl.decode_from_stream
ValueError: Unknown type tag 7f
FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
    work_executor.execute()
  File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 208, in execute
    op.start()
  File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start
  File "dataflow_worker/native_operations.py", line 40, in dataflow_worker.native_operations.NativeReadOperation.start
  File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start
  File "dataflow_worker/native_operations.py", line 48, in dataflow_worker.native_operations.NativeReadOperation.start
  File "/usr/local/lib/python3.7/site-packages/dataflow_worker/inmemory.py", line 108, in __iter__
    yield self._source.coder.decode(value)
  File "/usr/local/lib/python3.7/site-packages/apache_beam/coders/coders.py", line 432, in decode
    return value.decode('utf-8')
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xdf in position 1: invalid continuation byte
============ 10 failed, 5 skipped, 9 warnings in 1097.15s (0:18:17) ============

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE

> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221209165239
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e37f79082146e56eb68a9c7dcb58108c801db5592c5f5e6422027b3479af5808
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221209165239]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e37f79082146e56eb68a9c7dcb58108c801db5592c5f5e6422027b3479af5808]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221209165239] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e37f79082146e56eb68a9c7dcb58108c801db5592c5f5e6422027b3479af5808])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e37f79082146e56eb68a9c7dcb58108c801db5592c5f5e6422027b3479af5808
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e37f79082146e56eb68a9c7dcb58108c801db5592c5f5e6422027b3479af5808
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e37f79082146e56eb68a9c7dcb58108c801db5592c5f5e6422027b3479af5808].

> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221209165239
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7d92c4650f95b65011cfa516cc608bdd9fb4cb2de84639a96914bc38875fb68
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221209165239]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7d92c4650f95b65011cfa516cc608bdd9fb4cb2de84639a96914bc38875fb68]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221209165239] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7d92c4650f95b65011cfa516cc608bdd9fb4cb2de84639a96914bc38875fb68])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7d92c4650f95b65011cfa516cc608bdd9fb4cb2de84639a96914bc38875fb68
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7d92c4650f95b65011cfa516cc608bdd9fb4cb2de84639a96914bc38875fb68
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7d92c4650f95b65011cfa516cc608bdd9fb4cb2de84639a96914bc38875fb68].

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1604604.
Stopping expansion service pid: 1604605.

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 30m 31s
139 actionable tasks: 95 executed, 38 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/v3zwuixjwzrp6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJava_Dataflow #1258

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1258/display/redirect>

Changes:


------------------------------------------
[...truncated 549.53 KB...]
google-cloud-bigquery==3.4.0
google-cloud-bigquery-storage==2.16.2
google-cloud-bigtable==1.7.3
google-cloud-core==2.3.2
google-cloud-datastore==1.15.5
google-cloud-dlp==3.9.2
google-cloud-firestore==2.7.2
google-cloud-language==1.3.2
google-cloud-profiler==3.1.0
google-cloud-pubsub==2.13.11
google-cloud-pubsublite==1.6.0
google-cloud-recommendations-ai==0.7.1
google-cloud-spanner==3.24.0
google-cloud-storage==2.7.0
google-cloud-videointelligence==1.16.3
google-cloud-vision==3.1.4
google-crc32c==1.5.0
google-pasta==0.2.0
google-python-cloud-debugger==3.1
google-resumable-media==2.4.0
googleapis-common-protos==1.57.0
greenlet==2.0.1
grpc-google-iam-v1==0.12.4
grpcio==1.51.1
grpcio-status==1.48.2
guppy3==3.1.2
h5py==3.7.0
hdfs==2.7.0
httplib2==0.20.4
hypothesis==6.60.0
idna==3.4
importlib-metadata==5.1.0
iniconfig==1.1.1
joblib==1.2.0
keras==2.11.0
libclang==14.0.6
Markdown==3.4.1
MarkupSafe==2.1.1
mmh3==3.0.0
mock==2.0.0
msgpack==1.0.4
nltk==3.7
nose==1.3.7
numpy==1.21.6
oauth2client==4.1.3
oauthlib==3.2.2
objsize==0.6.1
opt-einsum==3.3.0
orjson==3.8.3
overrides==6.5.0
packaging==21.3
pandas==1.3.5
parameterized==0.8.1
pbr==5.11.0
pip==22.3.1
pluggy==1.0.0
proto-plus==1.22.1
protobuf==3.19.6
psycopg2-binary==2.9.5
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.13.0
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.2.0
pytest-forked==1.4.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.6
PyYAML==6.0
regex==2022.10.31
requests==2.28.1
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.0.2
scipy==1.7.3
setuptools==65.6.3
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.44
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.11.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.11.0
tensorflow-estimator==2.11.0
tensorflow-io-gcs-filesystem==0.28.0
termcolor==2.1.1
testcontainers==3.7.1
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.13
websocket-client==1.4.2
Werkzeug==2.2.2
wheel==0.38.4
wrapt==1.14.1
zipp==3.11.0
zstandard==0.19.0
Removing intermediate container e6d8939c7ebf
 ---> e10b5553cdb1
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
 ---> 595224d49fb6
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
 ---> 520fe79d3e23
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
 ---> 7c767dabd449
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
 ---> e334d8f55c8a
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in 7a764af24f9d
Removing intermediate container 7a764af24f9d
 ---> 83f46724ebc1
Step 22/32 : FROM beam as third_party_licenses
 ---> 83f46724ebc1
Step 23/32 : ARG pull_licenses
 ---> Running in cb578f3473bf
Removing intermediate container cb578f3473bf
 ---> ea2b5335383d
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
 ---> f1dc438c7a97
Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
 ---> 84eb2db103ce
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in 1917d56f5b93
Removing intermediate container 1917d56f5b93
 ---> ecd2e8158c1a
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
 ---> 9b590f09bb28
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<4.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi
 ---> Running in 2a5cd4915557
Collecting pip-licenses<4.0.0
  Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.7/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.7/site-packages (5.1.5)
Collecting PTable
  Downloading PTable-0.9.2.tar.gz (31 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.7/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
  Building wheel for PTable (setup.py): started
  Building wheel for PTable (setup.py): finished with status 'done'
  Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=de9eac06fc6855d2e551733c9817148a1fa21ce66067f52b24f6c004e639f1a2
  Stored in directory: /root/.cache/pip/wheels/06/7f/53/a4d4981283f05f4678f6765305901f2f43911384b5bddfe8d9
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Skip pulling license for  bs4
INFO:root:Successfully pulled licenses for 142 dependencies
Removing intermediate container 2a5cd4915557
 ---> a4bc1e41c622
Step 29/32 : FROM beam
 ---> 83f46724ebc1
Step 30/32 : ARG pull_licenses
 ---> Running in 763889b566c9
Removing intermediate container 763889b566c9
 ---> a31290a10707
Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
 ---> f2969615e869
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then       rm -rf /opt/apache/beam/third_party_licenses ;     fi
 ---> Running in ac9ada62f7cf
Removing intermediate container ac9ada62f7cf
 ---> 39ee566274e9
Successfully built 39ee566274e9
Successfully tagged apache/beam_python3.7_sdk:2.45.0.dev

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker


> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE

> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221209105242]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:400e74ba53bd7fadb482c8bc072da50f5c32e458932fde11b290652431c5b4d7]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221209105242] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:400e74ba53bd7fadb482c8bc072da50f5c32e458932fde11b290652431c5b4d7])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:400e74ba53bd7fadb482c8bc072da50f5c32e458932fde11b290652431c5b4d7
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:400e74ba53bd7fadb482c8bc072da50f5c32e458932fde11b290652431c5b4d7].

> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221209105242]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:82a7bf4b20aa4ddb17834769fefe9bb9668e3f7ba2510e2039edcb2fdf64b5a7]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221209105242] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:82a7bf4b20aa4ddb17834769fefe9bb9668e3f7ba2510e2039edcb2fdf64b5a7])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:82a7bf4b20aa4ddb17834769fefe9bb9668e3f7ba2510e2039edcb2fdf64b5a7
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:82a7bf4b20aa4ddb17834769fefe9bb9668e3f7ba2510e2039edcb2fdf64b5a7].

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 33m 35s
139 actionable tasks: 99 executed, 34 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/kyfb75r3tlago

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJava_Dataflow #1257

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1257/display/redirect?page=changes>

Changes:

[Kenneth Knowles] Turn rawtype checking back on for core Java SDK

[Kenneth Knowles] Eliminate null errors from JdbcIO

[noreply] docs(fix): Filter.whereFieldName(s?) ->

[hiandyzhang] ElasticsearchIO: Lower log level in flushBatch to avoid noisy log


------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-10 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/>
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
 > git init <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git --version # 'git version 2.25.1'
 > git fetch --tags --force --progress -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git fetch --tags --force --progress -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 58b4d46655d94374f3d3564752dc12eb98b95456 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 58b4d46655d94374f3d3564752dc12eb98b95456 # timeout=10
Commit message: "Merge pull request #24574: Turn rawtype checking back on for core Java SDK"
 > git rev-list --no-walk e8814846f5bbd15ca63da587d2b004fc0613742f # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[beam_PostCommit_XVR_PythonUsingJava_Dataflow] $ /bin/bash -xe /tmp/jenkins6996887193198331996.sh
+ echo '*** RUN CROSS-LANGUAGE DATAFLOW PYTHON WITH JAVA EXTERNAL TRANSFORMS USING PYTHON 3.7 ***'
*** RUN CROSS-LANGUAGE DATAFLOW PYTHON WITH JAVA EXTERNAL TRANSFORMS USING PYTHON 3.7 ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/gradlew> --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PpythonVersion=3.7 :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
Starting a Gradle Daemon, 2 busy Daemons could not be reused, use --status for details
Configuration on demand is an incubating feature.
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :buildSrc:assemble
> Task :buildSrc:spotlessGroovy FROM-CACHE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle FROM-CACHE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins FROM-CACHE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.19.3
go install golang.org/dl/go1.19.3@latest: no matching versions for query "latest"

FAILURE: Build failed with an exception.

* What went wrong:
Could not determine the dependencies of task ':sdks:java:container:goBuild'.
> Could not create task ':sdks:java:container:goPrepare'.
   > Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1m 18s
10 actionable tasks: 4 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/tbd7rmseqpchg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJava_Dataflow #1256

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1256/display/redirect?page=changes>

Changes:

[Kenneth Knowles] Exclude IOs already split from Java Precommit job

[Kenneth Knowles] Move expansion services into appropriate precommits

[Kenneth Knowles] Split more IOs out of Java precommit

[Kenneth Knowles] Fix trigger paths for separated IOs

[noreply] Bump golang.org/x/net from 0.3.0 to 0.4.0 in /sdks (#24587)

[noreply] Replaced finalize with DoFn Teardown in Neo4jIO (#24571)

[Kenneth Knowles] Simplify bug report templates

[Kenneth Knowles] Fix bugs in issue template yml

[noreply] Fix issue templates (#24597)

[noreply] [#24024] Stop wrapping light weight functions with Contextful as they

[noreply] Sample window size as well (#24388)

[noreply] Implement Kafka Write Schema Transform (#24495)


------------------------------------------
[...truncated 541.83 KB...]
google-cloud-bigquery==3.4.0
google-cloud-bigquery-storage==2.16.2
google-cloud-bigtable==1.7.3
google-cloud-core==2.3.2
google-cloud-datastore==1.15.5
google-cloud-dlp==3.9.2
google-cloud-firestore==2.7.2
google-cloud-language==1.3.2
google-cloud-profiler==3.1.0
google-cloud-pubsub==2.13.11
google-cloud-pubsublite==1.6.0
google-cloud-recommendations-ai==0.7.1
google-cloud-spanner==3.24.0
google-cloud-storage==2.7.0
google-cloud-videointelligence==1.16.3
google-cloud-vision==3.1.4
google-crc32c==1.5.0
google-pasta==0.2.0
google-python-cloud-debugger==3.1
google-resumable-media==2.4.0
googleapis-common-protos==1.57.0
greenlet==2.0.1
grpc-google-iam-v1==0.12.4
grpcio==1.51.1
grpcio-status==1.48.2
guppy3==3.1.2
h5py==3.7.0
hdfs==2.7.0
httplib2==0.20.4
hypothesis==6.60.0
idna==3.4
importlib-metadata==5.1.0
iniconfig==1.1.1
joblib==1.2.0
keras==2.11.0
libclang==14.0.6
Markdown==3.4.1
MarkupSafe==2.1.1
mmh3==3.0.0
mock==2.0.0
msgpack==1.0.4
nltk==3.7
nose==1.3.7
numpy==1.21.6
oauth2client==4.1.3
oauthlib==3.2.2
objsize==0.6.1
opt-einsum==3.3.0
orjson==3.8.3
overrides==6.5.0
packaging==21.3
pandas==1.3.5
parameterized==0.8.1
pbr==5.11.0
pip==22.3.1
pluggy==1.0.0
proto-plus==1.22.1
protobuf==3.19.6
psycopg2-binary==2.9.5
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.13.0
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.2.0
pytest-forked==1.4.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.6
PyYAML==6.0
regex==2022.10.31
requests==2.28.1
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.0.2
scipy==1.7.3
setuptools==65.6.3
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.44
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.11.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.11.0
tensorflow-estimator==2.11.0
tensorflow-io-gcs-filesystem==0.28.0
termcolor==2.1.1
testcontainers==3.7.1
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.13
websocket-client==1.4.2
Werkzeug==2.2.2
wheel==0.38.4
wrapt==1.14.1
zipp==3.11.0
zstandard==0.19.0
Removing intermediate container e6d90b55fe0f
 ---> 31c762c90728
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
 ---> 68a47fb1a5ef
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
 ---> f1fb405981a3
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
 ---> 6dc66c425ae6
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
 ---> 120d6f52d78b
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in 4f7027c74b02
Removing intermediate container 4f7027c74b02
 ---> aebfc9867cd6
Step 22/32 : FROM beam as third_party_licenses
 ---> aebfc9867cd6
Step 23/32 : ARG pull_licenses
 ---> Running in d073da4d2721
Removing intermediate container d073da4d2721
 ---> 3f0fd6fb4fc7
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
 ---> b728d6d14121
Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
 ---> cb293cafc78d
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in 24393df6a4ae
Removing intermediate container 24393df6a4ae
 ---> 751dd8ebcdad
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
 ---> e8f154f1435a
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<4.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi
 ---> Running in b6eebf80ced1
Collecting pip-licenses<4.0.0
  Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.7/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.7/site-packages (5.1.5)
Collecting PTable
  Downloading PTable-0.9.2.tar.gz (31 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.7/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
  Building wheel for PTable (setup.py): started
  Building wheel for PTable (setup.py): finished with status 'done'
  Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=01582e23f6ed77353520bb3c5fd61db690d95fcbed062b7e66b57666a06d1ac9
  Stored in directory: /root/.cache/pip/wheels/06/7f/53/a4d4981283f05f4678f6765305901f2f43911384b5bddfe8d9
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Skip pulling license for  bs4
INFO:root:Successfully pulled licenses for 142 dependencies
Removing intermediate container b6eebf80ced1
 ---> f9c78d72a777
Step 29/32 : FROM beam
 ---> aebfc9867cd6
Step 30/32 : ARG pull_licenses
 ---> Running in 62af50d3d85b
Removing intermediate container 62af50d3d85b
 ---> a2c86375127e
Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
 ---> 59c1ff159b5c
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then       rm -rf /opt/apache/beam/third_party_licenses ;     fi
 ---> Running in d4d983512a95
Removing intermediate container d4d983512a95
 ---> d5f55220b5e8
Successfully built d5f55220b5e8
Successfully tagged apache/beam_python3.7_sdk:2.45.0.dev

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker


> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE

> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208225231]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ffaeee658545a7ca9a09ad2e1dce4a961d917e8a75197b8460e3bcf609e03b4f]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208225231] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ffaeee658545a7ca9a09ad2e1dce4a961d917e8a75197b8460e3bcf609e03b4f])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ffaeee658545a7ca9a09ad2e1dce4a961d917e8a75197b8460e3bcf609e03b4f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ffaeee658545a7ca9a09ad2e1dce4a961d917e8a75197b8460e3bcf609e03b4f].

> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208225231]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2b7629d260e9b28a9ed5af79ebe7f25593f6fa7a32325acd1e84b8762b3d5aab]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208225231] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2b7629d260e9b28a9ed5af79ebe7f25593f6fa7a32325acd1e84b8762b3d5aab])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2b7629d260e9b28a9ed5af79ebe7f25593f6fa7a32325acd1e84b8762b3d5aab
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2b7629d260e9b28a9ed5af79ebe7f25593f6fa7a32325acd1e84b8762b3d5aab].

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 30m 27s
139 actionable tasks: 102 executed, 31 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/oj6dh5cqg2zty

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org