Build failed in Jenkins: beam_PostCommit_Java_DataflowV2 #723

[Apache Jenkins Server <je...@builds.apache.org>]

See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/723/display/redirect?page=changes>

Changes:

[kileysok] Update windmill state map to resolve *IfAbsent methods immediately

[piotr.szczepanik] [BEAM-12356] Fixed last non-cached usage of DatasetService in BigQuery

[noreply] [BEAM-12977] Translates Reshuffle in Portable Mode with Samza native

[noreply] [BEAM-12982] Help users debug which JvmInitializer is running and when.


------------------------------------------
[...truncated 42.68 KB...]
> Task :sdks:java:extensions:protobuf:testClasses
> Task :sdks:java:extensions:protobuf:testJar
> Task :sdks:java:harness:shadowJar FROM-CACHE
> Task :sdks:java:container:buildLinuxAmd64
> Task :sdks:java:container:goBuild
> Task :sdks:java:container:java8:copySdkHarnessLauncher
> Task :runners:java-fn-execution:compileJava FROM-CACHE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar
> Task :sdks:java:expansion-service:compileJava FROM-CACHE
> Task :sdks:java:expansion-service:classes UP-TO-DATE
> Task :sdks:java:expansion-service:jar
> Task :runners:direct-java:compileJava FROM-CACHE
> Task :runners:direct-java:classes UP-TO-DATE
> Task :sdks:java:io:kafka:compileJava FROM-CACHE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :sdks:java:io:kafka:jar
> Task :sdks:java:extensions:ml:compileJava FROM-CACHE
> Task :sdks:java:extensions:ml:classes UP-TO-DATE
> Task :sdks:java:extensions:ml:jar
> Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:jar
> Task :sdks:java:container:java8:copyDockerfileDependencies
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
> Task :runners:google-cloud-dataflow-java:classes
> Task :runners:google-cloud-dataflow-java:jar
> Task :examples:java:compileJava FROM-CACHE
> Task :examples:java:classes UP-TO-DATE
> Task :examples:java:jar
> Task :runners:direct-java:shadowJar
> Task :examples:java:compileTestJava FROM-CACHE
> Task :examples:java:testClasses
> Task :examples:java:testJar
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:testClasses
> Task :sdks:java:io:google-cloud-platform:testJar
> Task :sdks:java:container:generateLicenseReport

> Task :sdks:java:container:pullLicenses
Copying already-fetched licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
Already using interpreter /usr/bin/python3
Using base prefix '/usr'
New python executable in <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python3>
Also creating executable in <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python>
Installing setuptools, pip, wheel...
done.
DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality.
Collecting beautifulsoup4<5.0,>=4.9.0
  Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB)
Collecting future<1.0.0,>=0.16.0
  Using cached future-0.18.2-py3-none-any.whl
Collecting pyyaml<6.0.0,>=3.12
  Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl
Collecting tenacity<6.0,>=5.0.2
  Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
  Using cached soupsieve-2.1-py3-none-any.whl (32 kB)
Collecting six>=1.9.0
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4
Successfully installed beautifulsoup4-4.10.0 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5
Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json>        --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>        --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> 
INFO:root:Pulling license for 209 dependencies using 16 threads.
INFO:root:pull_licenses_java.py succeed. It took 2.047418 seconds with 16 threads.
Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh

> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses

> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses
+ tee /output/licenses/list.csv
+ go-licenses csv github.com/apache/beam/sdks/java/container
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses

> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker

The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java]
1fb9342645cf: Preparing
d390a265fe69: Preparing
fd1f07861500: Preparing
9866d3925317: Preparing
afa2ef589269: Preparing
4da9b610a22b: Preparing
56c6658ace39: Preparing
ae82bbd705d6: Preparing
ab9440921c27: Preparing
706dca7d0f58: Preparing
e1fe7ee532b4: Preparing
dc5f213d5321: Preparing
ab19b46e9384: Preparing
080ef0ba5cc0: Preparing
d08e6b97bf21: Preparing
3054497613e6: Preparing
d35dc7f4c79e: Preparing
dabfe5b2ea81: Preparing
5e6a409f30b6: Preparing
4da9b610a22b: Waiting
56c6658ace39: Waiting
ae82bbd705d6: Waiting
ab9440921c27: Waiting
706dca7d0f58: Waiting
e1fe7ee532b4: Waiting
dc5f213d5321: Waiting
ab19b46e9384: Waiting
080ef0ba5cc0: Waiting
d08e6b97bf21: Waiting
3054497613e6: Waiting
d35dc7f4c79e: Waiting
dabfe5b2ea81: Waiting
5e6a409f30b6: Waiting
afa2ef589269: Pushed
d390a265fe69: Pushed
fd1f07861500: Pushed
4da9b610a22b: Pushed
1fb9342645cf: Pushed
9866d3925317: Pushed
ae82bbd705d6: Pushed
ab9440921c27: Pushed
ab19b46e9384: Layer already exists
080ef0ba5cc0: Layer already exists
d08e6b97bf21: Layer already exists
3054497613e6: Layer already exists
d35dc7f4c79e: Layer already exists
dabfe5b2ea81: Layer already exists
5e6a409f30b6: Layer already exists
dc5f213d5321: Pushed
e1fe7ee532b4: Pushed
56c6658ace39: Pushed
706dca7d0f58: Pushed
20210930000110: digest: sha256:884d0ad97e6358b826bbb73ea8908fbac0c087a476c6c55ed90f816971fff629 size: 4311

> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest

***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0930000654-924d1121
The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0930000654-924d1121
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1632960409344.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0930000654-924d1121
The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0930000654-924d1121
The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1632960409344.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage.
***********************************************************
***********************************************************

***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0930003228-59846d34
The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0930003228-59846d34
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1632961947541.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0930003228-59846d34
The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0930003228-59846d34
The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1632961947541.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage.
***********************************************************
***********************************************************

> Task :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest

org.apache.beam.sdk.io.gcp.bigquery.BigQueryNestedRecordsIT > testNestedRecords FAILED
    com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryNestedRecordsIT.java:102

38 tests completed, 1 failed, 2 skipped

> Task :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest FAILED

> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210930000110
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:884d0ad97e6358b826bbb73ea8908fbac0c087a476c6c55ed90f816971fff629
Deleted: sha256:fd94a1f52e433c3c74025e3144cb91d632e40d83f839d60811c8511b50c2731d
Deleted: sha256:f62650920966d02947bf2a8de0e2217d8c35c97ba43b2a0b64040768939e7eed
Deleted: sha256:ed22e067ed3497bb1408f81da2fba76b3e8a38e435e6f3be1a3dd25a12ee15ef
Deleted: sha256:3a698c7c89d58b916165990dc493580ad0472a6c116e8a39c80470f478ee56c9
Deleted: sha256:5f516a866b09c52c6223dabddeb7bda45845af052f29a61882cdf2054d9fb3bc
Deleted: sha256:f7a6eb0028be331f4b24912e726b2b867617625729ffb0bcb1ead7228315ba2e
Deleted: sha256:469df1c9a6d961c2cb9dc9422d38ddc886cd113d41830ba3aaf593338cbeffb0
Deleted: sha256:1fd04e77f237a4de4c2d9c6b2aef466675fa5a843dc8f5dc37d499f23cb355e7
Deleted: sha256:92a34f8136471882be707c3ab64c46647ca8ec93935fa8f7f81a401c2f38f481
Deleted: sha256:1097389a73433b457ef1399087e706fa4440130e703aa25d8c386e7df2b094db
Deleted: sha256:3656adb52bfeaec3d901c0ee2432ef4b07ad5e7884664831d793ada743f8ab00
Deleted: sha256:d7958c2be144cff5f41b03b81f161c0bf81ab494f7fc18e8d83169d4f1418f25
Deleted: sha256:a0951216699f92453a1dc3f5e8eaf98d82373b888f0e1b6b78e985cb3587a5f8
Deleted: sha256:f1a84a298b9931abde4eaf03ef51fab362c3b66d39b19ee3ea254959c0b0ea98
Deleted: sha256:57b756fadf9b7da1f93cad448dab59ec121e9451f163409e6521b2d99a18512d
Deleted: sha256:c9e4982bf8d39bc7385b960d3db46610390a3b6c5ab432d0bd2a0ca82ae05153
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210930000110]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:884d0ad97e6358b826bbb73ea8908fbac0c087a476c6c55ed90f816971fff629]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210930000110] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:884d0ad97e6358b826bbb73ea8908fbac0c087a476c6c55ed90f816971fff629])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:884d0ad97e6358b826bbb73ea8908fbac0c087a476c6c55ed90f816971fff629
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:884d0ad97e6358b826bbb73ea8908fbac0c087a476c6c55ed90f816971fff629
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:884d0ad97e6358b826bbb73ea8908fbac0c087a476c6c55ed90f816971fff629].

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html>

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 51m 5s
129 actionable tasks: 88 executed, 39 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/4t62zlhte3cku

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Jenkins build is back to normal : beam_PostCommit_Java_DataflowV2 #724

[Apache Jenkins Server <je...@builds.apache.org>]

See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/724/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org