You are viewing a plain text version of this content. The canonical link for it is here.

Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/04/28 01:23:31 UTC

Build failed in Jenkins: beam_PostCommit_Java_DataflowV2 #133

See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/133/display/redirect?page=changes>

Changes:

[ajamato] [BEAM-11994] Refactor BigQueryTornadoes to make more options

[zyichi] [BEAM-12221] Add experimental pipeline option to control the execution

[Kenneth Knowles] Add View.toList pipeline to translator tests

[Kenneth Knowles] Temporarily disable FnApiDoFnRunnerTest.testUsingMetrics

[Kenneth Knowles] Resolve beam_fn_api experiment for side inputs, using portable expansion

[noreply] [BEAM-12232] Expose public factory methods in SparkJobServerDriver

[Kyle Weaver] [BEAM-12009] Enable Calc splitting rule by default.

[noreply] [BEAM-12016] Initial implementation for add_suffix, add_prefix (#14623)


------------------------------------------
[...truncated 61.55 KB...]
  Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4

> Task :examples:java:compileTestJava FROM-CACHE
> Task :examples:java:testClasses
> Task :examples:java:testJar

> Task :sdks:go:resolveBuildDependencies
Resolving golang.org/x/crypto: commit='d9133f5469342136e669e85192a26056b587f503', urls=[https://go.googlesource.com/crypto]
Resolving golang.org/x/debug: commit='95515998a8a4bd7448134b2cb5971dbeb12e0b77', urls=[https://go.googlesource.com/debug]
Resolving golang.org/x/net: commit='2fb46b16b8dda405028c50f7c7f0f9dd1fa6bfb1', urls=[https://go.googlesource.com/net]
Resolving golang.org/x/oauth2: commit='5d25da1a8d43b66f2898c444f899c7bcfd6a407e', urls=[https://go.googlesource.com/oauth2]
Resolving golang.org/x/sync: commit='fd80eb99c8f653c847d294a001bdf2a3a6f768f5', urls=[https://go.googlesource.com/sync]

> Task :sdks:java:container:pullLicenses
Successfully installed beautifulsoup4-4.9.3 future-0.18.2 pyyaml-5.3.1 six-1.15.0 soupsieve-2.1 tenacity-5.1.5
Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json>        --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>        --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> 
INFO:root:Pulling license for 207 dependencies using 16 threads.
INFO:root:pull_licenses_java.py succeed. It took 6.82245 seconds with 16 threads.
Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh

> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses NO-SOURCE

> Task :sdks:go:resolveBuildDependencies
Resolving golang.org/x/sys: commit='fde4db37ae7ad8191b03d30d27f258b5291ae4e3', urls=[https://go.googlesource.com/sys]
Resolving golang.org/x/text: commit='23ae387dee1f90d29a23c0e87ee0b46038fbed0e', urls=[https://go.googlesource.com/text]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]

> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses

> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses

> Task :sdks:go:resolveBuildDependencies
Resolving google.golang.org/api: commit='0324d5e90dc7753607860272666845fad9ceb97e', urls=[https://code.googlesource.com/google-api-go-client]
Resolving google.golang.org/genproto: commit='4d944d34d83c502a5f761500a14d8842648415c3', urls=[https://github.com/google/go-genproto]
Resolving google.golang.org/grpc: commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58', urls=[https://github.com/grpc/grpc-go]
Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]

> Task :sdks:go:installDependencies
> Task :sdks:go:buildLinuxAmd64
> Task :sdks:go:goBuild

> Task :sdks:java:container:resolveBuildDependencies
Unable to watch the file system for changes. The inotify watches limit is too low.
Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/go>

> Task :sdks:java:container:installDependencies
> Task :sdks:java:container:buildLinuxAmd64
> Task :sdks:java:container:goBuild
> Task :sdks:java:container:java8:copySdkHarnessLauncher
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker

The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java]
2a865320966b: Preparing
e99783212c10: Preparing
edd89ac33348: Preparing
4f46b45accb7: Preparing
d5358fb2d316: Preparing
6327c1eab8c8: Preparing
cdfe957be884: Preparing
5e2d7800b5e1: Preparing
67ebaae180dd: Preparing
1a599263b4d7: Preparing
3614603af2de: Preparing
d8460eb1eb77: Preparing
30b0cc543ee7: Preparing
26863b4714ee: Preparing
5d5962699bd5: Preparing
a42439ce9650: Preparing
26270c5e25fa: Preparing
e2c6ff462357: Preparing
26863b4714ee: Waiting
67ebaae180dd: Waiting
d8460eb1eb77: Waiting
6327c1eab8c8: Waiting
cdfe957be884: Waiting
1a599263b4d7: Waiting
30b0cc543ee7: Waiting
3614603af2de: Waiting
5e2d7800b5e1: Waiting
a42439ce9650: Waiting
26270c5e25fa: Waiting
e2c6ff462357: Waiting
5d5962699bd5: Waiting
4f46b45accb7: Pushed
2a865320966b: Pushed
e99783212c10: Pushed
d5358fb2d316: Pushed
5e2d7800b5e1: Pushed
edd89ac33348: Pushed
cdfe957be884: Pushed
d8460eb1eb77: Layer already exists
30b0cc543ee7: Layer already exists
26863b4714ee: Layer already exists
5d5962699bd5: Layer already exists
a42439ce9650: Layer already exists
26270c5e25fa: Layer already exists
e2c6ff462357: Layer already exists
1a599263b4d7: Pushed
3614603af2de: Pushed
6327c1eab8c8: Pushed
67ebaae180dd: Pushed
20210428000057: digest: sha256:df5de89358c32d23c00a4cdfea8964dac7862d26a6412560d519df8a5dd2f64b size: 4099

> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest NO-SOURCE

> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest

org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2EBigQueryTornadoesWithExportUsingQuery FAILED
    java.lang.RuntimeException at BigQueryTornadoesIT.java:70
        Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryTornadoesIT.java:70

org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2EBigQueryTornadoesWithExport FAILED
    java.lang.IllegalArgumentException at BigQueryTornadoesIT.java:68

org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2eBigQueryTornadoesWithStorageApi FAILED
    java.lang.RuntimeException at BigQueryTornadoesIT.java:70
        Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryTornadoesIT.java:70

org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2eBigQueryTornadoesWithStorageApiUsingQuery FAILED
    java.lang.RuntimeException at BigQueryTornadoesIT.java:70
        Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryTornadoesIT.java:70

***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0428000907-efa2650c
The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428000907-efa2650c
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1619568543559.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0428000907-efa2650c
The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428000907-efa2650c
The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1619568543559.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage.
***********************************************************
***********************************************************

***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0428000937-331ac828
The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428000937-331ac828
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1619568576948.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0428000937-331ac828
The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428000937-331ac828
The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1619568576948.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage.
***********************************************************
***********************************************************

8 tests completed, 4 failed

> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest FAILED
> Task :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest

> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210428000057
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:df5de89358c32d23c00a4cdfea8964dac7862d26a6412560d519df8a5dd2f64b
Deleted: sha256:069b4c62fd63cf1f9eb248883c4c79ffb1807e30c9e26103fcbe071fc18889cb
Deleted: sha256:272f90cac86d1330eb2ddd785a9a3fc3651c2c548b7e138591e6380743b26059
Deleted: sha256:b4262e197498f24706e80feb872187e8522f32898b0164628176d6a4e687fd92
Deleted: sha256:b151c782897f51d69de7281648dce74e6b56cb66075e50303a5ca1e385dc21c4
Deleted: sha256:b240d3de267a56ff384ef260bb475a5d45d8e517e5a95fbf5fe67d73c3093023
Deleted: sha256:886f4ce339bb4277d402d2c73c3aedef030ecfdaa21999de3e111e82a6d4444b
Deleted: sha256:b3096da350d2cb3a21d9fe2be71efee3f74d6ee1f8ca885fdfac727adac6c9d6
Deleted: sha256:0fb4d0af77404c306fb69affaa2aa6f0da24dd13e947651e6c11793c429a5e54
Deleted: sha256:1e194a2ef4942796686e963c45edad37d06a09cd01ca3b03345a7b5dd6f1ef9c
Deleted: sha256:cfabde9f009853997b26944b6db405aa7d4da607e04537476b0625fe61217f0c
Deleted: sha256:0842a77f073cc637b10182873a49c5a6c88f88fd21b4a3af9f970a252ed3287d
Deleted: sha256:cfb03343bc7ce152499723ff1f3e8070a96eb863c5e881781e7a8f39155854e8
Deleted: sha256:2ec1632359f48f6e02d7e83c9ef704ac88d8cc39104992eb7d63ba544086eee5
Deleted: sha256:a012c69e546348241dc475e8325ebc21ac1ffdf70ed4845ed87cd3bffcf3d538
Deleted: sha256:9b65aac8ca73a89af0a77ff0b9f1c441e7690fc507c25ae8f0e59e9c181003b8
Deleted: sha256:a82075d055ed4a656ca2660dc6700df312669a64a58642e2db45052c0f4cabf3
Deleted: sha256:3311b2d0ca4f4e31e68035d1028137c5f9eed6d11656734776450da746e51cea
Deleted: sha256:a068cab432e8d03555afc6e4203496c0b906c9313f45ddbf0b52dc97fe25adb6
Deleted: sha256:ef6de77dd5077f7a6ac50933aacb3f316e860da52201b728226ff05f1c9a70e0
Deleted: sha256:30103963436b286e6dc7fa6144c543c2c3ccbc315dc167048ce74d2902cc5997
Deleted: sha256:74f0aa2ab3a9acc2d91774c91ead9acb540217233d4cba8fb13d7c0161e6130e
Deleted: sha256:d90ac23683b6d53d032f884e9ac61bf5678defcb0ab2c2470fa28b4a7fc4e078
Deleted: sha256:6bc309457ebba15b6c12464239a0148a3a0c4a4592f52aad134568b7d07408cd
Deleted: sha256:aa3a364320d3599799b72a97125473621567cded816a9d5e8ad4888d3c17c222
Deleted: sha256:a838a522fceb20e7eae17a00f2aa18f635e79258cf087e8e1f94c3e50648b27c
Deleted: sha256:a90fcf8f25e2ae224a0d1c37fea7fb99daf3343fafb98e007da41c07674fbfb9
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:df5de89358c32d23c00a4cdfea8964dac7862d26a6412560d519df8a5dd2f64b
  Associated tags:
 - 20210428000057
Tags:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210428000057
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210428000057].
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:df5de89358c32d23c00a4cdfea8964dac7862d26a6412560d519df8a5dd2f64b].

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html>

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 23m 3s
125 actionable tasks: 86 executed, 37 from cache, 2 up-to-date
Gradle was unable to watch the file system for changes. The inotify watches limit is too low.

Publishing build scan...
https://gradle.com/s/tvteqdwdhnt26

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Jenkins build is back to normal : beam_PostCommit_Java_DataflowV2 #137

Posted by Apache Jenkins Server <je...@builds.apache.org>.

See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/137/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Java_DataflowV2 #136

Posted by Apache Jenkins Server <je...@builds.apache.org>.

See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/136/display/redirect?page=changes>

Changes:

[Kenneth Knowles] Update run_rc_validation.sh to pull RC tag

[Kenneth Knowles] Remove WindowFn.getOutputTime

[kwu] [BEAM-12227] Implement ExternalWorkerService#stopWorker to support

[kwu] Add ExternalWorkerServiceTest

[Robert Bradshaw] Refinements to the portability page, reflecting its state of


------------------------------------------
[...truncated 69.10 KB...]
> Task :sdks:java:io:kafka:jar
> Task :sdks:java:container:java8:copyDockerfileDependencies

> Task :sdks:java:container:java8:dockerPrepare
Unable to watch the file system for changes. The inotify watches limit is too low.

> Task :runners:direct-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :runners:direct-java:classes
> Task :runners:direct-java:shadowJar FROM-CACHE

> Task :sdks:java:container:java8:docker
Removing intermediate container 942f1a0917e7
 ---> 69d1e4a74d23
Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then     rm -rf /opt/apache/beam/third_party_licenses ;    fi
 ---> Running in 27e04d83b410
Removing intermediate container 27e04d83b410
 ---> 58aeeffba77e
Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/
 ---> c8dccaee6777
Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in 212456e2c207
Removing intermediate container 212456e2c207
 ---> 944485461d6f
Successfully built 944485461d6f
Successfully tagged apache/beam_java8_sdk:2.30.0.dev

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker

The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java]
35c59c7bdbc3: Preparing
0193b0a9fc59: Preparing
e5e6139e2707: Preparing
b6ca80eca068: Preparing
49693ed17f24: Preparing
f77bf9009437: Preparing
e9a703841b52: Preparing
364cbdd113c9: Preparing
9de8bd27fd22: Preparing
959bd1046349: Preparing
562aa6204fdf: Preparing
23c34b58c1a4: Preparing
d8460eb1eb77: Preparing
30b0cc543ee7: Preparing
26863b4714ee: Preparing
f77bf9009437: Waiting
5d5962699bd5: Preparing
a42439ce9650: Preparing
26270c5e25fa: Preparing
562aa6204fdf: Waiting
e2c6ff462357: Preparing
23c34b58c1a4: Waiting
e9a703841b52: Waiting
d8460eb1eb77: Waiting
364cbdd113c9: Waiting
30b0cc543ee7: Waiting
26863b4714ee: Waiting
26270c5e25fa: Waiting
e2c6ff462357: Waiting
5d5962699bd5: Waiting
a42439ce9650: Waiting
9de8bd27fd22: Waiting
0193b0a9fc59: Pushed
49693ed17f24: Pushed
e5e6139e2707: Pushed
f77bf9009437: Pushed
35c59c7bdbc3: Pushed
364cbdd113c9: Pushed
b6ca80eca068: Pushed
9de8bd27fd22: Pushed
d8460eb1eb77: Layer already exists
30b0cc543ee7: Layer already exists
26863b4714ee: Layer already exists
5d5962699bd5: Layer already exists
a42439ce9650: Layer already exists
26270c5e25fa: Layer already exists
562aa6204fdf: Pushed
23c34b58c1a4: Pushed
e2c6ff462357: Layer already exists
e9a703841b52: Pushed
959bd1046349: Pushed
20210428180209: digest: sha256:4b2f1387b276bf6af037585d43cfa91f8115d166e236456aac02d9c05beeb6ba size: 4310

> Task :sdks:java:io:google-cloud-platform:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :sdks:java:io:google-cloud-platform:classes
> Task :sdks:java:io:google-cloud-platform:jar

> Task :sdks:java:io:google-cloud-platform:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :sdks:java:io:google-cloud-platform:testClasses
> Task :sdks:java:io:google-cloud-platform:testJar
> Task :runners:google-cloud-dataflow-java:compileJava
> Task :examples:java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :examples:java:classes
> Task :examples:java:jar

> Task :examples:java:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :examples:java:testClasses
> Task :examples:java:testJar

> Task :runners:google-cloud-dataflow-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :runners:google-cloud-dataflow-java:classes
> Task :runners:google-cloud-dataflow-java:jar
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest NO-SOURCE

> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest

org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2EBigQueryTornadoesWithExportUsingQuery FAILED
    java.lang.RuntimeException at BigQueryTornadoesIT.java:70
        Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryTornadoesIT.java:70

org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2EBigQueryTornadoesWithExport FAILED
    java.lang.IllegalArgumentException at BigQueryTornadoesIT.java:68

org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2eBigQueryTornadoesWithStorageApi FAILED
    java.lang.RuntimeException at BigQueryTornadoesIT.java:70
        Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryTornadoesIT.java:70

org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2eBigQueryTornadoesWithStorageApiUsingQuery FAILED
    java.lang.RuntimeException at BigQueryTornadoesIT.java:70
        Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryTornadoesIT.java:70

***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0428182958-600d082c
The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428182958-600d082c
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1619634597836.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0428182958-600d082c
The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428182958-600d082c
The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1619634597836.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage.
***********************************************************
***********************************************************

org.apache.beam.examples.complete.TrafficRoutesIT > testE2ETrafficRoutes FAILED
    java.lang.RuntimeException at TrafficRoutesIT.java:74

org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT > testTableIO FAILED
    java.lang.RuntimeException at BigQuerySamplesIT.java:108

8 tests completed, 6 failed

> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest FAILED
> Task :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest

> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210428180209
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4b2f1387b276bf6af037585d43cfa91f8115d166e236456aac02d9c05beeb6ba
Deleted: sha256:944485461d6f9ab731ad1203d000114c7e3a4f8a8f3614493d8029e7a4d9121a
Deleted: sha256:c8dccaee67776df714328ab177034d97c3a22f4ebf89f3e81cefe47e7e9f4599
Deleted: sha256:783d2b7cf6e2beffd89474c29087b941380fdbdbecc14643439a311a6969e685
Deleted: sha256:58aeeffba77e51f19859c862861cb9e60331f657ceaf18dedff021b86c897f41
Deleted: sha256:69d1e4a74d23213dbaf5270008d8573ef8bfba13e012187025628592ecf4993a
Deleted: sha256:e8a74ecb4b539519cb70aa9db4205cce8425100fc81961b8dffec96ece5394ca
Deleted: sha256:34d1d5abdea8ebfb830d3d907a666eb0ef445dfbe9d88bdbf256e7d1471deead
Deleted: sha256:40cf2755af79a7975d74ccfb8a682d6a36f07225bf104fd74b5efffeb2271b7c
Deleted: sha256:ee12e98fbcbff9ec962b2258e0a934fc2818da695dde4c5f7d9548bc688f7149
Deleted: sha256:c1dcf5d01a73e7fcc9966e7604cc4a21bc1a7b1f1515aeecdc20f16aafc3eff1
Deleted: sha256:22813deaa82a6452956a22c83f280dfb3c7509d5210cbd1daa1d8e4fe1c603cd
Deleted: sha256:ae055b4a5e6b2798459527e83d22f51b8f4a365fc0fd078464ef9c80233070b3
Deleted: sha256:ea2831e564c8047e9c515e77737eff918d8a76044194a403c3ac31dc2afafe73
Deleted: sha256:cf7858618241c82345f9e16e48c94369c68d64da67ed6d12d63736b8f64c2ef5
Deleted: sha256:d89873f91f35ec722b2454cdbe3dd715ca5895da2f31abef68cc55a3e5369a00
Deleted: sha256:f26a10613bf8345dad7510684f56fc307d239a32c203647b6c4091afb6cb2d11
Deleted: sha256:46582908b665bb3d92141886b121873f7793429f0f8d66b793b81e0f71773726
Deleted: sha256:9ae8b71675aec802be040fe6c246b11cf74d00e6ee52dae2056c106b3e530217
Deleted: sha256:32ebfba5e8efaafb3add4bec2040f7c774fc81b338931c4be608970abe623cad
Deleted: sha256:56b418ee526e66b5e87ad2a7c3dd8205457df67f11d346110dfaa97a96405c05
Deleted: sha256:9badbc068ec820d2d1665a5af575fa40e2492d4b10624e94aaf5761dfe243ef1
Deleted: sha256:0ff47b96358cc5b8b1ac9b6fe4e449088b2270424b429be018da3f71a3b8a11f
Deleted: sha256:db4e023d19d18f683a94e00c79fba66e5e65f4c3593f1c8ec76a2c905bb95ba9
Deleted: sha256:ff32fbfd8a33bd03696fee8fb0179000e90e32f951c5c8bdc85c2fd1555ad143
Deleted: sha256:112f65d1ffbd16eab3a90136ac1ff6c96b23fc1225fe00cbe7089e2ce580e58e
Deleted: sha256:47d5cc6941e01031b3e1388c3de422484cc77850da9d6f72de3ad38a4a1fe7c3
Deleted: sha256:f7366071593b8b8150f763517d13da36c3e230ae5b45b1ce8410142021b9be6c
Deleted: sha256:a0e94db7e670b4b764782b39cecfc5a1f7a9a49e8d1e89fbd352e2428d8344ca
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4b2f1387b276bf6af037585d43cfa91f8115d166e236456aac02d9c05beeb6ba
  Associated tags:
 - 20210428180209
Tags:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210428180209
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210428180209].
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4b2f1387b276bf6af037585d43cfa91f8115d166e236456aac02d9c05beeb6ba].

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html>

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2h 36m 43s
126 actionable tasks: 112 executed, 12 from cache, 2 up-to-date
Gradle was unable to watch the file system for changes. The inotify watches limit is too low.

Publishing build scan...
https://gradle.com/s/zonkjossb3vzi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Java_DataflowV2 #135

Posted by Apache Jenkins Server <je...@builds.apache.org>.

See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/135/display/redirect?page=changes>

Changes:

[Ismaël Mejía] [BEAM-11055] Update log4j to version 2.14.1


------------------------------------------
[...truncated 70.92 KB...]
> Task :runners:direct-java:shadowJar

> Task :sdks:java:container:java8:docker
 ---> Running in 4e8aa58c2ca6
Removing intermediate container 4e8aa58c2ca6
 ---> 686015d4fac0
Step 4/18 : ARG pull_licenses
 ---> Running in 8adb4c22f522
Removing intermediate container 8adb4c22f522
 ---> 2167ab5200dd
Step 5/18 : ADD target/slf4j-api.jar /opt/apache/beam/jars/
 ---> 23895d3e83f3
Step 6/18 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
 ---> bc0289b5d039
Step 7/18 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
 ---> 088d098b27bc
Step 8/18 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
 ---> f2b816a06297
Step 9/18 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
 ---> 95e242054438
Step 10/18 : ADD target/linux_amd64/boot /opt/apache/beam/
 ---> dd7fe76f6698
Step 11/18 : COPY target/LICENSE /opt/apache/beam/
 ---> 3b32b3289e64
Step 12/18 : COPY target/NOTICE /opt/apache/beam/
 ---> 4c59d7d52e0f
Step 13/18 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
 ---> 005095e32e08
Step 14/18 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
 ---> cc0c9b7cfe43
Step 15/18 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in 973573c5ac92
Removing intermediate container 973573c5ac92
 ---> 31b2792b5fc4
Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then     rm -rf /opt/apache/beam/third_party_licenses ;    fi
 ---> Running in c2b6399b1e0c
Removing intermediate container c2b6399b1e0c
 ---> ab0299f2c710
Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/
 ---> 55c328fcdd02
Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in f97736246c3c
Removing intermediate container f97736246c3c
 ---> af7924a5a414
Successfully built af7924a5a414
Successfully tagged apache/beam_java8_sdk:2.30.0.dev

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker

The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java]
f11b88bbf2f6: Preparing
69210e8ed0cc: Preparing
57eae743a44d: Preparing
cb87be068134: Preparing
7f1aaa997e3a: Preparing
3a9f731df511: Preparing
a9221ae94031: Preparing
60b46bda2b70: Preparing
51f2230d1096: Preparing
9b6a7167be60: Preparing
616a2f996ae5: Preparing
d4d7a1aa5732: Preparing
d8460eb1eb77: Preparing
30b0cc543ee7: Preparing
26863b4714ee: Preparing
5d5962699bd5: Preparing
a42439ce9650: Preparing
26270c5e25fa: Preparing
e2c6ff462357: Preparing
616a2f996ae5: Waiting
a9221ae94031: Waiting
5d5962699bd5: Waiting
d4d7a1aa5732: Waiting
60b46bda2b70: Waiting
a42439ce9650: Waiting
26270c5e25fa: Waiting
51f2230d1096: Waiting
d8460eb1eb77: Waiting
9b6a7167be60: Waiting
30b0cc543ee7: Waiting
e2c6ff462357: Waiting
26863b4714ee: Waiting
3a9f731df511: Waiting
69210e8ed0cc: Pushed
57eae743a44d: Pushed
7f1aaa997e3a: Pushed
3a9f731df511: Pushed
f11b88bbf2f6: Pushed
60b46bda2b70: Pushed
cb87be068134: Pushed
51f2230d1096: Pushed
d8460eb1eb77: Layer already exists
30b0cc543ee7: Layer already exists
26863b4714ee: Layer already exists
5d5962699bd5: Layer already exists
a42439ce9650: Layer already exists
26270c5e25fa: Layer already exists
e2c6ff462357: Layer already exists
d4d7a1aa5732: Pushed
616a2f996ae5: Pushed
a9221ae94031: Pushed
9b6a7167be60: Pushed
20210428120054: digest: sha256:3e71df516bc8609cbe0041aca0dd2233d4846bea7381e3476c9aa8098216b9bf size: 4310

> Task :sdks:java:io:google-cloud-platform:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :sdks:java:io:google-cloud-platform:classes
> Task :sdks:java:io:google-cloud-platform:jar

> Task :sdks:java:io:google-cloud-platform:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :runners:google-cloud-dataflow-java:compileJava
> Task :examples:java:compileJava
> Task :sdks:java:io:google-cloud-platform:testClasses
> Task :sdks:java:io:google-cloud-platform:testJar

> Task :examples:java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :examples:java:classes
> Task :examples:java:jar

> Task :examples:java:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :examples:java:testClasses
> Task :examples:java:testJar

> Task :runners:google-cloud-dataflow-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :runners:google-cloud-dataflow-java:classes
> Task :runners:google-cloud-dataflow-java:jar
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest NO-SOURCE

> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest

org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2EBigQueryTornadoesWithExportUsingQuery FAILED
    java.lang.RuntimeException at BigQueryTornadoesIT.java:70
        Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryTornadoesIT.java:70

org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2EBigQueryTornadoesWithExport FAILED
    java.lang.IllegalArgumentException at BigQueryTornadoesIT.java:68

org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2eBigQueryTornadoesWithStorageApi FAILED
    java.lang.RuntimeException at BigQueryTornadoesIT.java:70
        Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryTornadoesIT.java:70

org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2eBigQueryTornadoesWithStorageApiUsingQuery FAILED
    java.lang.RuntimeException at BigQueryTornadoesIT.java:70
        Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryTornadoesIT.java:70

***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0428122137-a3ab3dc2
The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428122137-a3ab3dc2
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1619612489799.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0428122137-a3ab3dc2
The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428122137-a3ab3dc2
The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1619612489799.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage.
***********************************************************
***********************************************************

***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0428122211-226c54db
The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428122211-226c54db
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1619612530769.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0428122211-226c54db
The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428122211-226c54db
The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1619612530769.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage.
***********************************************************
***********************************************************

8 tests completed, 4 failed

> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest FAILED
> Task :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest

> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210428120054
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3e71df516bc8609cbe0041aca0dd2233d4846bea7381e3476c9aa8098216b9bf
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3e71df516bc8609cbe0041aca0dd2233d4846bea7381e3476c9aa8098216b9bf
  Associated tags:
 - 20210428120054
Tags:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210428120054
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210428120054].
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3e71df516bc8609cbe0041aca0dd2233d4846bea7381e3476c9aa8098216b9bf].

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html>

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 34m 39s
126 actionable tasks: 117 executed, 7 from cache, 2 up-to-date
Gradle was unable to watch the file system for changes. The inotify watches limit is too low.

Publishing build scan...
https://gradle.com/s/j6mjyqkvjcpto

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Java_DataflowV2 #134

Posted by Apache Jenkins Server <je...@builds.apache.org>.

See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/134/display/redirect?page=changes>

Changes:

[Ismaël Mejía] [BEAM-9283] Disable caching ValidatesRunner tests tasks

[Kenneth Knowles] Enable dual job submission for Dataflow

[zyichi] [BEAM-12045] Install google cloud profiler agent in java sdk container

[edre] Fix worker_pool plumbing to use a mutable List.

[noreply] [BEAM-12237] Fix logging in Samza Runner (#14657)

[Valentyn Tymofieiev] [BEAM-2085] Add resource hints support in Java SDK.

[Valentyn Tymofieiev] Translate Resource Hints into v1beta3 API in DF Runner and add test

[Valentyn Tymofieiev] Support passing resource hints through pipeline options.

[Valentyn Tymofieiev] Add resource hints supported by Dataflow.


------------------------------------------
[...truncated 68.95 KB...]
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :sdks:java:io:google-cloud-platform:classes
> Task :sdks:java:io:google-cloud-platform:jar

> Task :sdks:java:io:google-cloud-platform:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :sdks:java:io:google-cloud-platform:testClasses
> Task :sdks:java:io:google-cloud-platform:testJar
> Task :runners:google-cloud-dataflow-java:compileJava
> Task :examples:java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :examples:java:classes
> Task :examples:java:jar

> Task :examples:java:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :examples:java:testClasses
> Task :examples:java:testJar

> Task :runners:google-cloud-dataflow-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :runners:google-cloud-dataflow-java:classes
> Task :runners:google-cloud-dataflow-java:jar

> Task :sdks:go:resolveBuildDependencies
Resolving google.golang.org/genproto: commit='4d944d34d83c502a5f761500a14d8842648415c3', urls=[https://github.com/google/go-genproto]
Resolving google.golang.org/grpc: commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58', urls=[https://github.com/grpc/grpc-go]
Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]

> Task :sdks:go:installDependencies
> Task :sdks:go:buildLinuxAmd64
> Task :sdks:go:goBuild

> Task :sdks:java:container:resolveBuildDependencies
Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/go>

> Task :sdks:java:container:installDependencies
> Task :sdks:java:container:buildLinuxAmd64
> Task :sdks:java:container:goBuild

> Task :sdks:java:container:java8:copySdkHarnessLauncher
Unable to watch the file system for changes. The inotify watches limit is too low.

> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker

The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java]
5dd751e84dab: Preparing
512d3b97a349: Preparing
09241fa06946: Preparing
5f725e77d1f6: Preparing
16993e090c4e: Preparing
14d62209da97: Preparing
428534a64b68: Preparing
17d64317c552: Preparing
d6c3e780b28e: Preparing
b8995340fdb4: Preparing
651ed7fc8180: Preparing
dc9f04cf7a7a: Preparing
d8460eb1eb77: Preparing
30b0cc543ee7: Preparing
26863b4714ee: Preparing
5d5962699bd5: Preparing
a42439ce9650: Preparing
26270c5e25fa: Preparing
e2c6ff462357: Preparing
428534a64b68: Waiting
b8995340fdb4: Waiting
17d64317c552: Waiting
651ed7fc8180: Waiting
d6c3e780b28e: Waiting
dc9f04cf7a7a: Waiting
d8460eb1eb77: Waiting
30b0cc543ee7: Waiting
26863b4714ee: Waiting
14d62209da97: Waiting
e2c6ff462357: Waiting
26270c5e25fa: Waiting
5d5962699bd5: Waiting
a42439ce9650: Waiting
09241fa06946: Pushed
512d3b97a349: Pushed
16993e090c4e: Pushed
14d62209da97: Pushed
5dd751e84dab: Pushed
5f725e77d1f6: Pushed
17d64317c552: Pushed
d6c3e780b28e: Pushed
d8460eb1eb77: Layer already exists
30b0cc543ee7: Layer already exists
651ed7fc8180: Pushed
26863b4714ee: Layer already exists
a42439ce9650: Layer already exists
5d5962699bd5: Layer already exists
26270c5e25fa: Layer already exists
e2c6ff462357: Layer already exists
dc9f04cf7a7a: Pushed
428534a64b68: Pushed
b8995340fdb4: Pushed
20210428060106: digest: sha256:2dcf0ece196f5a569b089acb8763714670bb3c4369467b64b1501fe93e13e208 size: 4310

> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest NO-SOURCE

> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest

org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2EBigQueryTornadoesWithExportUsingQuery FAILED
    java.lang.RuntimeException at BigQueryTornadoesIT.java:70
        Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryTornadoesIT.java:70

org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2EBigQueryTornadoesWithExport FAILED
    java.lang.IllegalArgumentException at BigQueryTornadoesIT.java:68

org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2eBigQueryTornadoesWithStorageApi FAILED
    java.lang.RuntimeException at BigQueryTornadoesIT.java:70
        Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryTornadoesIT.java:70

org.apache.beam.examples.cookbook.BigQueryTornadoesIT > testE2eBigQueryTornadoesWithStorageApiUsingQuery FAILED
    java.lang.RuntimeException at BigQueryTornadoesIT.java:70
        Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException at BigQueryTornadoesIT.java:70

***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0428061749-b9def9e
The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428061749-b9def9e
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1619590662613.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0428061749-b9def9e
The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428061749-b9def9e
The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1619590662613.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage.
***********************************************************
***********************************************************

***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0428061820-3f5ecb3f
The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428061820-3f5ecb3f
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1619590699568.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0428061820-3f5ecb3f
The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0428061820-3f5ecb3f
The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1619590699568.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage.
***********************************************************
***********************************************************

8 tests completed, 4 failed

> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest FAILED
> Task :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest

> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210428060106
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dcf0ece196f5a569b089acb8763714670bb3c4369467b64b1501fe93e13e208
Deleted: sha256:d2c257fb00f8128baab1f50c6a1643b8bb0087ab65d68e883cb56b89272e7ef8
Deleted: sha256:7bf5eb3de243771d10a074703bc058ca32132a48d2970e95454ae9c6b232a47b
Deleted: sha256:cf88847bdbe0547fbe41b5848ef3abedccdd7fc03ad8219da5d08da1afb30c39
Deleted: sha256:b86d2945cd5ab468eb525fb06b3a70370d674507cc6645c4c57c9ca6784f1f3d
Deleted: sha256:2249d022ca8f679e8a1fd0bc5664bf346bfa64d447106f1d737b043819548693
Deleted: sha256:dffdb02c353789577691d92ff9aade6e4e403abe6b1bcc527729e4e6fc16990f
Deleted: sha256:27507d823221dc7016e5fd82df911fba5f745bc21bd5daf215a3190dc25fbf51
Deleted: sha256:e12ccf7a06a02045211aa1630b8741d9bec767b8041af8c54f06b4ec1d21c417
Deleted: sha256:c5862b90189d4a5c3909ac7c7e744ecd8231cc793c53d4fa8139e8f66fd4019e
Deleted: sha256:996d2e20778e5f8551643b89175be9f83aad797529adca34919f6a35bfc62f2e
Deleted: sha256:e90b00485fc35a3807850d273bd78a5ed9d99b0b8a9219449cf411e88418fcc7
Deleted: sha256:c4b79b99be36a549cc438bb7f81681b1a835a3c3157ae68b631e0b3a6e038ce4
Deleted: sha256:d0f9a4abe6c62a3d7e13e27df534740a69d65101a288c9b4e5d7073e96f6f07e
Deleted: sha256:117392d1c9daac992b2059823fd713bf9cf725b6aa751e33e993578b80400f00
Deleted: sha256:542416cfefab912f9f19cb11baaf7f9c1553215e7a9a54f14325b33dc810e0fc
Deleted: sha256:6cd509eb1b4d011ecae97fdd9c4c94c0556594681fb4f3b19688546ad9dc0412
Deleted: sha256:af853751781985f5808c2cded34cda4db04c86e74d5ef1133af401f1a9221c89
Deleted: sha256:8b6365506703d32f594126e15cf9072055426ee03dcaa5b0dbdab9144ef485ee
Deleted: sha256:2a34b8f63b63b0fbb4c86180d10587381294d1552e8e5319ecd62193398cff76
Deleted: sha256:1db1667dd8cd6fef517eec76c3ad9b3b6a1aa7971238e43ae3446f510167f8d1
Deleted: sha256:08377034da0b5b804a4d3ae366a19262a705f6417703eb85b9bd0eaf271cdc74
Deleted: sha256:bb9dcf6d3c5bdace8bff8a51ce8bc60e7f7478c2504d3d8a5872913d259895d5
Deleted: sha256:118bc826335ed6d85df80569bd5457a5ccce79374f983aef0b2d694a3b94a6e1
Deleted: sha256:60172a69f742f51f5ac5dbcbd383287edac18c20852e595de4ef5c9c8abab24a
Deleted: sha256:da370298248e3027282510da2dc36c1b6c25fbb6ba561e20ebe49f867ce5204a
Deleted: sha256:3acd904ba7e7469eaead925e61d11fe7b366c4fa2b2aa3ca1e780821d3e5ed5e
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dcf0ece196f5a569b089acb8763714670bb3c4369467b64b1501fe93e13e208
  Associated tags:
 - 20210428060106
Tags:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210428060106
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210428060106].
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dcf0ece196f5a569b089acb8763714670bb3c4369467b64b1501fe93e13e208].

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html>

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 32m 5s
126 actionable tasks: 107 executed, 17 from cache, 2 up-to-date
Gradle was unable to watch the file system for changes. The inotify watches limit is too low.

Publishing build scan...
https://gradle.com/s/stkqnzaos6m6u

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org