You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/03/17 06:45:42 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Spark #3481
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3481/display/redirect?page=changes>
Changes:
[noreply] Mapped JOB_STATE_RESOURCE_CLEANING_UP to State.RUNNING.
------------------------------------------
[...truncated 554.04 KB...]
>
>
root_transform_ids: "s1"
2022/03/17 06:26:27 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/integration/io/xlang/kafka/kafka_test.go> as /tmp/worker-1-1647498387312725508
ptest.go:102: Failed to execute job: connecting to job service
failed to dial server at localhost:36769
caused by:
context deadline exceeded
--- FAIL: TestKafkaIO_BasicReadWrite (137.93s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 140.985s
FAIL
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CoGroupByKeyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:345
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:340
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombineGloballyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:362
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:357
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombinePerKeyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:379
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:374
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$FlattenTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:396
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:391
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$GroupByKeyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:327
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:322
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$MultiInputOutputWithSideInputTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:309
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:304
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$PartitionTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:414
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:409
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$SingleInputOutputTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:292
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:287
8 tests completed, 8 failed
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CoGroupByKeyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:345
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:340
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombineGloballyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:362
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:357
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombinePerKeyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:379
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:374
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$FlattenTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:396
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:391
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$GroupByKeyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:327
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:322
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$MultiInputOutputWithSideInputTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:309
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:304
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$PartitionTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:414
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:409
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$SingleInputOutputTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:292
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:287
8 tests completed, 8 failed
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$PythonDependenciesTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:423
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:418
1 test completed, 1 failed
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingPython FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:2:job-server:sparkJobServerCleanup
FAILURE: Build completed with 7 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 176
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingJava/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPythonOnly/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
5: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
6: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
7: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 37m 35s
250 actionable tasks: 172 executed, 67 from cache, 11 up-to-date
Publishing build scan...
https://gradle.com/s/n6gyeeplmsc4q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Spark #3493
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3493/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark #3492
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3492/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14122] Upgrade pip-licenses dependency (#17132)
------------------------------------------
[...truncated 972.25 KB...]
key: "QFDQJJNllSbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.38.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.38.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nL/tmp/artifacts/icedtea-sound-ebvtNFkfFXg4aaYFuDnwKpwDSjzsaZqlqv5iKxPTr-U.jar\022@79bbed34591f15783869a605b839f02a9c034a3cec699aa5aafe622b13d3afe5"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n=icedtea-sound-ebvtNFkfFXg4aaYFuDnwKpwDSjzsaZqlqv5iKxPTr-U.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nF/tmp/artifacts/jaccess-ULFTCPsb6cLYZ0f1BG1FQfczmHNaZCx8plXuRDKpBqE.jar\022@50b15308fb1be9c2d86747f5046d4541f73398735a642c7ca655ee4432a906a1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n7jaccess-ULFTCPsb6cLYZ0f1BG1FQfczmHNaZCx8plXuRDKpBqE.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nI/tmp/artifacts/localedata-dUHqyGxaTVCjfTI8MckPYarZ3_mwf62udkxaHi1aKns.jar\022@7541eac86c5a4d50a37d323c31c90f61aad9dff9b07fadae764c5a1e2d5a2a7b"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n:localedata-dUHqyGxaTVCjfTI8MckPYarZ3_mwf62udkxaHi1aKns.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nF/tmp/artifacts/nashorn-XdUndQGroXOP9NCsfITpBERYcbbGXVHLjbvNWXCh-3A.jar\022@5dd5277501aba1738ff4d0ac7c84e904445871b6c65d51cb8dbbcd5970a1fb70"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n7nashorn-XdUndQGroXOP9NCsfITpBERYcbbGXVHLjbvNWXCh-3A.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nG/tmp/artifacts/cldrdata-YqzuKX1QnLCOo0cwjKRdBhGrip_ltIJZg-APT60tUPA.jar\022@62acee297d509cb08ea347308ca45d0611ab8a9fe5b4825983e00f4fad2d50f0"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n8cldrdata-YqzuKX1QnLCOo0cwjKRdBhGrip_ltIJZg-APT60tUPA.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nD/tmp/artifacts/dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar\022@761129d7ceae74417a5fa72166eb3e449cd6466ce571cc71d7f6ed95759ac952"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n5dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nr/tmp/artifacts/beam-sdks-java-io-expansion-service-2.38.0-SNAPSHOT-YAzW-36fpGxk3zmPx2PXOkBcptWpoDFJr7WKCGi14hQ.jar\022@600cd6fb7e9fa46c64df398fc763d73a405ca6d5a9a03149afb58a0868b5e214"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ncbeam-sdks-java-io-expansion-service-2.38.0-SNAPSHOT-YAzW-36fpGxk3zmPx2PXOkBcptWpoDFJr7WKCGi14hQ.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "s3"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/20 00:19:34 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/integration/io/xlang/kafka/kafka_test.go> as /tmp/worker-2-1647735574848090742
2022/03/20 00:19:36 Prepared job with id: go-testkafkaio_basicreadwrite_aa68efa6-c85a-4787-af93-3f0b7b7ad82f and staging token: go-testkafkaio_basicreadwrite_aa68efa6-c85a-4787-af93-3f0b7b7ad82f
2022/03/20 00:19:37 Staged binary artifact with token:
2022/03/20 00:19:37 Submitted job: go0testkafkaio0basicreadwrite-jenkins-0320001937-b9620d28_252f7432-688f-4670-84a4-8dea45aff1d0
2022/03/20 00:19:37 Job state: STOPPED
2022/03/20 00:19:37 Job state: STARTING
2022/03/20 00:19:37 Job state: RUNNING
2022/03/20 00:20:11 Job state: DONE
2022/03/20 00:20:11 Warning: 6 errors during metrics processing: [failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"QFDQJJNllSExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/PairWithRestriction0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"QFDQJJNllSExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xbcA\xbcA\xbcA" labels:{key:"PCOLLECTION" value:"QFDQJJNllSExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/PairWithRestriction0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xc9A\xc9A\xc9A" labels:{key:"PCOLLECTION" value:"QFDQJJNllSExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"QFDQJJNllSExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xc9A\xc9A\xc9A" labels:{key:"PCOLLECTION" value:"QFDQJJNllSExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"}]
--- PASS: TestKafkaIO_BasicReadWrite (54.15s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 57.213s
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CoGroupByKeyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:345
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:340
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombineGloballyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:362
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:357
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombinePerKeyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:379
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:374
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$FlattenTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:396
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:391
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$GroupByKeyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:327
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:322
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$MultiInputOutputWithSideInputTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:309
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:304
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$PartitionTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:414
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:409
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$SingleInputOutputTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:292
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:287
8 tests completed, 8 failed
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$PythonDependenciesTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:423
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:418
1 test completed, 1 failed
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingPython FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:2:job-server:sparkJobServerCleanup
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPythonOnly/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 32m 23s
250 actionable tasks: 172 executed, 67 from cache, 11 up-to-date
Publishing build scan...
https://gradle.com/s/jbcsio7pg4l52
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark #3491
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3491/display/redirect>
Changes:
------------------------------------------
[...truncated 1.45 MB...]
attrs==21.4.0
beautifulsoup4==4.10.0
bs4==0.0.1
cachetools==4.2.4
certifi==2021.10.8
cffi==1.15.0
charset-normalizer==2.0.12
click==8.0.4
cloudpickle==2.0.0
crcmod==1.7
cryptography==36.0.1
Cython==0.29.28
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.9
fasteners==0.17.3
flatbuffers==2.0
freezegun==1.2.0
future==0.18.2
gast==0.5.3
google-api-core==1.31.5
google-api-python-client==2.39.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.34.1
google-cloud-bigquery-storage==2.12.0
google-cloud-bigtable==1.7.0
google-cloud-core==1.7.2
google-cloud-datastore==1.15.3
google-cloud-dlp==3.6.1
google-cloud-language==1.3.0
google-cloud-profiler==3.0.7
google-cloud-pubsub==2.9.0
google-cloud-pubsublite==1.4.0
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.1
google-cloud-videointelligence==1.16.1
google-cloud-vision==1.0.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.3.1
googleapis-common-protos==1.55.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.3
grpcio==1.44.0
grpcio-gcp==0.2.2
grpcio-status==1.44.0
guppy3==3.1.2
h5py==3.6.0
hdfs==2.6.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.11.2
joblib==1.1.0
keras==2.8.0
Keras-Preprocessing==1.1.2
libclang==13.0.0
libcst==0.4.1
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
mypy-extensions==0.4.3
nltk==3.7
nose==1.3.7
numpy==1.22.2
oauth2client==4.1.3
oauthlib==3.2.0
opt-einsum==3.3.0
orjson==3.6.7
overrides==6.1.0
packaging==21.3
pandas==1.4.1
parameterized==0.7.5
pbr==5.8.1
pip==22.0.4
pluggy==0.13.1
proto-plus==1.20.3
protobuf==3.19.4
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==6.0.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2021.3
PyYAML==6.0
regex==2022.3.2
requests==2.27.1
requests-mock==1.9.3
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==1.0.2
scipy==1.8.0
setuptools==58.1.0
six==1.16.0
soupsieve==2.3.1
SQLAlchemy==1.4.31
tenacity==5.1.5
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.8.0
tensorflow-io-gcs-filesystem==0.24.0
termcolor==1.1.0
testcontainers==3.4.2
tf-estimator-nightly==2.8.0.dev2021122109
threadpoolctl==3.1.0
tqdm==4.63.0
typing-inspect==0.7.1
typing-utils==0.1.0
typing_extensions==4.1.1
uritemplate==4.1.1
urllib3==1.26.8
wcwidth==0.2.5
websocket-client==1.3.1
Werkzeug==2.0.3
wheel==0.37.1
wrapt==1.13.3
zipp==3.7.0
Removing intermediate container b545cfdeb004
---> f8816f1086b8
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
---> 5db2f7477881
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
---> c10355323714
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
---> f2b1032df312
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> ff4bdee8150f
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 564f3000d528
Removing intermediate container 564f3000d528
---> 06a3ae13be60
Step 21/31 : FROM beam as third_party_licenses
---> 06a3ae13be60
Step 22/31 : ARG pull_licenses
---> Running in 567137ba3abc
Removing intermediate container 567137ba3abc
---> 72a9e7ece9a6
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
---> b584dbaa3bde
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 06ff912b93a8
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 7e97c75e5658
Removing intermediate container 7e97c75e5658
---> 08c0057338c4
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
---> 3fb5d9b435f0
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 5ec4eff721c5
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.9/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=8acdcadbc16725435621e9599b5f6c2944607418a41e352c598319e4ab3ed4b2
Stored in directory: /root/.cache/pip/wheels/b8/d5/8b/e0c9765594e0dc8093aae5f67eacc08b9b533da598c710b54a
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mTraceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 40, in <module>
[0m[91m from pip._internal.utils.misc import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip._internal.utils.misc' (/usr/local/lib/python3.9/site-packages/pip/_internal/utils/misc.py)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/pip-licenses", line 5, in <module>
[0m[91m from piplicenses import main
File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 42, in <module>
[0m[91m from pip import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip' (/usr/local/lib/python3.9/site-packages/pip/__init__.py)
[0m[91mTraceback (most recent call last):
File "/tmp/license_scripts/pull_licenses_py.py", line 166, in <module>
[0m[91m dependencies = run_pip_licenses()
File "/tmp/license_scripts/pull_licenses_py.py", line 49, in run_pip_licenses
[0m[91m dependencies = run_bash_command(command)
File "/tmp/license_scripts/pull_licenses_py.py", line 44, in run_bash_command
[0m[91m return subprocess.check_output(command.split()).decode('utf-8')
File "/usr/local/lib/python3.9/subprocess.py", line 424, in check_output
[0m[91m return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
File "/usr/local/lib/python3.9/subprocess.py", line 528, in run
[0m[91m raise CalledProcessError(retcode, process.args,
[0m[91msubprocess.CalledProcessError: Command '['pip-licenses', '--with-license-file', '--with-urls', '--from=mixed', '--ignore', 'apache-beam', '--format=json']' returned non-zero exit status 1.
[0mThe command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi' returned a non-zero code: 1
> Task :sdks:python:container:py39:docker FAILED
> Task :runners:spark:2:job-server:sparkJobServerCleanup
Stopping job server pid: 4170725.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 7m 12s
226 actionable tasks: 26 executed, 200 up-to-date
Publishing build scan...
https://gradle.com/s/hdq6vrvhj4lkw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark #3490
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3490/display/redirect>
Changes:
------------------------------------------
[...truncated 205.99 KB...]
>
>
root_transform_ids: "s1"
2022/03/19 12:25:46 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/integration/io/xlang/kafka/kafka_test.go> as /tmp/worker-1-1647692746537802943
ptest.go:102: Failed to execute job: connecting to job service
failed to dial server at localhost:43841
caused by:
context deadline exceeded
--- FAIL: TestKafkaIO_BasicReadWrite (124.85s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 127.877s
FAIL
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CoGroupByKeyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:345
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:340
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombineGloballyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:362
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:357
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombinePerKeyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:379
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:374
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$FlattenTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:396
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:391
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$GroupByKeyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:327
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:322
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$MultiInputOutputWithSideInputTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:309
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:304
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$PartitionTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:414
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:409
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$SingleInputOutputTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:292
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:287
8 tests completed, 8 failed
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CoGroupByKeyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:345
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:340
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombineGloballyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:362
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:357
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombinePerKeyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:379
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:374
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$FlattenTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:396
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:391
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$GroupByKeyTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:327
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:322
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$MultiInputOutputWithSideInputTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:309
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:304
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$PartitionTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:414
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:409
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$SingleInputOutputTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:292
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:287
8 tests completed, 8 failed
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$PythonDependenciesTest > test FAILED
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:423
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:155
java.lang.NullPointerException at ValidateRunnerXlangTest.java:418
1 test completed, 1 failed
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingPython FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:2:job-server:sparkJobServerCleanup
FAILURE: Build completed with 7 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 176
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingJava/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPythonOnly/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
5: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
6: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
7: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 40m 29s
250 actionable tasks: 166 executed, 73 from cache, 11 up-to-date
Publishing build scan...
https://gradle.com/s/diw36l3oxzma4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark #3489
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3489/display/redirect?page=changes>
Changes:
[yiru] .
[yiru] .
[yiru] .
[yiru] format fix
[yiru] .
[yiru] make DoFn into a separate class
[yiru] .
[yiru] fix setting
[yiru] fix checkstyle
[yiru] spotlessapply
[noreply] Merge pull request #17016 from [BEAM-14049][Playground] Add new API
[noreply] Merge pull request #17077 from [BEAM-14078] [Website] change link
[noreply] Merge pull request #17085 from [BEAM-14077] [Website] add beam
[noreply] Update Changes.md w/Go pipeline pre-process fix.
[noreply] [BEAM-14098] wrapper for postgres on JDBC IO GO SDK (#17088)
[noreply] Merge pull request #17023 from [BEAM-12164]: Remove child partition
------------------------------------------
[...truncated 1.45 MB...]
attrs==21.4.0
beautifulsoup4==4.10.0
bs4==0.0.1
cachetools==4.2.4
certifi==2021.10.8
cffi==1.15.0
charset-normalizer==2.0.12
click==8.0.4
cloudpickle==2.0.0
crcmod==1.7
cryptography==36.0.1
Cython==0.29.28
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.9
fasteners==0.17.3
flatbuffers==2.0
freezegun==1.2.0
future==0.18.2
gast==0.5.3
google-api-core==1.31.5
google-api-python-client==2.39.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.34.1
google-cloud-bigquery-storage==2.12.0
google-cloud-bigtable==1.7.0
google-cloud-core==1.7.2
google-cloud-datastore==1.15.3
google-cloud-dlp==3.6.1
google-cloud-language==1.3.0
google-cloud-profiler==3.0.7
google-cloud-pubsub==2.9.0
google-cloud-pubsublite==1.4.0
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.1
google-cloud-videointelligence==1.16.1
google-cloud-vision==1.0.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.3.1
googleapis-common-protos==1.55.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.3
grpcio==1.44.0
grpcio-gcp==0.2.2
grpcio-status==1.44.0
guppy3==3.1.2
h5py==3.6.0
hdfs==2.6.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.11.2
joblib==1.1.0
keras==2.8.0
Keras-Preprocessing==1.1.2
libclang==13.0.0
libcst==0.4.1
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
mypy-extensions==0.4.3
nltk==3.7
nose==1.3.7
numpy==1.22.2
oauth2client==4.1.3
oauthlib==3.2.0
opt-einsum==3.3.0
orjson==3.6.7
overrides==6.1.0
packaging==21.3
pandas==1.4.1
parameterized==0.7.5
pbr==5.8.1
pip==22.0.4
pluggy==0.13.1
proto-plus==1.20.3
protobuf==3.19.4
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==6.0.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2021.3
PyYAML==6.0
regex==2022.3.2
requests==2.27.1
requests-mock==1.9.3
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==1.0.2
scipy==1.8.0
setuptools==58.1.0
six==1.16.0
soupsieve==2.3.1
SQLAlchemy==1.4.31
tenacity==5.1.5
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.8.0
tensorflow-io-gcs-filesystem==0.24.0
termcolor==1.1.0
testcontainers==3.4.2
tf-estimator-nightly==2.8.0.dev2021122109
threadpoolctl==3.1.0
tqdm==4.63.0
typing-inspect==0.7.1
typing-utils==0.1.0
typing_extensions==4.1.1
uritemplate==4.1.1
urllib3==1.26.8
wcwidth==0.2.5
websocket-client==1.3.1
Werkzeug==2.0.3
wheel==0.37.1
wrapt==1.13.3
zipp==3.7.0
Removing intermediate container 777c80293ace
---> 57ada5a64926
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
---> 1a1b5a4632e5
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
---> 3588767871ef
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
---> 73cf9b01d991
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 3f688142f4da
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 8b286c19bc33
Removing intermediate container 8b286c19bc33
---> 085e7597040c
Step 21/31 : FROM beam as third_party_licenses
---> 085e7597040c
Step 22/31 : ARG pull_licenses
---> Running in c40eac162c5c
Removing intermediate container c40eac162c5c
---> 8e2d4dd5b60b
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
---> f0e378bc0b62
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> abf0c93920c0
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in e9baeb20a566
Removing intermediate container e9baeb20a566
---> 28be39dd1a1d
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
---> 223baed74c6e
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 655b9a557da3
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.9/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=9283c3be9c09893c6f14e3ecc993bca1eb04db61c7ba6f5e5f836538b9bf2af4
Stored in directory: /root/.cache/pip/wheels/b8/d5/8b/e0c9765594e0dc8093aae5f67eacc08b9b533da598c710b54a
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mTraceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 40, in <module>
[0m[91m from pip._internal.utils.misc import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip._internal.utils.misc' (/usr/local/lib/python3.9/site-packages/pip/_internal/utils/misc.py)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/pip-licenses", line 5, in <module>
[0m[91m from piplicenses import main
File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 42, in <module>
[0m[91m from pip import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip' (/usr/local/lib/python3.9/site-packages/pip/__init__.py)
[0m[91mTraceback (most recent call last):
File "/tmp/license_scripts/pull_licenses_py.py", line 166, in <module>
[0m[91m dependencies = run_pip_licenses()
File "/tmp/license_scripts/pull_licenses_py.py", line 49, in run_pip_licenses
[0m[91m dependencies = run_bash_command(command)
File "/tmp/license_scripts/pull_licenses_py.py", line 44, in run_bash_command
[0m[91m return subprocess.check_output(command.split()).decode('utf-8')
File "/usr/local/lib/python3.9/subprocess.py", line 424, in check_output
[0m[91m return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
File "/usr/local/lib/python3.9/subprocess.py", line 528, in run
[0m[91m raise CalledProcessError(retcode, process.args,
[0m[91msubprocess.CalledProcessError: Command '['pip-licenses', '--with-license-file', '--with-urls', '--from=mixed', '--ignore', 'apache-beam', '--format=json']' returned non-zero exit status 1.
[0mThe command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi' returned a non-zero code: 1
> Task :sdks:python:container:py39:docker FAILED
> Task :runners:spark:2:job-server:sparkJobServerCleanup
Stopping job server pid: 1624530.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 6m 52s
226 actionable tasks: 26 executed, 200 up-to-date
Publishing build scan...
https://gradle.com/s/h7otdc6kw4lhy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark #3488
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3488/display/redirect?page=changes>
Changes:
[Kiley Sok] Add Java 17 Nexmark metrics to Grafana
[mmack] [BEAM-14125] Update website IO matrix to recommend aws2 IOs
[noreply] [BEAM-14128] Eliminating quadratic behavior of
[noreply] [BEAM-13972] Add RunInference interface (#16917)
[noreply] Merge pull request #17116 from [BEAM-12164] Remove change_stream in
[noreply] Deprecate tags.go (#17025)
[noreply] [BEAM-12753] and [BEAM-12815] Fix Flink Integration Tests (#17067)
[noreply] Merge pull request #16895 from [BEAM-13882][Playground] More tests for
[noreply] [BEAM-13925] Add weekly automation to update our reviewer config
[noreply] Merge pull request #17076 from Beam 14082 update payground for mobile
[noreply] [BEAM-13925] Assign committers in the scheduled action (#17062)
[noreply] Pin setup-gcloud to v0 instead of master (#17123)
[noreply] [BEAM-3304] documentation for PaneInfo in BPG (#17047)
------------------------------------------
[...truncated 477.26 KB...]
atomicwrites==1.4.0
attrs==21.4.0
beautifulsoup4==4.10.0
bs4==0.0.1
cached-property==1.5.2
cachetools==4.2.4
certifi==2021.10.8
cffi==1.15.0
charset-normalizer==2.0.12
clang==5.0
click==8.0.4
cloudpickle==2.0.0
crcmod==1.7
cryptography==36.0.1
Cython==0.29.28
dataclasses==0.8
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.7
fasteners==0.17.3
flatbuffers==1.12
freezegun==1.2.0
future==0.18.2
gast==0.4.0
google-api-core==1.31.5
google-api-python-client==2.39.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.34.1
google-cloud-bigquery-storage==2.12.0
google-cloud-bigtable==1.7.0
google-cloud-core==1.7.2
google-cloud-datastore==1.15.3
google-cloud-dlp==3.6.1
google-cloud-language==1.3.0
google-cloud-profiler==3.0.7
google-cloud-pubsub==2.9.0
google-cloud-pubsublite==1.4.0
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.1
google-cloud-videointelligence==1.16.1
google-cloud-vision==1.0.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.3.1
googleapis-common-protos==1.55.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.3
grpcio==1.44.0
grpcio-gcp==0.2.2
grpcio-status==1.44.0
guppy3==3.1.2
h5py==3.1.0
hdfs==2.6.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.8.3
importlib-resources==5.4.0
joblib==1.1.0
keras==2.6.0
Keras-Preprocessing==1.1.2
libcst==0.4.1
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
mypy-extensions==0.4.3
nltk==3.6.7
nose==1.3.7
numpy==1.19.5
oauth2client==4.1.3
oauthlib==3.2.0
opt-einsum==3.3.0
orjson==3.6.1
overrides==6.1.0
packaging==21.3
pandas==1.1.5
parameterized==0.7.5
pbr==5.8.1
pip==21.2.4
pluggy==0.13.1
proto-plus==1.20.3
protobuf==3.19.4
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==6.0.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2021.3
PyYAML==6.0
regex==2022.3.2
requests==2.27.1
requests-mock==1.9.3
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==0.24.2
scipy==1.5.4
setuptools==57.5.0
six==1.15.0
soupsieve==2.3.1
SQLAlchemy==1.4.31
tenacity==5.1.5
tensorboard==2.6.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.6.2
tensorflow-estimator==2.6.0
termcolor==1.1.0
testcontainers==3.4.2
threadpoolctl==3.1.0
tqdm==4.63.0
typing-extensions==3.7.4.3
typing-inspect==0.7.1
typing-utils==0.1.0
uritemplate==4.1.1
urllib3==1.26.8
wcwidth==0.2.5
websocket-client==1.3.1
Werkzeug==2.0.3
wheel==0.37.0
wrapt==1.12.1
zipp==3.6.0
Removing intermediate container 5c3536f35db4
---> 73f8ad8bec63
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
---> 85b1564adb46
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
---> 97ce193b498f
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
---> 0484627f566b
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> b99c478288e7
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 84172c0eedab
Removing intermediate container 84172c0eedab
---> a341e0189335
Step 21/31 : FROM beam as third_party_licenses
---> a341e0189335
Step 22/31 : ARG pull_licenses
---> Running in 33e9e41dfceb
Removing intermediate container 33e9e41dfceb
---> 80c9c12985c2
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
---> 357c63cb3d0c
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 76392abe53ee
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in a4ef278a4673
Removing intermediate container a4ef278a4673
---> da61dadcb299
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
---> c9f3ece3c34a
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 9d7c6506a7fb
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.6/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.6/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.6/site-packages (from tenacity) (1.15.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22924 sha256=4a2c61e4f366355e2633e95d1e2ee11fa77c12b09b698b6589a99adeec890e5a
Stored in directory: /root/.cache/pip/wheels/f3/65/67/71f473ec87ea4554d1bdfb1b5128cfe1414c2b113b72a1ee8e
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 139 dependencies
[0mRemoving intermediate container 9d7c6506a7fb
---> e8f80d4919e7
Step 28/31 : FROM beam
---> a341e0189335
Step 29/31 : ARG pull_licenses
---> Running in 47527e3450dd
Removing intermediate container 47527e3450dd
---> 543d907d2bd0
Step 30/31 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> 06d39e14376c
Step 31/31 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 5a23eb0e41eb
Removing intermediate container 5a23eb0e41eb
---> b6e63709ec76
Successfully built b6e63709ec76
Successfully tagged apache/beam_python3.6_sdk:2.38.0.dev
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerSetup
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingPython
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:2:job-server:sparkJobServerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:extensions:schemaio-expansion-service:checkstyleTest'.
> Failed to load cache entry for task ':sdks:java:extensions:schemaio-expansion-service:checkstyleTest'
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 41m 27s
249 actionable tasks: 170 executed, 68 from cache, 11 up-to-date
Publishing build scan...
https://gradle.com/s/ny7vm7s7edqgs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark #3487
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3487/display/redirect?page=changes>
Changes:
[mmack] [adhoc] Minor cleanup for aws2 tests
------------------------------------------
[...truncated 905.80 KB...]
attrs==21.4.0
beautifulsoup4==4.10.0
bs4==0.0.1
cachetools==4.2.4
certifi==2021.10.8
cffi==1.15.0
charset-normalizer==2.0.12
click==8.0.4
cloudpickle==2.0.0
crcmod==1.7
cryptography==36.0.1
Cython==0.29.28
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.9
fasteners==0.17.3
flatbuffers==2.0
freezegun==1.2.0
future==0.18.2
gast==0.5.3
google-api-core==1.31.5
google-api-python-client==2.39.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.34.1
google-cloud-bigquery-storage==2.12.0
google-cloud-bigtable==1.7.0
google-cloud-core==1.7.2
google-cloud-datastore==1.15.3
google-cloud-dlp==3.6.1
google-cloud-language==1.3.0
google-cloud-profiler==3.0.7
google-cloud-pubsub==2.9.0
google-cloud-pubsublite==1.4.0
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.1
google-cloud-videointelligence==1.16.1
google-cloud-vision==1.0.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.3.1
googleapis-common-protos==1.55.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.3
grpcio==1.44.0
grpcio-gcp==0.2.2
grpcio-status==1.44.0
guppy3==3.1.2
h5py==3.6.0
hdfs==2.6.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.11.2
joblib==1.1.0
keras==2.8.0
Keras-Preprocessing==1.1.2
libclang==13.0.0
libcst==0.4.1
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
mypy-extensions==0.4.3
nltk==3.7
nose==1.3.7
numpy==1.22.2
oauth2client==4.1.3
oauthlib==3.2.0
opt-einsum==3.3.0
orjson==3.6.7
overrides==6.1.0
packaging==21.3
pandas==1.4.1
parameterized==0.7.5
pbr==5.8.1
pip==22.0.4
pluggy==0.13.1
proto-plus==1.20.3
protobuf==3.19.4
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==6.0.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2021.3
PyYAML==6.0
regex==2022.3.2
requests==2.27.1
requests-mock==1.9.3
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==1.0.2
scipy==1.8.0
setuptools==58.1.0
six==1.16.0
soupsieve==2.3.1
SQLAlchemy==1.4.31
tenacity==5.1.5
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.8.0
tensorflow-io-gcs-filesystem==0.24.0
termcolor==1.1.0
testcontainers==3.4.2
tf-estimator-nightly==2.8.0.dev2021122109
threadpoolctl==3.1.0
tqdm==4.63.0
typing-inspect==0.7.1
typing-utils==0.1.0
typing_extensions==4.1.1
uritemplate==4.1.1
urllib3==1.26.8
wcwidth==0.2.5
websocket-client==1.3.1
Werkzeug==2.0.3
wheel==0.37.1
wrapt==1.13.3
zipp==3.7.0
Removing intermediate container feb5304688f8
---> 8f2fd412c5e2
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
---> 2e6294b85a84
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
---> 44329461edbb
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
---> 6dcd32530396
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> aac997eeac66
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in ee67abeadb58
Removing intermediate container ee67abeadb58
---> fe2d8b6f30d4
Step 21/31 : FROM beam as third_party_licenses
---> fe2d8b6f30d4
Step 22/31 : ARG pull_licenses
---> Running in 612691f10744
Removing intermediate container 612691f10744
---> ea547e1610e1
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
---> 6c030acdc39e
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> d1e2f9336451
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 256faa957ef2
Removing intermediate container 256faa957ef2
---> 1cc42878716f
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
---> 7db8b9d9113b
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in c22ac3643122
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.9/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=2323e018518bbe9bfd9cefa5a51447c5d0db23cb22188cc0d50d4810f2565cdb
Stored in directory: /root/.cache/pip/wheels/b8/d5/8b/e0c9765594e0dc8093aae5f67eacc08b9b533da598c710b54a
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mTraceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 40, in <module>
[0m[91m from pip._internal.utils.misc import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip._internal.utils.misc' (/usr/local/lib/python3.9/site-packages/pip/_internal/utils/misc.py)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/pip-licenses", line 5, in <module>
from piplicenses import main
File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 42, in <module>
[0m[91m from pip import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip' (/usr/local/lib/python3.9/site-packages/pip/__init__.py)
[0m[91mTraceback (most recent call last):
File "/tmp/license_scripts/pull_licenses_py.py", line 166, in <module>
[0m[91m dependencies = run_pip_licenses()
File "/tmp/license_scripts/pull_licenses_py.py", line 49, in run_pip_licenses
dependencies = run_bash_command(command)
File "/tmp/license_scripts/pull_licenses_py.py", line 44, in run_bash_command
[0m[91m return subprocess.check_output(command.split()).decode('utf-8')
File "/usr/local/lib/python3.9/subprocess.py", line 424, in check_output
[0m[91m return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
File "/usr/local/lib/python3.9/subprocess.py", line 528, in run
[0m[91m raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pip-licenses', '--with-license-file', '--with-urls', '--from=mixed', '--ignore', 'apache-beam', '--format=json']' returned non-zero exit status 1.
[0mThe command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi' returned a non-zero code: 1
> Task :sdks:python:container:py39:docker FAILED
> Task :runners:spark:2:job-server:sparkJobServerCleanup
Stopping job server pid: 2525117.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 7m 49s
226 actionable tasks: 26 executed, 200 up-to-date
Publishing build scan...
https://gradle.com/s/zzrorojxlw522
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark #3486
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3486/display/redirect>
Changes:
------------------------------------------
[...truncated 1.30 MB...]
attrs==21.4.0
beautifulsoup4==4.10.0
bs4==0.0.1
cachetools==4.2.4
certifi==2021.10.8
cffi==1.15.0
charset-normalizer==2.0.12
click==8.0.4
cloudpickle==2.0.0
crcmod==1.7
cryptography==36.0.1
Cython==0.29.28
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.9
fasteners==0.17.3
flatbuffers==2.0
freezegun==1.2.0
future==0.18.2
gast==0.5.3
google-api-core==1.31.5
google-api-python-client==2.39.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.34.1
google-cloud-bigquery-storage==2.12.0
google-cloud-bigtable==1.7.0
google-cloud-core==1.7.2
google-cloud-datastore==1.15.3
google-cloud-dlp==3.6.1
google-cloud-language==1.3.0
google-cloud-profiler==3.0.7
google-cloud-pubsub==2.9.0
google-cloud-pubsublite==1.4.0
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.1
google-cloud-videointelligence==1.16.1
google-cloud-vision==1.0.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.3.1
googleapis-common-protos==1.55.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.3
grpcio==1.44.0
grpcio-gcp==0.2.2
grpcio-status==1.44.0
guppy3==3.1.2
h5py==3.6.0
hdfs==2.6.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.11.2
joblib==1.1.0
keras==2.8.0
Keras-Preprocessing==1.1.2
libclang==13.0.0
libcst==0.4.1
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
mypy-extensions==0.4.3
nltk==3.7
nose==1.3.7
numpy==1.22.2
oauth2client==4.1.3
oauthlib==3.2.0
opt-einsum==3.3.0
orjson==3.6.7
overrides==6.1.0
packaging==21.3
pandas==1.4.1
parameterized==0.7.5
pbr==5.8.1
pip==22.0.4
pluggy==0.13.1
proto-plus==1.20.3
protobuf==3.19.4
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==6.0.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2021.3
PyYAML==6.0
regex==2022.3.2
requests==2.27.1
requests-mock==1.9.3
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==1.0.2
scipy==1.8.0
setuptools==58.1.0
six==1.16.0
soupsieve==2.3.1
SQLAlchemy==1.4.31
tenacity==5.1.5
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.8.0
tensorflow-io-gcs-filesystem==0.24.0
termcolor==1.1.0
testcontainers==3.4.2
tf-estimator-nightly==2.8.0.dev2021122109
threadpoolctl==3.1.0
tqdm==4.63.0
typing-inspect==0.7.1
typing-utils==0.1.0
typing_extensions==4.1.1
uritemplate==4.1.1
urllib3==1.26.8
wcwidth==0.2.5
websocket-client==1.3.1
Werkzeug==2.0.3
wheel==0.37.1
wrapt==1.13.3
zipp==3.7.0
Removing intermediate container 3f3e4116f062
---> 7ea63ccd3e50
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
---> 6822ad9a4572
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
---> 00040a0601ce
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
---> f17e228350ea
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> fa911ef04756
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 963099bce0db
Removing intermediate container 963099bce0db
---> 6642d2a9950c
Step 21/31 : FROM beam as third_party_licenses
---> 6642d2a9950c
Step 22/31 : ARG pull_licenses
---> Running in 80036d96e1e5
Removing intermediate container 80036d96e1e5
---> ea95963b421b
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
---> bd9fdb303851
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> db6152f13712
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 0c03ce5ebd2b
Removing intermediate container 0c03ce5ebd2b
---> e2957ea1d1b5
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
---> 21288cb4b730
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 9b15c9459fda
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.9/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=5752cad902445fb44110992eb40222fed9384cdeb2fc3c6e61f41b42608fea08
Stored in directory: /root/.cache/pip/wheels/b8/d5/8b/e0c9765594e0dc8093aae5f67eacc08b9b533da598c710b54a
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mTraceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 40, in <module>
from pip._internal.utils.misc import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip._internal.utils.misc' (/usr/local/lib/python3.9/site-packages/pip/_internal/utils/misc.py)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/pip-licenses", line 5, in <module>
[0m[91m from piplicenses import main
File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 42, in <module>
[0m[91m from pip import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip' (/usr/local/lib/python3.9/site-packages/pip/__init__.py)
[0m[91mTraceback (most recent call last):
File "/tmp/license_scripts/pull_licenses_py.py", line 166, in <module>
[0m[91m dependencies = run_pip_licenses()
File "/tmp/license_scripts/pull_licenses_py.py", line 49, in run_pip_licenses
dependencies = run_bash_command(command)
File "/tmp/license_scripts/pull_licenses_py.py", line 44, in run_bash_command
[0m[91m return subprocess.check_output(command.split()).decode('utf-8')
File "/usr/local/lib/python3.9/subprocess.py", line 424, in check_output
[0m[91m return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
File "/usr/local/lib/python3.9/subprocess.py", line 528, in run
[0m[91m raise CalledProcessError(retcode, process.args,
[0m[91msubprocess.CalledProcessError: Command '['pip-licenses', '--with-license-file', '--with-urls', '--from=mixed', '--ignore', 'apache-beam', '--format=json']' returned non-zero exit status 1.
[0mThe command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi' returned a non-zero code: 1
> Task :sdks:python:container:py39:docker FAILED
> Task :runners:spark:2:job-server:sparkJobServerCleanup
Stopping job server pid: 4105823.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 6m 56s
226 actionable tasks: 26 executed, 200 up-to-date
Publishing build scan...
https://gradle.com/s/wfu5d7psujdba
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark #3485
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3485/display/redirect?page=changes>
Changes:
[Luke Cwik] [BEAM-10212] Clean-up comments, remove rawtypes usage.
[Kyle Weaver] [BEAM-14123] Fix typo in hdfsIntegrationTest task name.
[noreply] [BEAM-13893] improved coverage of jobopts package (#17003)
[noreply] Merge pull request #16977 from [BEAM-12164] Added integration test for
------------------------------------------
[...truncated 951.59 KB...]
attrs==21.4.0
beautifulsoup4==4.10.0
bs4==0.0.1
cachetools==4.2.4
certifi==2021.10.8
cffi==1.15.0
charset-normalizer==2.0.12
click==8.0.4
cloudpickle==2.0.0
crcmod==1.7
cryptography==36.0.1
Cython==0.29.28
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.9
fasteners==0.17.3
flatbuffers==2.0
freezegun==1.2.0
future==0.18.2
gast==0.5.3
google-api-core==1.31.5
google-api-python-client==2.39.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.34.1
google-cloud-bigquery-storage==2.12.0
google-cloud-bigtable==1.7.0
google-cloud-core==1.7.2
google-cloud-datastore==1.15.3
google-cloud-dlp==3.6.1
google-cloud-language==1.3.0
google-cloud-profiler==3.0.7
google-cloud-pubsub==2.9.0
google-cloud-pubsublite==1.4.0
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.1
google-cloud-videointelligence==1.16.1
google-cloud-vision==1.0.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.3.1
googleapis-common-protos==1.55.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.3
grpcio==1.44.0
grpcio-gcp==0.2.2
grpcio-status==1.44.0
guppy3==3.1.2
h5py==3.6.0
hdfs==2.6.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.11.2
joblib==1.1.0
keras==2.8.0
Keras-Preprocessing==1.1.2
libclang==13.0.0
libcst==0.4.1
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
mypy-extensions==0.4.3
nltk==3.7
nose==1.3.7
numpy==1.22.2
oauth2client==4.1.3
oauthlib==3.2.0
opt-einsum==3.3.0
orjson==3.6.7
overrides==6.1.0
packaging==21.3
pandas==1.4.1
parameterized==0.7.5
pbr==5.8.1
pip==22.0.4
pluggy==0.13.1
proto-plus==1.20.3
protobuf==3.19.4
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==6.0.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2021.3
PyYAML==6.0
regex==2022.3.2
requests==2.27.1
requests-mock==1.9.3
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==1.0.2
scipy==1.8.0
setuptools==58.1.0
six==1.16.0
soupsieve==2.3.1
SQLAlchemy==1.4.31
tenacity==5.1.5
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.8.0
tensorflow-io-gcs-filesystem==0.24.0
termcolor==1.1.0
testcontainers==3.4.2
tf-estimator-nightly==2.8.0.dev2021122109
threadpoolctl==3.1.0
tqdm==4.63.0
typing-inspect==0.7.1
typing-utils==0.1.0
typing_extensions==4.1.1
uritemplate==4.1.1
urllib3==1.26.8
wcwidth==0.2.5
websocket-client==1.3.1
Werkzeug==2.0.3
wheel==0.37.1
wrapt==1.13.3
zipp==3.7.0
Removing intermediate container 1665f14d7840
---> f78501fd8f20
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
---> e200fe34a257
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
---> 4096c50684e0
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
---> be9468346af7
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 664f6fdc4bb0
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in b600a9eb4d06
Removing intermediate container b600a9eb4d06
---> b209e0153b4a
Step 21/31 : FROM beam as third_party_licenses
---> b209e0153b4a
Step 22/31 : ARG pull_licenses
---> Running in 48685794c941
Removing intermediate container 48685794c941
---> dd82968251ae
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
---> d433aac8d480
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 76df33010603
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 1f353ad676b9
Removing intermediate container 1f353ad676b9
---> b8669ab395aa
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
---> cbff9de14c0d
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 7cbcd718385f
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.9/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=a599c38f826dc555b7d342ba575f4c78882260bc950c0a2d1fcb4e778bbc7ed8
Stored in directory: /root/.cache/pip/wheels/b8/d5/8b/e0c9765594e0dc8093aae5f67eacc08b9b533da598c710b54a
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mTraceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 40, in <module>
[0m[91m from pip._internal.utils.misc import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip._internal.utils.misc' (/usr/local/lib/python3.9/site-packages/pip/_internal/utils/misc.py)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/pip-licenses", line 5, in <module>
[0m[91m from piplicenses import main
File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 42, in <module>
[0m[91m from pip import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip' (/usr/local/lib/python3.9/site-packages/pip/__init__.py)
[0m[91mTraceback (most recent call last):
File "/tmp/license_scripts/pull_licenses_py.py", line 166, in <module>
[0m[91m dependencies = run_pip_licenses()
File "/tmp/license_scripts/pull_licenses_py.py", line 49, in run_pip_licenses
[0m[91m dependencies = run_bash_command(command)
File "/tmp/license_scripts/pull_licenses_py.py", line 44, in run_bash_command
[0m[91m return subprocess.check_output(command.split()).decode('utf-8')
File "/usr/local/lib/python3.9/subprocess.py", line 424, in check_output
[0m[91m return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
File "/usr/local/lib/python3.9/subprocess.py", line 528, in run
[0m[91m raise CalledProcessError(retcode, process.args,
[0m[91msubprocess.CalledProcessError: Command '['pip-licenses', '--with-license-file', '--with-urls', '--from=mixed', '--ignore', 'apache-beam', '--format=json']' returned non-zero exit status 1.
[0mThe command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi' returned a non-zero code: 1
> Task :sdks:python:container:py39:docker FAILED
> Task :runners:spark:2:job-server:sparkJobServerCleanup
Stopping job server pid: 1989993.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 7m 39s
226 actionable tasks: 26 executed, 200 up-to-date
Publishing build scan...
https://gradle.com/s/dylamtmdeafbu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark #3484
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3484/display/redirect?page=changes>
Changes:
[noreply] Populate environment capabilities in v1beta3 protos. (#17042)
[Kyle Weaver] [BEAM-12976] Test a whole pipeline using projection pushdown in BQ IO.
[Kyle Weaver] [BEAM-12976] Enable projection pushdown for Java pipelines on Dataflow,
[noreply] [BEAM-14038] Auto-startup for Python expansion service. (#17035)
------------------------------------------
[...truncated 926.02 KB...]
attrs==21.4.0
beautifulsoup4==4.10.0
bs4==0.0.1
cachetools==4.2.4
certifi==2021.10.8
cffi==1.15.0
charset-normalizer==2.0.12
click==8.0.4
cloudpickle==2.0.0
crcmod==1.7
cryptography==36.0.1
Cython==0.29.28
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.9
fasteners==0.17.3
flatbuffers==2.0
freezegun==1.2.0
future==0.18.2
gast==0.5.3
google-api-core==1.31.5
google-api-python-client==2.39.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.34.1
google-cloud-bigquery-storage==2.12.0
google-cloud-bigtable==1.7.0
google-cloud-core==1.7.2
google-cloud-datastore==1.15.3
google-cloud-dlp==3.6.1
google-cloud-language==1.3.0
google-cloud-profiler==3.0.7
google-cloud-pubsub==2.9.0
google-cloud-pubsublite==1.4.0
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.1
google-cloud-videointelligence==1.16.1
google-cloud-vision==1.0.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.3.1
googleapis-common-protos==1.55.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.3
grpcio==1.44.0
grpcio-gcp==0.2.2
grpcio-status==1.44.0
guppy3==3.1.2
h5py==3.6.0
hdfs==2.6.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.11.2
joblib==1.1.0
keras==2.8.0
Keras-Preprocessing==1.1.2
libclang==13.0.0
libcst==0.4.1
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
mypy-extensions==0.4.3
nltk==3.7
nose==1.3.7
numpy==1.22.2
oauth2client==4.1.3
oauthlib==3.2.0
opt-einsum==3.3.0
orjson==3.6.7
overrides==6.1.0
packaging==21.3
pandas==1.4.1
parameterized==0.7.5
pbr==5.8.1
pip==22.0.4
pluggy==0.13.1
proto-plus==1.20.3
protobuf==3.19.4
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==6.0.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2021.3
PyYAML==6.0
regex==2022.3.2
requests==2.27.1
requests-mock==1.9.3
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==1.0.2
scipy==1.8.0
setuptools==58.1.0
six==1.16.0
soupsieve==2.3.1
SQLAlchemy==1.4.31
tenacity==5.1.5
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.8.0
tensorflow-io-gcs-filesystem==0.24.0
termcolor==1.1.0
testcontainers==3.4.2
tf-estimator-nightly==2.8.0.dev2021122109
threadpoolctl==3.1.0
tqdm==4.63.0
typing-inspect==0.7.1
typing-utils==0.1.0
typing_extensions==4.1.1
uritemplate==4.1.1
urllib3==1.26.8
wcwidth==0.2.5
websocket-client==1.3.1
Werkzeug==2.0.3
wheel==0.37.1
wrapt==1.13.3
zipp==3.7.0
Removing intermediate container da62dfd9d78c
---> 2ac89d8b3671
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
---> 8c135e41b379
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
---> b130c65a7726
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
---> 4d2bdcf54f99
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> faaf5244d2a5
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in d00b927b224e
Removing intermediate container d00b927b224e
---> 732d3ddbb087
Step 21/31 : FROM beam as third_party_licenses
---> 732d3ddbb087
Step 22/31 : ARG pull_licenses
---> Running in 91b2aff95fa6
Removing intermediate container 91b2aff95fa6
---> f0a0400de0a4
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
---> 1e46d5f32e97
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 7bedf227e234
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in f8f9ba9cc4af
Removing intermediate container f8f9ba9cc4af
---> 40592999b6d3
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
---> 1efbdb31f3c0
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in c640f8fa3abd
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.9/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=41bccbc2fc9415dc3e5a3bdc7caf098c9d3303ab135d4dbd15dab86643973e61
Stored in directory: /root/.cache/pip/wheels/b8/d5/8b/e0c9765594e0dc8093aae5f67eacc08b9b533da598c710b54a
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mTraceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 40, in <module>
from pip._internal.utils.misc import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip._internal.utils.misc' (/usr/local/lib/python3.9/site-packages/pip/_internal/utils/misc.py)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/pip-licenses", line 5, in <module>
[0m[91m from piplicenses import main
File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 42, in <module>
[0m[91m from pip import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip' (/usr/local/lib/python3.9/site-packages/pip/__init__.py)
[0m[91mTraceback (most recent call last):
File "/tmp/license_scripts/pull_licenses_py.py", line 166, in <module>
[0m[91m dependencies = run_pip_licenses()
File "/tmp/license_scripts/pull_licenses_py.py", line 49, in run_pip_licenses
dependencies = run_bash_command(command)
File "/tmp/license_scripts/pull_licenses_py.py", line 44, in run_bash_command
[0m[91m return subprocess.check_output(command.split()).decode('utf-8')
File "/usr/local/lib/python3.9/subprocess.py", line 424, in check_output
[0m[91m return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
File "/usr/local/lib/python3.9/subprocess.py", line 528, in run
[0m[91m raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pip-licenses', '--with-license-file', '--with-urls', '--from=mixed', '--ignore', 'apache-beam', '--format=json']' returned non-zero exit status 1.
[0mThe command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi' returned a non-zero code: 1
> Task :sdks:python:container:py39:docker FAILED
> Task :runners:spark:2:job-server:sparkJobServerCleanup
Stopping job server pid: 1664950.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 7m 56s
226 actionable tasks: 26 executed, 200 up-to-date
Publishing build scan...
https://gradle.com/s/mgqwb6mkfqmp6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark #3483
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3483/display/redirect?page=changes>
Changes:
[noreply] [BEAM-11934] Add enable_file_dynamic_sharding to allow DataflowRunner
[noreply] [BEAM-12777] Create symlink for `current` directory (#17105)
[noreply] [BEAM-14020] Adding SchemaTransform, SchemaTransformProvider,
[noreply] [BEAM-13015] Modify metrics to begin and reset to a non-dirty state.
[noreply] [BEAM-14112] Avoid storing a generator in _CustomBigQuerySource (#17100)
------------------------------------------
[...truncated 1.29 MB...]
attrs==21.4.0
beautifulsoup4==4.10.0
bs4==0.0.1
cachetools==4.2.4
certifi==2021.10.8
cffi==1.15.0
charset-normalizer==2.0.12
click==8.0.4
cloudpickle==2.0.0
crcmod==1.7
cryptography==36.0.1
Cython==0.29.28
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.9
fasteners==0.17.3
flatbuffers==2.0
freezegun==1.2.0
future==0.18.2
gast==0.5.3
google-api-core==1.31.5
google-api-python-client==2.39.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.34.1
google-cloud-bigquery-storage==2.12.0
google-cloud-bigtable==1.7.0
google-cloud-core==1.7.2
google-cloud-datastore==1.15.3
google-cloud-dlp==3.6.1
google-cloud-language==1.3.0
google-cloud-profiler==3.0.7
google-cloud-pubsub==2.9.0
google-cloud-pubsublite==1.4.0
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.1
google-cloud-videointelligence==1.16.1
google-cloud-vision==1.0.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.3.1
googleapis-common-protos==1.55.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.3
grpcio==1.44.0
grpcio-gcp==0.2.2
grpcio-status==1.44.0
guppy3==3.1.2
h5py==3.6.0
hdfs==2.6.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.11.2
joblib==1.1.0
keras==2.8.0
Keras-Preprocessing==1.1.2
libclang==13.0.0
libcst==0.4.1
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
mypy-extensions==0.4.3
nltk==3.7
nose==1.3.7
numpy==1.22.2
oauth2client==4.1.3
oauthlib==3.2.0
opt-einsum==3.3.0
orjson==3.6.7
overrides==6.1.0
packaging==21.3
pandas==1.4.1
parameterized==0.7.5
pbr==5.8.1
pip==22.0.4
pluggy==0.13.1
proto-plus==1.20.3
protobuf==3.19.4
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==6.0.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2021.3
PyYAML==6.0
regex==2022.3.2
requests==2.27.1
requests-mock==1.9.3
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==1.0.2
scipy==1.8.0
setuptools==58.1.0
six==1.16.0
soupsieve==2.3.1
SQLAlchemy==1.4.31
tenacity==5.1.5
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.8.0
tensorflow-io-gcs-filesystem==0.24.0
termcolor==1.1.0
testcontainers==3.4.2
tf-estimator-nightly==2.8.0.dev2021122109
threadpoolctl==3.1.0
tqdm==4.63.0
typing-inspect==0.7.1
typing-utils==0.1.0
typing_extensions==4.1.1
uritemplate==4.1.1
urllib3==1.26.8
wcwidth==0.2.5
websocket-client==1.3.1
Werkzeug==2.0.3
wheel==0.37.1
wrapt==1.13.3
zipp==3.7.0
Removing intermediate container b8855b88a715
---> 204b3371722b
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
---> 043ee5459866
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
---> 079b43313e0f
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
---> 63890eb80457
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 3277c9f51af8
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 75e611071a1c
Removing intermediate container 75e611071a1c
---> bb1746a40ba4
Step 21/31 : FROM beam as third_party_licenses
---> bb1746a40ba4
Step 22/31 : ARG pull_licenses
---> Running in dec880ddf621
Removing intermediate container dec880ddf621
---> 42200dbcfea1
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
---> 14cf8190582c
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 1ac07e3f2bc4
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 2853dc3650e0
Removing intermediate container 2853dc3650e0
---> 398cf46e057a
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
---> 6358c3ae3242
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 3bd291a0bbb3
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.9/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=b4dda0c1be6deffacb56f37ab51e4931f4996d8760941d07282cf82bcf36bfed
Stored in directory: /root/.cache/pip/wheels/b8/d5/8b/e0c9765594e0dc8093aae5f67eacc08b9b533da598c710b54a
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mTraceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 40, in <module>
from pip._internal.utils.misc import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip._internal.utils.misc' (/usr/local/lib/python3.9/site-packages/pip/_internal/utils/misc.py)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/pip-licenses", line 5, in <module>
[0m[91m from piplicenses import main
File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 42, in <module>
[0m[91m from pip import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip' (/usr/local/lib/python3.9/site-packages/pip/__init__.py)
[0m[91mTraceback (most recent call last):
File "/tmp/license_scripts/pull_licenses_py.py", line 166, in <module>
[0m[91m dependencies = run_pip_licenses()
File "/tmp/license_scripts/pull_licenses_py.py", line 49, in run_pip_licenses
[0m[91m dependencies = run_bash_command(command)
File "/tmp/license_scripts/pull_licenses_py.py", line 44, in run_bash_command
[0m[91m return subprocess.check_output(command.split()).decode('utf-8')
File "/usr/local/lib/python3.9/subprocess.py", line 424, in check_output
[0m[91m return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
File "/usr/local/lib/python3.9/subprocess.py", line 528, in run
[0m[91m raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pip-licenses', '--with-license-file', '--with-urls', '--from=mixed', '--ignore', 'apache-beam', '--format=json']' returned non-zero exit status 1.
[0mThe command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi' returned a non-zero code: 1
> Task :sdks:python:container:py39:docker FAILED
> Task :runners:spark:2:job-server:sparkJobServerCleanup
Stopping job server pid: 3030611.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 8m 10s
226 actionable tasks: 26 executed, 200 up-to-date
Publishing build scan...
https://gradle.com/s/4aifcpv4daqgg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark #3482
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3482/display/redirect>
Changes:
------------------------------------------
[...truncated 655.57 KB...]
>
coders: <
key: "zGAIeWgUpzKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "zGAIeWgUpzVarIntCoder"
component_coder_ids: "zGAIeWgUpzSerializableCoder1"
>
>
coders: <
key: "zGAIeWgUpzKvCoder3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "zGAIeWgUpzVarIntCoder"
component_coder_ids: "zGAIeWgUpzTimestampedValueCoder"
>
>
coders: <
key: "zGAIeWgUpzKvCoder4"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "zGAIeWgUpzVarIntCoder"
component_coder_ids: "zGAIeWgUpzIterableCoder"
>
>
coders: <
key: "zGAIeWgUpzSerializableCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\312\241\002\360^\254\355\000\005sr\000,org.apache.beam.sdk.coders.SerializableCoder\010\364 \216\305ynl\002\000\001L\000\004typet\000\021Ljava/lang/Class;xr\000&ofV\000\024Custom\005P8j\260\010\235\013;\035\013\002\000\000xr\000 j\213\000\005/\034C\335\325\211\256\274~\370\001/\020pvr\000$N1\000\\io.BoundedSource!`v\023\177\370QA\0015\010r\000\035Z3\000\t,0\020\213\372\020Y\214\347\323\002\000\000xp"
>
>
>
coders: <
key: "zGAIeWgUpzSerializableCoder1"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\312\214\002\360^\254\355\000\005sr\000,org.apache.beam.sdk.coders.SerializableCoder\010\364 \216\305ynl\002\000\001L\000\004typet\000\021Ljava/lang/Class;xr\000&ofV\000\024Custom\005P8j\260\010\235\013;\035\013\002\000\000xr\000 j\213\000\005/\034C\335\325\211\256\274~\370\001/\020pvr\000;N1\000Pio.BoundedReadFromUnb\t\021`Source$Shardd\236\240U\205\000j\363\002\000\000xp"
>
>
>
coders: <
key: "zGAIeWgUpzTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\001?\315\003\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000LCoder\364\376\202p\274iX-\002\000\001L\000\nv\001)\005\030\034t\000\"Lorg/\t]\000/\001],/sdk/coders/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000,j1\000(Serializabl\t\277\034\010\364 \216\305ynl\005\327\\\004typet\000\021Ljava/lang/Class\001\300\000&jV\000\024Custom\005\215Pj\260\010\235\013;\035\013\002\000\000xq\000~\000\003vr\000;N;\000Pio.BoundedReadFromUnb\t\021`Source$Shardd\236\240U\205\000j\363\002\000\000xp"
>
>
>
coders: <
key: "zGAIeWgUpzValueWithRecordIdCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\001h\364\004\320\254\355\000\005sr\000Corg.apache.beam.sdk.values.ValueWithRecordId$B\022\000LCoder{\343\376bQ\014\204>\002\000\002L\000\007i\t\025\034t\000+Lorg/\t\\\000/\001\\\024/sdk/c\0012(s/ByteArray\005B\014;L\000\n\005u\005\016\010t\000\"n;\000\005$\020;xr\000*N\274\000\t`(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000)j1\0006\312\000\034\351\277\005|\263\3746\333\001:\010r\000&j8\000\024Atomic\005o\034\307\354\265\314\205tPF\0015 q\000~\000\003sr\000-N;\000$io.kafka.K\001\006\000R%\227\005B<I\320\251Y\032\341{#\002\000\001L\000\007kv\005\025\010t\000$nH\001\000K\t&\000;\025s\000\"Ns\000-P\r- j\000\275\271\035\243\3126\002!\353\010\010ke)\277\001\264\000\0022\303\001\005\022\rY$q\000~\000\006q\000~\000\016"
>
>
>
coders: <
key: "zGAIeWgUpzVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\210\330\001\350\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xrr5\000\024Atomic\0055 \307\354\265\314\205tPF\002\0055\000*jj\000$Structured\0059\034s\277\022\016\325\3246\021\t9\000 j9\000\005/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "zGAIeWgUpzVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\210\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\024Atomic\0055 \307\354\265\314\205tPF\002\0055\000*j5\000$Structured\0059\034s\277\022\016\325\3246\021\t9\000 j9\000\005/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "zGAIeWgUpzbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.38.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.38.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nL/tmp/artifacts/icedtea-sound-ebvtNFkfFXg4aaYFuDnwKpwDSjzsaZqlqv5iKxPTr-U.jar\022@79bbed34591f15783869a605b839f02a9c034a3cec699aa5aafe622b13d3afe5"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n=icedtea-sound-ebvtNFkfFXg4aaYFuDnwKpwDSjzsaZqlqv5iKxPTr-U.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nF/tmp/artifacts/jaccess-ULFTCPsb6cLYZ0f1BG1FQfczmHNaZCx8plXuRDKpBqE.jar\022@50b15308fb1be9c2d86747f5046d4541f73398735a642c7ca655ee4432a906a1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n7jaccess-ULFTCPsb6cLYZ0f1BG1FQfczmHNaZCx8plXuRDKpBqE.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nI/tmp/artifacts/localedata-dUHqyGxaTVCjfTI8MckPYarZ3_mwf62udkxaHi1aKns.jar\022@7541eac86c5a4d50a37d323c31c90f61aad9dff9b07fadae764c5a1e2d5a2a7b"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n:localedata-dUHqyGxaTVCjfTI8MckPYarZ3_mwf62udkxaHi1aKns.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nF/tmp/artifacts/nashorn-XdUndQGroXOP9NCsfITpBERYcbbGXVHLjbvNWXCh-3A.jar\022@5dd5277501aba1738ff4d0ac7c84e904445871b6c65d51cb8dbbcd5970a1fb70"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n7nashorn-XdUndQGroXOP9NCsfITpBERYcbbGXVHLjbvNWXCh-3A.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nG/tmp/artifacts/cldrdata-YqzuKX1QnLCOo0cwjKRdBhGrip_ltIJZg-APT60tUPA.jar\022@62acee297d509cb08ea347308ca45d0611ab8a9fe5b4825983e00f4fad2d50f0"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n8cldrdata-YqzuKX1QnLCOo0cwjKRdBhGrip_ltIJZg-APT60tUPA.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nD/tmp/artifacts/dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar\022@761129d7ceae74417a5fa72166eb3e449cd6466ce571cc71d7f6ed95759ac952"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n5dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nr/tmp/artifacts/beam-sdks-java-io-expansion-service-2.38.0-SNAPSHOT-FzJ_2jZjORdNrPH_9uhif3iFoIGdXtB3lDI4Z1iBRcA.jar\022@17327fda366339174dacf1fff6e8627f7885a0819d5ed07794323867588145c0"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ncbeam-sdks-java-io-expansion-service-2.38.0-SNAPSHOT-FzJ_2jZjORdNrPH_9uhif3iFoIGdXtB3lDI4Z1iBRcA.jar"
>
>
>
>
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "s3"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/17 12:31:34 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/integration/io/xlang/kafka/kafka_test.go> as /tmp/worker-2-1647520294041422593
2022/03/17 12:31:37 Prepared job with id: go-testkafkaio_basicreadwrite_41558a70-85bd-486c-964a-d1e1a04bea35 and staging token: go-testkafkaio_basicreadwrite_41558a70-85bd-486c-964a-d1e1a04bea35
2022/03/17 12:31:37 Staged binary artifact with token:
2022/03/17 12:31:38 Submitted job: go0testkafkaio0basicreadwrite-jenkins-0317123138-844169e8_6f1f6cd5-8171-4283-8528-047e82b8326d
2022/03/17 12:31:38 Job state: STOPPED
2022/03/17 12:31:38 Job state: STARTING
2022/03/17 12:31:38 Job state: RUNNING
2022/03/17 12:32:20 Job state: DONE
2022/03/17 12:32:20 Warning: 6 errors during metrics processing: [failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"zGAIeWgUpzExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/PairWithRestriction0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"zGAIeWgUpzExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xbcA\xbcA\xbcA" labels:{key:"PCOLLECTION" value:"zGAIeWgUpzExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/PairWithRestriction0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xc9A\xc9A\xc9A" labels:{key:"PCOLLECTION" value:"zGAIeWgUpzExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"zGAIeWgUpzExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xc9A\xc9A\xc9A" labels:{key:"PCOLLECTION" value:"zGAIeWgUpzExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"}]
--- PASS: TestKafkaIO_BasicReadWrite (98.75s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 101.808s
FAIL
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingPython
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:2:job-server:sparkJobServerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 176
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 2m 13s
250 actionable tasks: 166 executed, 73 from cache, 11 up-to-date
Publishing build scan...
https://gradle.com/s/z2hh7cgrsnztg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org