You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/09/06 19:09:03 UTC
Build failed in Jenkins: beam_PostCommit_Java_PVR_Spark_Batch #2470
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/2470/display/redirect?page=changes>
Changes:
[noreply] Fix Java 11 Example PreCommit GItHub Action (#28291)
------------------------------------------
[...truncated 54.83 KB...]
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.31.0/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile:
#1 transferring dockerfile: 2.58kB done
#1 DONE 1.0s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 1.0s
#3 [internal] load metadata for docker.io/library/eclipse-temurin:8
#3 DONE 0.9s
#4 [ 1/16] FROM docker.io/library/eclipse-temurin:8@sha256:a239363b3c5f06ce52fd2cfd50c6d092c33400ba827842e49f206c72e5a7b287
#4 DONE 0.0s
#5 [internal] load build context
#5 ...
#4 [ 1/16] FROM docker.io/library/eclipse-temurin:8@sha256:a239363b3c5f06ce52fd2cfd50c6d092c33400ba827842e49f206c72e5a7b287
#4 CACHED
#5 [internal] load build context
#5 transferring context: 47.19MB 0.4s done
#5 DONE 1.7s
#6 [ 2/16] ADD target/slf4j-api.jar /opt/apache/beam/jars/
#6 DONE 5.4s
#7 [ 3/16] ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
#7 DONE 0.1s
#8 [ 4/16] ADD target/jcl-over-slf4j.jar /opt/apache/beam/jars/
#8 DONE 0.1s
#9 [ 5/16] ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/
#9 DONE 0.1s
#10 [ 6/16] ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/
#10 DONE 0.1s
#11 [ 7/16] ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
#11 DONE 0.1s
#12 [ 8/16] COPY target/jamm.jar target/open-module-agent*.jar /opt/apache/beam/jars/
#12 DONE 0.1s
#13 [ 9/16] COPY target/linux_amd64/boot /opt/apache/beam/
#13 DONE 0.2s
#14 [10/16] COPY target/LICENSE /opt/apache/beam/
#14 DONE 0.1s
#15 [11/16] COPY target/NOTICE /opt/apache/beam/
#15 DONE 0.1s
#16 [12/16] ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
#16 DONE 0.2s
#17 [13/16] COPY target/LICENSE target/options/* /opt/apache/beam/options/
#17 DONE 0.1s
#18 [14/16] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#18 DONE 0.1s
#19 [15/16] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#19 DONE 0.9s
#20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/
#20 DONE 0.1s
#21 exporting to image
#21 exporting layers
#21 exporting layers 0.4s done
#21 writing image sha256:4822373e3f8aaa951b3596ee04c92f0fa56073afce37ef084d609cf271b8a846 done
#21 naming to docker.io/apache/beam_java8_sdk:2.51.0.dev done
#21 DONE 0.5s
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests > testParDoEmptyWithTaggedOutput FAILED
java.lang.RuntimeException at ParDoTest.java:765
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests > testParDoWithTaggedOutput FAILED
java.lang.RuntimeException at ParDoTest.java:723
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-f721a499-5585-4199-9562-5ba40c600c9e
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests > testMultiOutputParDoWithSideInputsIsCumulative FAILED
java.lang.RuntimeException at ParDoTest.java:1289
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests > testSideInputAnnotationWithMultipleSideInputs FAILED
java.lang.RuntimeException at ParDoTest.java:1179
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests > testSideInputAnnotation FAILED
java.lang.RuntimeException at ParDoTest.java:1076
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests > testParDoWithEmptyTaggedOutput FAILED
java.lang.RuntimeException at ParDoTest.java:789
org.apache.beam.sdk.transforms.ParDoTest$StateTests > testBagState FAILED
java.lang.RuntimeException at ParDoTest.java:2627
org.apache.beam.sdk.transforms.ParDoTest$StateTests > testCombiningState FAILED
java.lang.RuntimeException at ParDoTest.java:3497
org.apache.beam.sdk.transforms.ParDoTest$StateTests > testValueStateSameId FAILED
java.lang.RuntimeException at ParDoTest.java:2528
org.apache.beam.sdk.transforms.ParDoTest$StateTests > testValueStateTaggedOutput FAILED
java.lang.RuntimeException at ParDoTest.java:2579
org.apache.beam.sdk.transforms.ParDoTest$StateTests > testBagStateSideInput FAILED
java.lang.RuntimeException at ParDoTest.java:3583
org.apache.beam.sdk.transforms.ParDoTest$StateTests > testCombiningStateParameterSuperclass FAILED
java.lang.RuntimeException at ParDoTest.java:3533
org.apache.beam.sdk.transforms.ParDoTest$StateTests > testCoderInferenceOfList FAILED
java.lang.RuntimeException at ParDoTest.java:2429
org.apache.beam.sdk.transforms.ParDoTest$StateTests > testValueStateDedup FAILED
java.lang.RuntimeException at ParDoTest.java:2342
org.apache.beam.sdk.transforms.ParDoTest$StateTests > testValueStateFixedWindows FAILED
java.lang.RuntimeException at ParDoTest.java:2473
org.apache.beam.sdk.transforms.ParDoTest$TimestampTests > testParDoTaggedOutputWithTimestamp FAILED
java.lang.RuntimeException at ParDoTest.java:2030
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-1f0cc165-365e-42cb-aa96-8f989fb3aace
org.apache.beam.sdk.transforms.ParDoTest$TimestampTests > testParDoShiftTimestampUnlimited FAILED
java.lang.RuntimeException at ParDoTest.java:2142
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-7b5e2411-0c96-4e5b-8f05-58318560a42d
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-29c06c8a-f5a4-4e3b-bc1f-380ca29fdfa4
[pool-732-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 13 for at least 01h38m36s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1519/207921691.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1543/1797662483.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[pool-786-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 1 for at least 01h36m35s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1519/207921691.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1543/1797662483.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[pool-1029-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 6 for at least 01h26m55s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1519/207921691.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1543/1797662483.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[pool-732-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 13 for at least 01h38m36s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1519/207921691.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1543/1797662483.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
234 tests completed, 17 failed, 1 skipped
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch FAILED
> Task :runners:spark:3:job-server:validatesPortableRunnerDocker FROM-CACHE
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesPortableRunnerBatch'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/runners/spark/3/job-server/build/reports/tests/validatesPortableRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 54m 27s
118 actionable tasks: 72 executed, 42 from cache, 4 up-to-date
Publishing build scan...
https://ge.apache.org/s/nx5yhcdabqsvq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Java_PVR_Spark_Batch #2479
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/2479/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_PVR_Spark_Batch #2478
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/2478/display/redirect?page=changes>
Changes:
[noreply] Add descriptions for the 2 vertex examples (#28361)
------------------------------------------
[...truncated 44.58 KB...]
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/golang:1.20-bullseye
#3 DONE 0.3s
#4 [1/5] FROM docker.io/library/golang:1.20-bullseye@sha256:5731a4da495bc59dae9fe1c7f9cb4c6a730b2d42ebbb20626efa8a740f6cd4ec
#4 resolve docker.io/library/golang:1.20-bullseye@sha256:5731a4da495bc59dae9fe1c7f9cb4c6a730b2d42ebbb20626efa8a740f6cd4ec 0.0s done
#4 DONE 0.0s
#5 [internal] load build context
#5 transferring context: 1.96kB 0.0s done
#5 DONE 0.0s
#6 [4/5] RUN go install github.com/google/go-licenses@latest
#6 CACHED
#7 [2/5] WORKDIR /usr/src/app
#7 CACHED
#8 [3/5] COPY go.mod ./
#8 CACHED
#9 [5/5] COPY get-licenses.sh /opt/apache/beam/
#9 CACHED
#10 exporting to image
#10 exporting layers done
#10 writing image sha256:dd068219b30ed31d8b23ed0d36624514e9086cbd72f424c5875d202f29c992d2 done
#10 naming to docker.io/library/golicenses-java done
#10 DONE 0.0s
> Task :sdks:java:container:pullLicenses
Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
Successfully uninstalled setuptools-44.0.0
Successfully installed pip-23.2.1 setuptools-68.2.0 wheel-0.41.2
Collecting beautifulsoup4<5.0,>=4.9.0 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19))
Using cached beautifulsoup4-4.12.2-py3-none-any.whl (142 kB)
Collecting pyyaml<7,>=6.0.1 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 20))
Obtaining dependency information for pyyaml<7,>=6.0.1 from https://files.pythonhosted.org/packages/c8/6b/6600ac24725c7388255b2f5add93f91e58a5d7efaf4af244fdbcc11a541b/PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.1 kB)
Collecting tenacity<9.0,>=6.1.0 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 21))
Obtaining dependency information for tenacity<9.0,>=6.1.0 from https://files.pythonhosted.org/packages/f4/f1/990741d5bb2487d529d20a433210ffa136a367751e454214013b441c4575/tenacity-8.2.3-py3-none-any.whl.metadata
Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0,>=4.9.0->-r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19))
Obtaining dependency information for soupsieve>1.2 from https://files.pythonhosted.org/packages/4c/f3/038b302fdfbe3be7da016777069f26ceefe11a681055ea1f7817546508e3/soupsieve-2.5-py3-none-any.whl.metadata
Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: tenacity, soupsieve, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.12.2 pyyaml-6.0.1 soupsieve-2.5 tenacity-8.2.3
Executing python <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> --manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 126 dependencies using 16 threads.
INFO:root:Replaced local file URL with file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING> for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 1.510757 seconds with 16 threads.
Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :release:go-licenses:java:dockerRun
+ rm -rf '/output/*'
+ go get github.com/apache/beam/sdks/v2/java/container
go: downloading github.com/apache/beam/sdks/v2 v2.50.0
go: downloading github.com/apache/beam v2.50.0+incompatible
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :sdks:java:container:downloadCloudProfilerAgent
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0version.txt
NOTICES
profiler_java_agent.so
100 4183k 100 4183k 0 0 22.6M 0 --:--:-- --:--:-- --:--:-- 22.5M
> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.21.0 build -o ./build/target/linux_amd64/boot boot.go boot_test.go pathingjar.go pathingjar_test.go
> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons:
- Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6.2/userguide/validation_problems.html#implicit_dependency for more details about this problem.
> Task :release:go-licenses:java:dockerRun
go: downloading google.golang.org/grpc v1.57.0
go: downloading github.com/golang/protobuf v1.5.3
go: downloading golang.org/x/sys v0.11.0
go: downloading google.golang.org/protobuf v1.31.0
go: downloading golang.org/x/net v0.14.0
go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230726155614-23370e0ffb3e
go: downloading google.golang.org/genproto v0.0.0-20230706204954-ccb25ca9f130
go: downloading golang.org/x/text v0.12.0
go: added github.com/apache/beam/sdks/v2 v2.50.0
go: added github.com/golang/protobuf v1.5.3
go: added golang.org/x/net v0.14.0
go: added golang.org/x/sys v0.11.0
go: added golang.org/x/text v0.12.0
go: added google.golang.org/genproto/googleapis/rpc v0.0.0-20230726155614-23370e0ffb3e
go: added google.golang.org/grpc v1.57.0
go: added google.golang.org/protobuf v1.31.0
+ go-licenses save github.com/apache/beam/sdks/v2/java/container --save_path=/output/licenses
W0908 16:21:11.324057 36 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.11.0/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/java/container
+ tee /output/licenses/list.csv
W0908 16:21:17.015849 82 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.11.0/unix/asm_linux_amd64.s
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch
> Task :release:go-licenses:java:dockerRun
github.com/apache/beam/sdks/v2/go,https://github.com/apache/beam/blob/sdks/v2.50.0/sdks/go/README.md,Apache-2.0
github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.50.0/sdks/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.3/LICENSE,BSD-3-Clause
golang.org/x/net,https://cs.opensource.google/go/x/net/+/v0.14.0:LICENSE,BSD-3-Clause
golang.org/x/sys/unix,https://cs.opensource.google/go/x/sys/+/v0.11.0:LICENSE,BSD-3-Clause
golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.12.0:LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/23370e0ffb3e/googleapis/rpc/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.57.0/LICENSE,Apache-2.0
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.31.0/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 2.58kB 0.0s done
#1 DONE 0.1s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/eclipse-temurin:8
#3 DONE 0.4s
#4 [ 1/16] FROM docker.io/library/eclipse-temurin:8@sha256:a239363b3c5f06ce52fd2cfd50c6d092c33400ba827842e49f206c72e5a7b287
#4 CACHED
#5 [internal] load build context
#5 transferring context: 47.24MB 0.9s done
#5 DONE 0.9s
#6 [ 2/16] ADD target/slf4j-api.jar /opt/apache/beam/jars/
#6 DONE 1.2s
#7 [ 3/16] ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
#7 DONE 0.1s
#8 [ 4/16] ADD target/jcl-over-slf4j.jar /opt/apache/beam/jars/
#8 DONE 0.1s
#9 [ 5/16] ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/
#9 DONE 0.1s
#10 [ 6/16] ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/
#10 DONE 0.1s
#11 [ 7/16] ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
#11 DONE 0.1s
#12 [ 8/16] COPY target/jamm.jar target/open-module-agent*.jar /opt/apache/beam/jars/
#12 DONE 0.1s
#13 [ 9/16] COPY target/linux_amd64/boot /opt/apache/beam/
#13 DONE 0.2s
#14 [10/16] COPY target/LICENSE /opt/apache/beam/
#14 DONE 0.1s
#15 [11/16] COPY target/NOTICE /opt/apache/beam/
#15 DONE 0.1s
#16 [12/16] ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
#16 DONE 0.2s
#17 [13/16] COPY target/LICENSE target/options/* /opt/apache/beam/options/
#17 DONE 0.1s
#18 [14/16] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#18 DONE 0.1s
#19 [15/16] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#19 DONE 0.7s
#20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/
#20 DONE 0.1s
#21 exporting to image
#21 exporting layers
#21 exporting layers 0.5s done
#21 writing image sha256:a739ffacd186bcc93a983d245da65cf921ef503a6a3492d846f37d34f78482a0 done
#21 naming to docker.io/apache/beam_java8_sdk:2.51.0.dev done
#21 DONE 0.5s
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch
org.apache.beam.sdk.transforms.CombineTest$WindowingTests > testSlidingWindowsCombine FAILED
java.lang.RuntimeException at CombineTest.java:1164
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-55c0de38-6d3c-4420-989a-d585a2471feb
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-5c83b74f-f075-4fff-b635-5ba60296ec98
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-a9bb30ed-a582-47f9-b7c0-40873204321c
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-d2a06cf8-69c1-4601-b869-57c7fe64a249
234 tests completed, 1 failed, 1 skipped
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch FAILED
> Task :runners:spark:3:job-server:validatesPortableRunnerDocker
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-41bedc0a-e6c4-419f-b7bb-b88d00730b2d
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesPortableRunnerBatch'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/runners/spark/3/job-server/build/reports/tests/validatesPortableRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 49m 58s
118 actionable tasks: 73 executed, 41 from cache, 4 up-to-date
Publishing build scan...
https://ge.apache.org/s/x3erhtpmd6b3w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_PVR_Spark_Batch #2477
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/2477/display/redirect>
Changes:
------------------------------------------
[...truncated 45.93 KB...]
Collecting beautifulsoup4<5.0,>=4.9.0 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19))
Using cached beautifulsoup4-4.12.2-py3-none-any.whl (142 kB)
Collecting pyyaml<7,>=6.0.1 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 20))
Obtaining dependency information for pyyaml<7,>=6.0.1 from https://files.pythonhosted.org/packages/c8/6b/6600ac24725c7388255b2f5add93f91e58a5d7efaf4af244fdbcc11a541b/PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.1 kB)
Collecting tenacity<9.0,>=6.1.0 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 21))
Obtaining dependency information for tenacity<9.0,>=6.1.0 from https://files.pythonhosted.org/packages/f4/f1/990741d5bb2487d529d20a433210ffa136a367751e454214013b441c4575/tenacity-8.2.3-py3-none-any.whl.metadata
Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0,>=4.9.0->-r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19))
Obtaining dependency information for soupsieve>1.2 from https://files.pythonhosted.org/packages/4c/f3/038b302fdfbe3be7da016777069f26ceefe11a681055ea1f7817546508e3/soupsieve-2.5-py3-none-any.whl.metadata
Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: tenacity, soupsieve, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.12.2 pyyaml-6.0.1 soupsieve-2.5 tenacity-8.2.3
Executing python <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> --manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 126 dependencies using 16 threads.
INFO:root:Replaced local file URL with file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING> for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 1.386772 seconds with 16 threads.
Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :release:go-licenses:java:dockerRun
+ rm -rf '/output/*'
+ go get github.com/apache/beam/sdks/v2/java/container
go: downloading github.com/apache/beam/sdks/v2 v2.50.0
go: downloading github.com/apache/beam v2.50.0+incompatible
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :sdks:java:container:downloadCloudProfilerAgent
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0version.txt
NOTICES
profiler_java_agent.so
100 4183k 100 4183k 0 0 20.9M 0 --:--:-- --:--:-- --:--:-- 20.9M100 4183k 100 4183k 0 0 20.9M 0 --:--:-- --:--:-- --:--:-- 20.8M
> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :release:go-licenses:java:dockerRun
go: downloading github.com/golang/protobuf v1.5.3
go: downloading google.golang.org/protobuf v1.31.0
go: downloading golang.org/x/sys v0.11.0
go: downloading google.golang.org/grpc v1.57.0
go: downloading golang.org/x/net v0.14.0
go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230726155614-23370e0ffb3e
go: downloading google.golang.org/genproto v0.0.0-20230706204954-ccb25ca9f130
go: downloading golang.org/x/text v0.12.0
> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.21.0 build -o ./build/target/linux_amd64/boot boot.go boot_test.go pathingjar.go pathingjar_test.go
> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons:
- Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6.2/userguide/validation_problems.html#implicit_dependency for more details about this problem.
> Task :release:go-licenses:java:dockerRun
go: added github.com/apache/beam/sdks/v2 v2.50.0
go: added github.com/golang/protobuf v1.5.3
go: added golang.org/x/net v0.14.0
go: added golang.org/x/sys v0.11.0
go: added golang.org/x/text v0.12.0
go: added google.golang.org/genproto/googleapis/rpc v0.0.0-20230726155614-23370e0ffb3e
go: added google.golang.org/grpc v1.57.0
go: added google.golang.org/protobuf v1.31.0
+ go-licenses save github.com/apache/beam/sdks/v2/java/container --save_path=/output/licenses
W0908 10:21:07.517579 36 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.11.0/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/java/container
+ tee /output/licenses/list.csv
W0908 10:21:14.405729 83 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.11.0/unix/asm_linux_amd64.s
github.com/apache/beam/sdks/v2/go,https://github.com/apache/beam/blob/sdks/v2.50.0/sdks/go/README.md,Apache-2.0
github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.50.0/sdks/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.3/LICENSE,BSD-3-Clause
golang.org/x/net,https://cs.opensource.google/go/x/net/+/v0.14.0:LICENSE,BSD-3-Clause
golang.org/x/sys/unix,https://cs.opensource.google/go/x/sys/+/v0.11.0:LICENSE,BSD-3-Clause
golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.12.0:LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/23370e0ffb3e/googleapis/rpc/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.57.0/LICENSE,Apache-2.0
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.31.0/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
#1 [internal] load .dockerignore
#1 transferring context: 2B done
#1 DONE 0.1s
#2 [internal] load build definition from Dockerfile
#2 transferring dockerfile: 2.58kB done
#2 DONE 0.1s
#3 [internal] load metadata for docker.io/library/eclipse-temurin:8
#3 DONE 0.3s
#4 [ 1/16] FROM docker.io/library/eclipse-temurin:8@sha256:a239363b3c5f06ce52fd2cfd50c6d092c33400ba827842e49f206c72e5a7b287
#4 CACHED
#5 [internal] load build context
#5 transferring context: 47.20MB 0.7s done
#5 DONE 0.8s
#6 [ 2/16] ADD target/slf4j-api.jar /opt/apache/beam/jars/
#6 DONE 1.1s
#7 [ 3/16] ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
#7 DONE 0.1s
#8 [ 4/16] ADD target/jcl-over-slf4j.jar /opt/apache/beam/jars/
#8 DONE 0.1s
#9 [ 5/16] ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/
#9 DONE 0.1s
#10 [ 6/16] ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/
#10 DONE 0.1s
#11 [ 7/16] ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
#11 DONE 0.1s
#12 [ 8/16] COPY target/jamm.jar target/open-module-agent*.jar /opt/apache/beam/jars/
#12 DONE 0.1s
#13 [ 9/16] COPY target/linux_amd64/boot /opt/apache/beam/
#13 DONE 0.2s
#14 [10/16] COPY target/LICENSE /opt/apache/beam/
#14 DONE 0.1s
#15 [11/16] COPY target/NOTICE /opt/apache/beam/
#15 DONE 0.1s
#16 [12/16] ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
#16 DONE 0.2s
#17 [13/16] COPY target/LICENSE target/options/* /opt/apache/beam/options/
#17 DONE 0.1s
#18 [14/16] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#18 DONE 0.1s
#19 [15/16] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#19 DONE 0.7s
#20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/
#20 DONE 0.1s
#21 exporting to image
#21 exporting layers
#21 exporting layers 0.4s done
#21 writing image sha256:d8dcf2d0bcff67c416d4c0239dd1c24f575872ca883c4d677f77e5748abd5617 done
#21 naming to docker.io/apache/beam_java8_sdk:2.51.0.dev done
#21 DONE 0.4s
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch
org.apache.beam.sdk.transforms.CombineTest$WindowingTests > testWindowedCombineGloballyAsSingletonView FAILED
java.lang.RuntimeException at CombineTest.java:1402
org.apache.beam.sdk.transforms.ParDoTest$TimerCoderInferenceTests > testValueStateCoderInference FAILED
java.lang.RuntimeException at ParDoTest.java:6309
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests > testParDoWithOnlyTaggedOutput FAILED
java.lang.RuntimeException at ParDoTest.java:818
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests > testParDoEmptyWithTaggedOutput FAILED
java.lang.RuntimeException at ParDoTest.java:765
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-95272d9a-414c-491d-9cd4-ec8423b1891b
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests > testSideInputAnnotationWithMultipleSideInputs FAILED
java.lang.RuntimeException at ParDoTest.java:1179
org.apache.beam.sdk.transforms.ParDoTest$StateTests > testCombiningState FAILED
java.lang.RuntimeException at ParDoTest.java:3497
org.apache.beam.sdk.transforms.ParDoTest$StateTests > testValueStateSameId FAILED
java.lang.RuntimeException at ParDoTest.java:2528
org.apache.beam.sdk.transforms.ParDoTest$StateTests > testValueStateSimple FAILED
java.lang.RuntimeException at ParDoTest.java:2292
org.apache.beam.sdk.transforms.ParDoTest$StateTests > testCoderInferenceOfList FAILED
java.lang.RuntimeException at ParDoTest.java:2429
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-5e38696e-82db-4c24-be4c-69e6ffe3721c
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-efd5e436-0b98-4447-90bc-0ce80800cb42
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-08b2b755-b64f-435c-9891-cf8201bf36ea
[pool-894-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 4 for at least 01h24m56s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1544/1174262094.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1568/690334258.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
234 tests completed, 9 failed, 1 skipped
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch FAILED
> Task :runners:spark:3:job-server:validatesPortableRunnerDocker FROM-CACHE
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesPortableRunnerBatch'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/runners/spark/3/job-server/build/reports/tests/validatesPortableRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 43m 44s
118 actionable tasks: 72 executed, 42 from cache, 4 up-to-date
Publishing build scan...
https://ge.apache.org/s/73mihkfukcq5m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_PVR_Spark_Batch #2476
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/2476/display/redirect>
Changes:
------------------------------------------
[...truncated 44.85 KB...]
#4 DONE 0.0s
#5 [internal] load build context
#5 transferring context: 1.96kB 0.1s done
#5 DONE 0.1s
#6 [2/5] WORKDIR /usr/src/app
#6 CACHED
#7 [3/5] COPY go.mod ./
#7 CACHED
#8 [4/5] RUN go install github.com/google/go-licenses@latest
#8 CACHED
#9 [5/5] COPY get-licenses.sh /opt/apache/beam/
#9 CACHED
#10 exporting to image
#10 exporting layers done
#10 writing image sha256:eb754c1bca56e520095376e7c4f946d348bf60d0cfaebd6c4e595d35c204499c done
#10 naming to docker.io/library/golicenses-java done
#10 DONE 0.0s
> Task :sdks:java:container:pullLicenses
Collecting wheel
Using cached wheel-0.41.2-py3-none-any.whl (64 kB)
Installing collected packages: pip, setuptools, wheel
Attempting uninstall: pip
Found existing installation: pip 20.0.2
Uninstalling pip-20.0.2:
Successfully uninstalled pip-20.0.2
Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
Successfully uninstalled setuptools-44.0.0
Successfully installed pip-23.2.1 setuptools-68.2.0 wheel-0.41.2
Collecting beautifulsoup4<5.0,>=4.9.0 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19))
Using cached beautifulsoup4-4.12.2-py3-none-any.whl (142 kB)
Collecting pyyaml<7,>=6.0.1 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 20))
Obtaining dependency information for pyyaml<7,>=6.0.1 from https://files.pythonhosted.org/packages/c8/6b/6600ac24725c7388255b2f5add93f91e58a5d7efaf4af244fdbcc11a541b/PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.1 kB)
Collecting tenacity<9.0,>=6.1.0 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 21))
Obtaining dependency information for tenacity<9.0,>=6.1.0 from https://files.pythonhosted.org/packages/f4/f1/990741d5bb2487d529d20a433210ffa136a367751e454214013b441c4575/tenacity-8.2.3-py3-none-any.whl.metadata
Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0,>=4.9.0->-r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19))
Obtaining dependency information for soupsieve>1.2 from https://files.pythonhosted.org/packages/4c/f3/038b302fdfbe3be7da016777069f26ceefe11a681055ea1f7817546508e3/soupsieve-2.5-py3-none-any.whl.metadata
Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: tenacity, soupsieve, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.12.2 pyyaml-6.0.1 soupsieve-2.5 tenacity-8.2.3
Executing python <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> --manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 126 dependencies using 16 threads.
INFO:root:Replaced local file URL with file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING> for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 1.430064 seconds with 16 threads.
Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :release:go-licenses:java:dockerRun
+ rm -rf '/output/*'
+ go get github.com/apache/beam/sdks/v2/java/container
go: downloading github.com/apache/beam/sdks/v2 v2.50.0
go: downloading github.com/apache/beam v2.50.0+incompatible
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :sdks:java:container:downloadCloudProfilerAgent
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0version.txt
NOTICES
profiler_java_agent.so
100 4183k 100 4183k 0 0 23.8M 0 --:--:-- --:--:-- --:--:-- 24.0M
> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.21.0 build -o ./build/target/linux_amd64/boot boot.go boot_test.go pathingjar.go pathingjar_test.go
> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons:
- Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6.2/userguide/validation_problems.html#implicit_dependency for more details about this problem.
> Task :release:go-licenses:java:dockerRun
go: downloading github.com/golang/protobuf v1.5.3
go: downloading google.golang.org/grpc v1.57.0
go: downloading google.golang.org/protobuf v1.31.0
go: downloading golang.org/x/sys v0.11.0
go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230726155614-23370e0ffb3e
go: downloading golang.org/x/net v0.14.0
go: downloading google.golang.org/genproto v0.0.0-20230706204954-ccb25ca9f130
go: downloading golang.org/x/text v0.12.0
go: added github.com/apache/beam/sdks/v2 v2.50.0
go: added github.com/golang/protobuf v1.5.3
go: added golang.org/x/net v0.14.0
go: added golang.org/x/sys v0.11.0
go: added golang.org/x/text v0.12.0
go: added google.golang.org/genproto/googleapis/rpc v0.0.0-20230726155614-23370e0ffb3e
go: added google.golang.org/grpc v1.57.0
go: added google.golang.org/protobuf v1.31.0
+ go-licenses save github.com/apache/beam/sdks/v2/java/container --save_path=/output/licenses
W0908 04:21:25.532437 35 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.11.0/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/java/container
+ tee /output/licenses/list.csv
W0908 04:21:33.468899 77 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.11.0/unix/asm_linux_amd64.s
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch
> Task :release:go-licenses:java:dockerRun
github.com/apache/beam/sdks/v2/go,https://github.com/apache/beam/blob/sdks/v2.50.0/sdks/go/README.md,Apache-2.0
github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.50.0/sdks/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.3/LICENSE,BSD-3-Clause
golang.org/x/net,https://cs.opensource.google/go/x/net/+/v0.14.0:LICENSE,BSD-3-Clause
golang.org/x/sys/unix,https://cs.opensource.google/go/x/sys/+/v0.11.0:LICENSE,BSD-3-Clause
golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.12.0:LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/23370e0ffb3e/googleapis/rpc/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.57.0/LICENSE,Apache-2.0
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.31.0/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 2.58kB done
#1 DONE 0.1s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/eclipse-temurin:8
#3 DONE 0.4s
#4 [ 1/16] FROM docker.io/library/eclipse-temurin:8@sha256:a239363b3c5f06ce52fd2cfd50c6d092c33400ba827842e49f206c72e5a7b287
#4 CACHED
#5 [internal] load build context
#5 transferring context: 47.20MB 1.0s done
#5 DONE 1.0s
#6 [ 2/16] ADD target/slf4j-api.jar /opt/apache/beam/jars/
#6 DONE 1.4s
#7 [ 3/16] ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
#7 DONE 0.1s
#8 [ 4/16] ADD target/jcl-over-slf4j.jar /opt/apache/beam/jars/
#8 DONE 0.1s
#9 [ 5/16] ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/
#9 DONE 0.1s
#10 [ 6/16] ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/
#10 DONE 0.1s
#11 [ 7/16] ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
#11 DONE 0.1s
#12 [ 8/16] COPY target/jamm.jar target/open-module-agent*.jar /opt/apache/beam/jars/
#12 DONE 0.1s
#13 [ 9/16] COPY target/linux_amd64/boot /opt/apache/beam/
#13 DONE 0.2s
#14 [10/16] COPY target/LICENSE /opt/apache/beam/
#14 DONE 0.1s
#15 [11/16] COPY target/NOTICE /opt/apache/beam/
#15 DONE 0.1s
#16 [12/16] ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
#16 DONE 0.2s
#17 [13/16] COPY target/LICENSE target/options/* /opt/apache/beam/options/
#17 DONE 0.1s
#18 [14/16] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#18 DONE 0.1s
#19 [15/16] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#19 DONE 1.1s
#20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/
#20 DONE 0.3s
#21 exporting to image
#21 exporting layers
#21 exporting layers 0.4s done
#21 writing image sha256:6cf93f95c6113388308454767341005e09339bc1dbcad563f06c4d8d427ddf16 done
#21 naming to docker.io/apache/beam_java8_sdk:2.51.0.dev done
#21 DONE 0.4s
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch
org.apache.beam.sdk.transforms.CombineTest$WindowingTests > testSlidingWindowsCombine FAILED
java.lang.RuntimeException at CombineTest.java:1164
org.apache.beam.sdk.transforms.ParDoTest$TimerCoderInferenceTests > testValueStateCoderInference FAILED
java.lang.RuntimeException at ParDoTest.java:6309
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-fdaba1a0-4745-42d3-8259-a22381e8cb5a
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-699d94ff-d7a8-4a68-bdca-3cbf17d81a99
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-70228311-4830-4140-ad20-8f203b1ca831
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-c9254253-a528-419d-a68a-f4d122f7c898
234 tests completed, 2 failed, 1 skipped
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch FAILED
> Task :runners:spark:3:job-server:validatesPortableRunnerDocker FROM-CACHE
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesPortableRunnerBatch'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/runners/spark/3/job-server/build/reports/tests/validatesPortableRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 44m 40s
118 actionable tasks: 72 executed, 42 from cache, 4 up-to-date
Publishing build scan...
https://ge.apache.org/s/qxglx2yvgf5xe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_PVR_Spark_Batch #2475
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/2475/display/redirect>
Changes:
------------------------------------------
[...truncated 45.98 KB...]
Successfully installed pip-23.2.1 setuptools-68.2.0 wheel-0.41.2
Collecting beautifulsoup4<5.0,>=4.9.0 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19))
Using cached beautifulsoup4-4.12.2-py3-none-any.whl (142 kB)
Collecting pyyaml<7,>=6.0.1 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 20))
Obtaining dependency information for pyyaml<7,>=6.0.1 from https://files.pythonhosted.org/packages/c8/6b/6600ac24725c7388255b2f5add93f91e58a5d7efaf4af244fdbcc11a541b/PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.1 kB)
Collecting tenacity<9.0,>=6.1.0 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 21))
Obtaining dependency information for tenacity<9.0,>=6.1.0 from https://files.pythonhosted.org/packages/f4/f1/990741d5bb2487d529d20a433210ffa136a367751e454214013b441c4575/tenacity-8.2.3-py3-none-any.whl.metadata
Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0,>=4.9.0->-r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19))
Obtaining dependency information for soupsieve>1.2 from https://files.pythonhosted.org/packages/4c/f3/038b302fdfbe3be7da016777069f26ceefe11a681055ea1f7817546508e3/soupsieve-2.5-py3-none-any.whl.metadata
Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: tenacity, soupsieve, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.12.2 pyyaml-6.0.1 soupsieve-2.5 tenacity-8.2.3
Executing python <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> --manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 126 dependencies using 16 threads.
INFO:root:Replaced local file URL with file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING> for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 1.381136 seconds with 16 threads.
Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :release:go-licenses:java:dockerRun
+ rm -rf '/output/*'
+ go get github.com/apache/beam/sdks/v2/java/container
go: downloading github.com/apache/beam/sdks/v2 v2.50.0
go: downloading github.com/apache/beam v2.50.0+incompatible
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :sdks:java:container:downloadCloudProfilerAgent
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0version.txt
NOTICES
profiler_java_agent.so
100 4183k 100 4183k 0 0 24.4M 0 --:--:-- --:--:-- --:--:-- 24.4M
> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :release:go-licenses:java:dockerRun
go: downloading github.com/golang/protobuf v1.5.3
go: downloading google.golang.org/grpc v1.57.0
go: downloading google.golang.org/protobuf v1.31.0
go: downloading golang.org/x/sys v0.11.0
go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230726155614-23370e0ffb3e
go: downloading golang.org/x/net v0.14.0
go: downloading google.golang.org/genproto v0.0.0-20230706204954-ccb25ca9f130
go: downloading golang.org/x/text v0.12.0
> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.21.0 build -o ./build/target/linux_amd64/boot boot.go boot_test.go pathingjar.go pathingjar_test.go
> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons:
- Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6.2/userguide/validation_problems.html#implicit_dependency for more details about this problem.
> Task :release:go-licenses:java:dockerRun
go: added github.com/apache/beam/sdks/v2 v2.50.0
go: added github.com/golang/protobuf v1.5.3
go: added golang.org/x/net v0.14.0
go: added golang.org/x/sys v0.11.0
go: added golang.org/x/text v0.12.0
go: added google.golang.org/genproto/googleapis/rpc v0.0.0-20230726155614-23370e0ffb3e
go: added google.golang.org/grpc v1.57.0
go: added google.golang.org/protobuf v1.31.0
+ go-licenses save github.com/apache/beam/sdks/v2/java/container --save_path=/output/licenses
W0907 22:21:05.500086 37 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.11.0/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/java/container
+ tee /output/licenses/list.csv
W0907 22:21:12.388742 79 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.11.0/unix/asm_linux_amd64.s
github.com/apache/beam/sdks/v2/go,https://github.com/apache/beam/blob/sdks/v2.50.0/sdks/go/README.md,Apache-2.0
github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.50.0/sdks/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.3/LICENSE,BSD-3-Clause
golang.org/x/net,https://cs.opensource.google/go/x/net/+/v0.14.0:LICENSE,BSD-3-Clause
golang.org/x/sys/unix,https://cs.opensource.google/go/x/sys/+/v0.11.0:LICENSE,BSD-3-Clause
golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.12.0:LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/23370e0ffb3e/googleapis/rpc/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.57.0/LICENSE,Apache-2.0
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.31.0/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 2.58kB 0.0s done
#1 DONE 0.1s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/eclipse-temurin:8
#3 DONE 0.4s
#4 [ 1/16] FROM docker.io/library/eclipse-temurin:8@sha256:a239363b3c5f06ce52fd2cfd50c6d092c33400ba827842e49f206c72e5a7b287
#4 CACHED
#5 [internal] load build context
#5 transferring context: 47.20MB 0.9s done
#5 DONE 0.9s
#6 [ 2/16] ADD target/slf4j-api.jar /opt/apache/beam/jars/
#6 DONE 26.3s
#7 [ 3/16] ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
#7 DONE 0.8s
#8 [ 4/16] ADD target/jcl-over-slf4j.jar /opt/apache/beam/jars/
#8 DONE 0.1s
#9 [ 5/16] ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/
#9 DONE 0.1s
#10 [ 6/16] ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/
#10 DONE 0.1s
#11 [ 7/16] ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
#11 DONE 0.1s
#12 [ 8/16] COPY target/jamm.jar target/open-module-agent*.jar /opt/apache/beam/jars/
#12 DONE 0.1s
#13 [ 9/16] COPY target/linux_amd64/boot /opt/apache/beam/
#13 DONE 0.2s
#14 [10/16] COPY target/LICENSE /opt/apache/beam/
#14 DONE 0.0s
#15 [11/16] COPY target/NOTICE /opt/apache/beam/
#15 DONE 0.1s
#16 [12/16] ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
#16 DONE 0.3s
#17 [13/16] COPY target/LICENSE target/options/* /opt/apache/beam/options/
#17 DONE 0.1s
#18 [14/16] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#18 DONE 0.1s
#19 [15/16] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#19 DONE 0.5s
#20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/
#20 DONE 0.1s
#21 exporting to image
#21 exporting layers
#21 exporting layers 0.4s done
#21 writing image sha256:ad7a8706009e83a62e7b07153d43c2f0f63bdd1773a766484ef32aab884c1bb7 done
#21 naming to docker.io/apache/beam_java8_sdk:2.51.0.dev done
#21 DONE 0.4s
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch
org.apache.beam.sdk.transforms.CombineTest$WindowingTests > testCombineGloballyAsSingletonView FAILED
java.lang.RuntimeException at CombineTest.java:1359
org.apache.beam.sdk.transforms.CombineTest$WindowingTests > testWindowedCombineGloballyAsSingletonView FAILED
java.lang.RuntimeException at CombineTest.java:1402
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests > testParDoWithTaggedOutput FAILED
java.lang.RuntimeException at ParDoTest.java:723
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-4911d9af-003d-44c0-8ef3-cf9893bfcdfe
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests > testMultiOutputParDoWithSideInputsIsCumulative FAILED
java.lang.RuntimeException at ParDoTest.java:1289
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests > testSideInputAnnotationWithMultipleSideInputs FAILED
java.lang.RuntimeException at ParDoTest.java:1179
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests > testSideInputAnnotation FAILED
java.lang.RuntimeException at ParDoTest.java:1076
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests > testParDoWithEmptyTaggedOutput FAILED
java.lang.RuntimeException at ParDoTest.java:789
org.apache.beam.sdk.transforms.ParDoTest$TimestampTests > testParDoTaggedOutputWithTimestamp FAILED
java.lang.RuntimeException at ParDoTest.java:2030
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-7831c7fe-b1b9-4d13-a175-0997189345d7
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-aeac15b5-0a54-4d5c-8dab-45d317cef6f7
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-cb336ed1-1d63-48dd-a632-a87642f9dea0
[pool-732-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 13 for at least 01h57m26s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1529/68387795.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1553/1918928713.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
234 tests completed, 8 failed, 1 skipped
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch FAILED
> Task :runners:spark:3:job-server:validatesPortableRunnerDocker
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-b69fe32f-28b4-4e55-a26d-5b93aade5337
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesPortableRunnerBatch'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/runners/spark/3/job-server/build/reports/tests/validatesPortableRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 17m 49s
118 actionable tasks: 73 executed, 41 from cache, 4 up-to-date
Publishing build scan...
https://ge.apache.org/s/7weyjzefgfvpw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_PVR_Spark_Batch #2474
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/2474/display/redirect?page=changes>
Changes:
[noreply] Allow users to pass inference args into vertex ai model handler (#28354)
------------------------------------------
[...truncated 61.26 KB...]
org.apache.beam.sdk.transforms.ParDoTest$TimerTests > testPipelineOptionsParameterOnTimer FAILED
java.lang.RuntimeException at ParDoTest.java:5491
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-389136c5-f045-40d2-830c-894b408e8270
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-8cd1fc7a-f2fb-447e-92fa-2dd01c327358
[pool-894-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 3 for at least 25m25s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1631/1406441924.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1660/1367522159.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[pool-867-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 4 for at least 26m46s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1631/1406441924.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1660/1367522159.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[pool-921-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 3 for at least 24m29s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1631/1406441924.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1660/1367522159.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[pool-1110-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 3 for at least 17m19s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1631/1406441924.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1660/1367522159.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[pool-1218-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 2 for at least 12m54s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1631/1406441924.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1660/1367522159.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[pool-1056-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 3 for at least 19m42s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1631/1406441924.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1660/1367522159.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[pool-894-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 3 for at least 25m25s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1631/1406441924.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1660/1367522159.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[pool-867-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 4 for at least 26m46s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1631/1406441924.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1660/1367522159.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[pool-921-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 3 for at least 24m29s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1631/1406441924.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1660/1367522159.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[pool-1110-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 3 for at least 17m19s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1631/1406441924.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1660/1367522159.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[pool-1218-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 2 for at least 12m55s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1631/1406441924.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1660/1367522159.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[pool-1056-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 3 for at least 19m43s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1631/1406441924.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1660/1367522159.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-066f9f40-2ddc-404f-8162-bd912a4f6173
234 tests completed, 16 failed, 1 skipped
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch FAILED
> Task :runners:spark:3:job-server:validatesPortableRunnerDocker
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-ade2feed-248e-457a-9682-736e0c43a40b
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesPortableRunnerBatch'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/runners/spark/3/job-server/build/reports/tests/validatesPortableRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 31m 53s
118 actionable tasks: 73 executed, 41 from cache, 4 up-to-date
Publishing build scan...
https://ge.apache.org/s/6zpfbrznl5idi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_PVR_Spark_Batch #2473
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/2473/display/redirect>
Changes:
------------------------------------------
[...truncated 44.60 KB...]
#3 [internal] load metadata for docker.io/library/golang:1.20-bullseye
#3 DONE 0.6s
#4 [1/5] FROM docker.io/library/golang:1.20-bullseye@sha256:1f86457f5a252fc1f5dc6fcc2b1b1a1aa79d267c7ed62cdacab5c380f2859fcc
#4 DONE 0.0s
#5 [internal] load build context
#5 transferring context: 1.96kB 0.0s done
#5 DONE 0.3s
#6 [3/5] COPY go.mod ./
#6 CACHED
#7 [4/5] RUN go install github.com/google/go-licenses@latest
#7 CACHED
#8 [2/5] WORKDIR /usr/src/app
#8 CACHED
#9 [5/5] COPY get-licenses.sh /opt/apache/beam/
#9 CACHED
#10 exporting to image
#10 exporting layers done
#10 writing image sha256:ccbd8cde887eb7c6ffc0cbb40e3a4b059d53d6c51c6e53117d9a4a70819e90b5
#10 writing image sha256:ccbd8cde887eb7c6ffc0cbb40e3a4b059d53d6c51c6e53117d9a4a70819e90b5 0.1s done
#10 naming to docker.io/library/golicenses-java done
#10 DONE 0.6s
> Task :sdks:java:container:pullLicenses
Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
Successfully uninstalled setuptools-44.0.0
Successfully installed pip-23.2.1 setuptools-68.2.0 wheel-0.41.2
Collecting beautifulsoup4<5.0,>=4.9.0 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19))
Using cached beautifulsoup4-4.12.2-py3-none-any.whl (142 kB)
Collecting pyyaml<7,>=6.0.1 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 20))
Obtaining dependency information for pyyaml<7,>=6.0.1 from https://files.pythonhosted.org/packages/c8/6b/6600ac24725c7388255b2f5add93f91e58a5d7efaf4af244fdbcc11a541b/PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.1 kB)
Collecting tenacity<9.0,>=6.1.0 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 21))
Obtaining dependency information for tenacity<9.0,>=6.1.0 from https://files.pythonhosted.org/packages/f4/f1/990741d5bb2487d529d20a433210ffa136a367751e454214013b441c4575/tenacity-8.2.3-py3-none-any.whl.metadata
Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0,>=4.9.0->-r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19))
Obtaining dependency information for soupsieve>1.2 from https://files.pythonhosted.org/packages/4c/f3/038b302fdfbe3be7da016777069f26ceefe11a681055ea1f7817546508e3/soupsieve-2.5-py3-none-any.whl.metadata
Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: tenacity, soupsieve, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.12.2 pyyaml-6.0.1 soupsieve-2.5 tenacity-8.2.3
Executing python <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> --manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 126 dependencies using 16 threads.
INFO:root:Replaced local file URL with file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING> for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 1.384678 seconds with 16 threads.
Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :release:go-licenses:java:dockerRun
+ rm -rf '/output/*'
+ go get github.com/apache/beam/sdks/v2/java/container
go: downloading github.com/apache/beam/sdks/v2 v2.50.0
go: downloading github.com/apache/beam v2.50.0+incompatible
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :sdks:java:container:downloadCloudProfilerAgent
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0version.txt
NOTICES
profiler_java_agent.so
100 4183k 100 4183k 0 0 24.4M 0 --:--:-- --:--:-- --:--:-- 24.4M
> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :release:go-licenses:java:dockerRun
go: downloading github.com/golang/protobuf v1.5.3
go: downloading google.golang.org/protobuf v1.31.0
go: downloading golang.org/x/sys v0.11.0
go: downloading google.golang.org/grpc v1.57.0
go: downloading golang.org/x/net v0.14.0
go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230726155614-23370e0ffb3e
go: downloading google.golang.org/genproto v0.0.0-20230706204954-ccb25ca9f130
go: downloading golang.org/x/text v0.12.0
> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.21.0 build -o ./build/target/linux_amd64/boot boot.go boot_test.go pathingjar.go pathingjar_test.go
> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons:
- Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6.2/userguide/validation_problems.html#implicit_dependency for more details about this problem.
> Task :release:go-licenses:java:dockerRun
go: added github.com/apache/beam/sdks/v2 v2.50.0
go: added github.com/golang/protobuf v1.5.3
go: added golang.org/x/net v0.14.0
go: added golang.org/x/sys v0.11.0
go: added golang.org/x/text v0.12.0
go: added google.golang.org/genproto/googleapis/rpc v0.0.0-20230726155614-23370e0ffb3e
go: added google.golang.org/grpc v1.57.0
go: added google.golang.org/protobuf v1.31.0
+ go-licenses save github.com/apache/beam/sdks/v2/java/container --save_path=/output/licenses
W0907 10:21:07.461188 40 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.11.0/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/java/container
+ tee /output/licenses/list.csv
W0907 10:21:14.383776 82 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.11.0/unix/asm_linux_amd64.s
github.com/apache/beam/sdks/v2/go,https://github.com/apache/beam/blob/sdks/v2.50.0/sdks/go/README.md,Apache-2.0
github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.50.0/sdks/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.3/LICENSE,BSD-3-Clause
golang.org/x/net,https://cs.opensource.google/go/x/net/+/v0.14.0:LICENSE,BSD-3-Clause
golang.org/x/sys/unix,https://cs.opensource.google/go/x/sys/+/v0.11.0:LICENSE,BSD-3-Clause
golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.12.0:LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/23370e0ffb3e/googleapis/rpc/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.57.0/LICENSE,Apache-2.0
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.31.0/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
#1 [internal] load .dockerignore
#1 transferring context: 2B done
#1 ...
#2 [internal] load build definition from Dockerfile
#2 transferring dockerfile: 2.58kB done
#2 DONE 1.6s
#1 [internal] load .dockerignore
#1 DONE 2.4s
#3 [internal] load metadata for docker.io/library/eclipse-temurin:8
#3 DONE 0.6s
#4 [ 1/16] FROM docker.io/library/eclipse-temurin:8@sha256:a239363b3c5f06ce52fd2cfd50c6d092c33400ba827842e49f206c72e5a7b287
#4 CACHED
#5 [internal] load build context
#5 transferring context: 47.19MB 0.5s done
#5 DONE 1.1s
#6 [ 2/16] ADD target/slf4j-api.jar /opt/apache/beam/jars/
#6 DONE 3.5s
#7 [ 3/16] ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
#7 DONE 0.1s
#8 [ 4/16] ADD target/jcl-over-slf4j.jar /opt/apache/beam/jars/
#8 DONE 0.1s
#9 [ 5/16] ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/
#9 DONE 0.1s
#10 [ 6/16] ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/
#10 DONE 0.1s
#11 [ 7/16] ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
#11 DONE 0.1s
#12 [ 8/16] COPY target/jamm.jar target/open-module-agent*.jar /opt/apache/beam/jars/
#12 DONE 0.1s
#13 [ 9/16] COPY target/linux_amd64/boot /opt/apache/beam/
#13 DONE 0.2s
#14 [10/16] COPY target/LICENSE /opt/apache/beam/
#14 DONE 0.1s
#15 [11/16] COPY target/NOTICE /opt/apache/beam/
#15 DONE 0.1s
#16 [12/16] ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
#16 DONE 0.2s
#17 [13/16] COPY target/LICENSE target/options/* /opt/apache/beam/options/
#17 DONE 0.1s
#18 [14/16] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#18 DONE 0.1s
#19 [15/16] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#19 DONE 0.8s
#20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/
#20 DONE 0.1s
#21 exporting to image
#21 exporting layers
#21 exporting layers 0.4s done
#21 writing image sha256:0142b2ecb2f9f5738412ecd34fd5a48809c77de6d99dc9e9285db682b19e13b2 done
#21 naming to docker.io/apache/beam_java8_sdk:2.51.0.dev done
#21 DONE 0.4s
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch
org.apache.beam.sdk.transforms.CombineTest$WindowingTests > testCombineGloballyAsSingletonView FAILED
java.lang.RuntimeException at CombineTest.java:1359
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests > testMultiOutputParDoWithSideInputs FAILED
java.lang.RuntimeException at ParDoTest.java:1251
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-c498b1f7-ae45-43b1-a778-f71aa553f226
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-d775bcf9-e152-442c-94e6-52dafb81f635
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-86ef7305-e3d1-42cc-b6b6-4983273443b3
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-4774c63c-fa19-4337-91f4-f350a202e694
234 tests completed, 2 failed, 1 skipped
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch FAILED
> Task :runners:spark:3:job-server:validatesPortableRunnerDocker FROM-CACHE
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesPortableRunnerBatch'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/runners/spark/3/job-server/build/reports/tests/validatesPortableRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 37m 12s
118 actionable tasks: 72 executed, 42 from cache, 4 up-to-date
Publishing build scan...
https://ge.apache.org/s/gjzzjhhqqd25e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_PVR_Spark_Batch #2472
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/2472/display/redirect>
Changes:
------------------------------------------
[...truncated 45.21 KB...]
#9 [5/5] COPY get-licenses.sh /opt/apache/beam/
#9 CACHED
#10 exporting to image
#10 exporting layers done
#10 writing image sha256:ca3ff93ebe41989e4d411f0933c6d1863c65d2ae6615799059e7b2f3f19c0122 done
#10 naming to docker.io/library/golicenses-java done
#10 DONE 0.0s
> Task :sdks:java:container:pullLicenses
Installing collected packages: pip, setuptools, wheel
Attempting uninstall: pip
Found existing installation: pip 20.0.2
Uninstalling pip-20.0.2:
Successfully uninstalled pip-20.0.2
Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
Successfully uninstalled setuptools-44.0.0
Successfully installed pip-23.2.1 setuptools-68.2.0 wheel-0.41.2
Collecting beautifulsoup4<5.0,>=4.9.0 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19))
Using cached beautifulsoup4-4.12.2-py3-none-any.whl (142 kB)
Collecting pyyaml<7,>=6.0.1 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 20))
Obtaining dependency information for pyyaml<7,>=6.0.1 from https://files.pythonhosted.org/packages/c8/6b/6600ac24725c7388255b2f5add93f91e58a5d7efaf4af244fdbcc11a541b/PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.1 kB)
Collecting tenacity<9.0,>=6.1.0 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 21))
Obtaining dependency information for tenacity<9.0,>=6.1.0 from https://files.pythonhosted.org/packages/f4/f1/990741d5bb2487d529d20a433210ffa136a367751e454214013b441c4575/tenacity-8.2.3-py3-none-any.whl.metadata
Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0,>=4.9.0->-r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19))
Obtaining dependency information for soupsieve>1.2 from https://files.pythonhosted.org/packages/4c/f3/038b302fdfbe3be7da016777069f26ceefe11a681055ea1f7817546508e3/soupsieve-2.5-py3-none-any.whl.metadata
Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: tenacity, soupsieve, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.12.2 pyyaml-6.0.1 soupsieve-2.5 tenacity-8.2.3
Executing python <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> --manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 126 dependencies using 16 threads.
INFO:root:Replaced local file URL with file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING> for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 1.447491 seconds with 16 threads.
Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :release:go-licenses:java:dockerRun
+ rm -rf '/output/*'
+ go get github.com/apache/beam/sdks/v2/java/container
go: downloading github.com/apache/beam/sdks/v2 v2.50.0
go: downloading github.com/apache/beam v2.50.0+incompatible
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :sdks:java:container:downloadCloudProfilerAgent
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0version.txt
NOTICES
profiler_java_agent.so
100 4183k 100 4183k 0 0 22.5M 0 --:--:-- --:--:-- --:--:-- 22.4M
> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :release:go-licenses:java:dockerRun
go: downloading google.golang.org/grpc v1.57.0
go: downloading github.com/golang/protobuf v1.5.3
go: downloading google.golang.org/protobuf v1.31.0
go: downloading golang.org/x/sys v0.11.0
go: downloading golang.org/x/net v0.14.0
go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230726155614-23370e0ffb3e
go: downloading google.golang.org/genproto v0.0.0-20230706204954-ccb25ca9f130
> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.21.0 build -o ./build/target/linux_amd64/boot boot.go boot_test.go pathingjar.go pathingjar_test.go
> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons:
- Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6.2/userguide/validation_problems.html#implicit_dependency for more details about this problem.
> Task :release:go-licenses:java:dockerRun
go: downloading golang.org/x/text v0.12.0
go: added github.com/apache/beam/sdks/v2 v2.50.0
go: added github.com/golang/protobuf v1.5.3
go: added golang.org/x/net v0.14.0
go: added golang.org/x/sys v0.11.0
go: added golang.org/x/text v0.12.0
go: added google.golang.org/genproto/googleapis/rpc v0.0.0-20230726155614-23370e0ffb3e
go: added google.golang.org/grpc v1.57.0
go: added google.golang.org/protobuf v1.31.0
+ go-licenses save github.com/apache/beam/sdks/v2/java/container --save_path=/output/licenses
W0907 04:21:08.219604 36 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.11.0/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/java/container
+ tee /output/licenses/list.csv
W0907 04:21:15.088251 79 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.11.0/unix/asm_linux_amd64.s
github.com/apache/beam/sdks/v2/go,https://github.com/apache/beam/blob/sdks/v2.50.0/sdks/go/README.md,Apache-2.0
github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.50.0/sdks/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.3/LICENSE,BSD-3-Clause
golang.org/x/net,https://cs.opensource.google/go/x/net/+/v0.14.0:LICENSE,BSD-3-Clause
golang.org/x/sys/unix,https://cs.opensource.google/go/x/sys/+/v0.11.0:LICENSE,BSD-3-Clause
golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.12.0:LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/23370e0ffb3e/googleapis/rpc/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.57.0/LICENSE,Apache-2.0
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.31.0/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
#1 [internal] load .dockerignore
#1 transferring context: 2B done
#1 ...
#2 [internal] load build definition from Dockerfile
#2 transferring dockerfile: 2.58kB done
#2 DONE 2.7s
#1 [internal] load .dockerignore
#1 DONE 3.4s
#3 [internal] load metadata for docker.io/library/eclipse-temurin:8
#3 DONE 1.8s
#4 [ 1/16] FROM docker.io/library/eclipse-temurin:8@sha256:a239363b3c5f06ce52fd2cfd50c6d092c33400ba827842e49f206c72e5a7b287
#4 CACHED
#5 [internal] load build context
#5 transferring context: 12.67MB 0.1s
#5 transferring context: 47.19MB 0.4s done
#5 DONE 1.3s
#6 [ 2/16] ADD target/slf4j-api.jar /opt/apache/beam/jars/
#6 DONE 1.5s
#7 [ 3/16] ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
#7 DONE 0.2s
#8 [ 4/16] ADD target/jcl-over-slf4j.jar /opt/apache/beam/jars/
#8 DONE 0.1s
#9 [ 5/16] ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/
#9 DONE 0.1s
#10 [ 6/16] ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/
#10 DONE 0.1s
#11 [ 7/16] ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
#11 DONE 0.1s
#12 [ 8/16] COPY target/jamm.jar target/open-module-agent*.jar /opt/apache/beam/jars/
#12 DONE 0.1s
#13 [ 9/16] COPY target/linux_amd64/boot /opt/apache/beam/
#13 DONE 0.2s
#14 [10/16] COPY target/LICENSE /opt/apache/beam/
#14 DONE 0.1s
#15 [11/16] COPY target/NOTICE /opt/apache/beam/
#15 DONE 0.0s
#16 [12/16] ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
#16 DONE 0.2s
#17 [13/16] COPY target/LICENSE target/options/* /opt/apache/beam/options/
#17 DONE 0.1s
#18 [14/16] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#18 DONE 0.1s
#19 [15/16] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#19 DONE 0.7s
#20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/
#20 DONE 0.1s
#21 exporting to image
#21 exporting layers
#21 exporting layers 0.3s done
#21 writing image sha256:0c966fc335ce09bf2216aae3910bab4d547d65468dfeb555ad2a5fc37cbc51d8 done
#21 naming to docker.io/apache/beam_java8_sdk:2.51.0.dev done
#21 DONE 0.3s
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch
org.apache.beam.sdk.transforms.CombineTest$WindowingTests > testCombineGloballyAsSingletonView FAILED
java.lang.RuntimeException at CombineTest.java:1359
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-9195d990-3ba2-4428-ac12-07d1e83427e3
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-2fc1b9aa-3487-4319-a083-7eb1bfd4680d
[pool-246-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 4 for at least 22m57s without outputting or completing:
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.FnHarness$$Lambda$1667/680479818.apply(Unknown Source)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1724/125741731.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-4a1f52e9-110d-43e2-ad73-b18afb5ebfc1
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-04e06fe5-d22f-4a85-99aa-9a3b1770a8de
234 tests completed, 1 failed, 1 skipped
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch FAILED
> Task :runners:spark:3:job-server:validatesPortableRunnerDocker FROM-CACHE
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesPortableRunnerBatch'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/runners/spark/3/job-server/build/reports/tests/validatesPortableRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 38m 59s
118 actionable tasks: 72 executed, 42 from cache, 4 up-to-date
Publishing build scan...
https://ge.apache.org/s/dpm2jvcursr6q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_PVR_Spark_Batch #2471
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/2471/display/redirect>
Changes:
------------------------------------------
[...truncated 44.57 KB...]
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/golang:1.20-bullseye
#3 DONE 0.3s
#4 [1/5] FROM docker.io/library/golang:1.20-bullseye@sha256:1f86457f5a252fc1f5dc6fcc2b1b1a1aa79d267c7ed62cdacab5c380f2859fcc
#4 DONE 0.0s
#5 [internal] load build context
#5 transferring context: 1.96kB 0.0s done
#5 DONE 0.0s
#6 [3/5] COPY go.mod ./
#6 CACHED
#7 [4/5] RUN go install github.com/google/go-licenses@latest
#7 CACHED
#8 [2/5] WORKDIR /usr/src/app
#8 CACHED
#9 [5/5] COPY get-licenses.sh /opt/apache/beam/
#9 CACHED
#10 exporting to image
#10 exporting layers done
#10 writing image sha256:ccbd8cde887eb7c6ffc0cbb40e3a4b059d53d6c51c6e53117d9a4a70819e90b5 done
#10 naming to docker.io/library/golicenses-java done
#10 DONE 0.0s
> Task :sdks:java:container:pullLicenses
Uninstalling pip-20.0.2:
Successfully uninstalled pip-20.0.2
Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
Successfully uninstalled setuptools-44.0.0
Successfully installed pip-23.2.1 setuptools-68.1.2 wheel-0.41.2
Collecting beautifulsoup4<5.0,>=4.9.0 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19))
Using cached beautifulsoup4-4.12.2-py3-none-any.whl (142 kB)
Collecting pyyaml<7,>=6.0.1 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 20))
Obtaining dependency information for pyyaml<7,>=6.0.1 from https://files.pythonhosted.org/packages/c8/6b/6600ac24725c7388255b2f5add93f91e58a5d7efaf4af244fdbcc11a541b/PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.1 kB)
Collecting tenacity<9.0,>=6.1.0 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 21))
Obtaining dependency information for tenacity<9.0,>=6.1.0 from https://files.pythonhosted.org/packages/f4/f1/990741d5bb2487d529d20a433210ffa136a367751e454214013b441c4575/tenacity-8.2.3-py3-none-any.whl.metadata
Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0,>=4.9.0->-r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19))
Obtaining dependency information for soupsieve>1.2 from https://files.pythonhosted.org/packages/4c/f3/038b302fdfbe3be7da016777069f26ceefe11a681055ea1f7817546508e3/soupsieve-2.5-py3-none-any.whl.metadata
Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: tenacity, soupsieve, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.12.2 pyyaml-6.0.1 soupsieve-2.5 tenacity-8.2.3
Executing python <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> --manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 126 dependencies using 16 threads.
INFO:root:Replaced local file URL with file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING> for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 1.462645 seconds with 16 threads.
Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :release:go-licenses:java:dockerRun
+ rm -rf '/output/*'
+ go get github.com/apache/beam/sdks/v2/java/container
go: downloading github.com/apache/beam/sdks/v2 v2.50.0
go: downloading github.com/apache/beam v2.50.0+incompatible
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :sdks:java:container:downloadCloudProfilerAgent
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0version.txt
NOTICES
profiler_java_agent.so
100 4183k 100 4183k 0 0 22.4M 0 --:--:-- --:--:-- --:--:-- 22.4M
> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :release:go-licenses:java:dockerRun
go: downloading github.com/golang/protobuf v1.5.3
go: downloading google.golang.org/protobuf v1.31.0
go: downloading golang.org/x/sys v0.11.0
go: downloading google.golang.org/grpc v1.57.0
go: downloading golang.org/x/net v0.14.0
go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230726155614-23370e0ffb3e
go: downloading google.golang.org/genproto v0.0.0-20230706204954-ccb25ca9f130
go: downloading golang.org/x/text v0.12.0
> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.21.0 build -o ./build/target/linux_amd64/boot boot.go boot_test.go pathingjar.go pathingjar_test.go
> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons:
- Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6.2/userguide/validation_problems.html#implicit_dependency for more details about this problem.
> Task :release:go-licenses:java:dockerRun
go: added github.com/apache/beam/sdks/v2 v2.50.0
go: added github.com/golang/protobuf v1.5.3
go: added golang.org/x/net v0.14.0
go: added golang.org/x/sys v0.11.0
go: added golang.org/x/text v0.12.0
go: added google.golang.org/genproto/googleapis/rpc v0.0.0-20230726155614-23370e0ffb3e
go: added google.golang.org/grpc v1.57.0
go: added google.golang.org/protobuf v1.31.0
+ go-licenses save github.com/apache/beam/sdks/v2/java/container --save_path=/output/licenses
W0906 22:21:05.590128 36 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.11.0/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/java/container
+ tee /output/licenses/list.csv
W0906 22:21:12.568673 79 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.11.0/unix/asm_linux_amd64.s
github.com/apache/beam/sdks/v2/go,https://github.com/apache/beam/blob/sdks/v2.50.0/sdks/go/README.md,Apache-2.0
github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.50.0/sdks/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.3/LICENSE,BSD-3-Clause
golang.org/x/net,https://cs.opensource.google/go/x/net/+/v0.14.0:LICENSE,BSD-3-Clause
golang.org/x/sys/unix,https://cs.opensource.google/go/x/sys/+/v0.11.0:LICENSE,BSD-3-Clause
golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.12.0:LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/23370e0ffb3e/googleapis/rpc/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.57.0/LICENSE,Apache-2.0
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.31.0/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 2.58kB done
#1 DONE 0.0s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/eclipse-temurin:8
#3 DONE 0.3s
#4 [ 1/16] FROM docker.io/library/eclipse-temurin:8@sha256:a239363b3c5f06ce52fd2cfd50c6d092c33400ba827842e49f206c72e5a7b287
#4 CACHED
#5 [internal] load build context
#5 transferring context: 47.19MB 0.5s done
#5 DONE 0.5s
#6 [ 2/16] ADD target/slf4j-api.jar /opt/apache/beam/jars/
#6 DONE 10.6s
#7 [ 3/16] ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
#7 DONE 12.9s
#8 [ 4/16] ADD target/jcl-over-slf4j.jar /opt/apache/beam/jars/
#8 DONE 1.6s
#9 [ 5/16] ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/
#9 DONE 2.2s
#10 [ 6/16] ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/
#10 DONE 0.1s
#11 [ 7/16] ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
#11 DONE 0.1s
#12 [ 8/16] COPY target/jamm.jar target/open-module-agent*.jar /opt/apache/beam/jars/
#12 DONE 0.1s
#13 [ 9/16] COPY target/linux_amd64/boot /opt/apache/beam/
#13 DONE 0.2s
#14 [10/16] COPY target/LICENSE /opt/apache/beam/
#14 DONE 0.1s
#15 [11/16] COPY target/NOTICE /opt/apache/beam/
#15 DONE 0.1s
#16 [12/16] ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
#16 DONE 0.2s
#17 [13/16] COPY target/LICENSE target/options/* /opt/apache/beam/options/
#17 DONE 0.1s
#18 [14/16] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#18 DONE 0.1s
#19 [15/16] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#19 DONE 0.6s
#20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/
#20 DONE 0.1s
#21 exporting to image
#21 exporting layers
#21 exporting layers 0.4s done
#21 writing image sha256:6e16f7e5d63c3d1b2261c0ca6e09a5b9e7c5f6f64c6418e54541936c7e95f15f done
#21 naming to docker.io/apache/beam_java8_sdk:2.51.0.dev done
#21 DONE 0.4s
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch
org.apache.beam.sdk.transforms.CombineTest$WindowingTests > testCombineGloballyAsSingletonView FAILED
java.lang.RuntimeException at CombineTest.java:1359
org.apache.beam.sdk.transforms.CombineTest$WindowingTests > testSlidingWindowsCombine FAILED
java.lang.RuntimeException at CombineTest.java:1164
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-3b0825fa-9fe5-42b3-90b2-f12af04e664f
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-e9998d77-8757-4034-badc-8de11883cb9b
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-586b4b07-36e8-4ee0-95c6-7edd1cd0d173
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-cf70fb71-67d3-446c-957e-c42841056677
234 tests completed, 2 failed, 1 skipped
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch FAILED
> Task :runners:spark:3:job-server:validatesPortableRunnerDocker FROM-CACHE
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesPortableRunnerBatch'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/runners/spark/3/job-server/build/reports/tests/validatesPortableRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 38m 16s
118 actionable tasks: 72 executed, 42 from cache, 4 up-to-date
Publishing build scan...
https://ge.apache.org/s/3saa44iocajkq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org