You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/12/24 18:57:26 UTC
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4317
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4317/display/redirect>
Changes:
------------------------------------------
[...truncated 255.15 KB...]
Build cache key for task ':runners:direct-java:compileTestJava' is abf1ddae0b149097fc850a5341a1622b
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key abf1ddae0b149097fc850a5341a1622b
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.146 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':',5,main]) completed. Took 1.199 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is de23ded9c61f4037e001e29dd867f1a4
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key de23ded9c61f4037e001e29dd867f1a4
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':',5,main]) completed. Took 0.065 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is 231c2bbe14ddc3602ff8d7abb73dbcb9
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key 231c2bbe14ddc3602ff8d7abb73dbcb9
:sdks:java:io:google-cloud-platform:compileJava (Thread[Daemon ****,5,main]) completed. Took 0.718 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Daemon ****,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 4dd5c93c47da3663ada749342e198cef
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 4dd5c93c47da3663ada749342e198cef
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.347 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 30d1af0efe54fc96c457b980127a12ae
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 30d1af0efe54fc96c457b980127a12ae
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.25 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':',5,main]) completed. Took 0.066 secs.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Daemon ****,5,main]) completed. Took 0.352 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Daemon ****,5,main]) started.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is bb879aecd8394f3534c93abe227d10b0
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key bb879aecd8394f3534c93abe227d10b0
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.287 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is ab4be1a19fe16e0bfae9418c2c3dc234
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key ab4be1a19fe16e0bfae9418c2c3dc234
:runners:google-cloud-dataflow-java:compileJava (Thread[Daemon ****,5,main]) completed. Took 0.214 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.084 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c983570ab9933d4de22e22eacddbcf6c
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c983570ab9933d4de22e22eacddbcf6c
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.476 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87d6bff36f2dc0ca75da68bda9290362
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87d6bff36f2dc0ca75da68bda9290362
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.396 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.266 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9f32834befae7f2be107dcc7479c8976
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9f32834befae7f2be107dcc7479c8976
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.227 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.045 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9cd95100921ed478bf26b1f1c7e68892
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9cd95100921ed478bf26b1f1c7e68892
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.356 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 3,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 156e54fc22f98a3e6513b5b74c9aaf3c
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:35.225.136.66:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://35.225.136.66:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.018 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.024 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 3.254 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 31s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5lmb7omvxd5zk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4362
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4362/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4361
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4361/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #16404: [BEAM-13586] Fix NPE in
[noreply] [BEAM-13480] Sickbay PubSubIntegrationTest.test_streaming_data_only on
------------------------------------------
[...truncated 255.81 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is c8f5e44d75681b86711d0255986d45e6
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key c8f5e44d75681b86711d0255986d45e6
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.481 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 9c3ac6cb8b174ad9e48fca8ca0217ba1
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.128 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':',5,main]) completed. Took 1.288 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':',5,main]) completed. Took 0.014 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.216 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.074 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.063 secs.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is e4f179f062de06aec9f18c0b3a9019fa
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key e4f179f062de06aec9f18c0b3a9019fa
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.249 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.195 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.062 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.272 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.398 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.308 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 00953e3d98a0217e2ef2170f8103984a
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 00953e3d98a0217e2ef2170f8103984a
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.154 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.252 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.19 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.03 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 9,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 6f445a1a8316cb13a67e5f2cef7c3ae4
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:35.232.206.200:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://35.232.206.200:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.016 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.021 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 3.399 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 27s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/iq6udzi6tkwvs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4360
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4360/display/redirect>
Changes:
------------------------------------------
[...truncated 256.04 KB...]
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:direct-java:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:direct-java:shadowJar'.
Build cache key for task ':runners:direct-java:shadowJar' is 5ab68a2bd01d2fd609a2bd6525b31ce1
Task ':runners:direct-java:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowJar' with cache key 5ab68a2bd01d2fd609a2bd6525b31ce1
:runners:direct-java:shadowJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.333 secs.
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 9c3ac6cb8b174ad9e48fca8ca0217ba1
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.139 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.224 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 1.353 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.015 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is e4f179f062de06aec9f18c0b3a9019fa
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key e4f179f062de06aec9f18c0b3a9019fa
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.221 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.1 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.211 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.086 secs.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.063 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) started.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.26 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.391 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.429 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 00953e3d98a0217e2ef2170f8103984a
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 00953e3d98a0217e2ef2170f8103984a
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.178 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.263 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.208 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.032 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 5,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 6f445a1a8316cb13a67e5f2cef7c3ae4
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:35.223.90.241:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://35.223.90.241:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.02 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.024 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 3.704 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 30s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ayllu4daeugpy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4359
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4359/display/redirect>
Changes:
------------------------------------------
[...truncated 255.92 KB...]
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:direct-java:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:direct-java:shadowJar'.
Build cache key for task ':runners:direct-java:shadowJar' is 5ab68a2bd01d2fd609a2bd6525b31ce1
Task ':runners:direct-java:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowJar' with cache key 5ab68a2bd01d2fd609a2bd6525b31ce1
:runners:direct-java:shadowJar (Thread[Execution **** for ':',5,main]) completed. Took 0.42 secs.
:runners:direct-java:compileTestJava (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Daemon ****,5,main]) completed. Took 1.532 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.022 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.111 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 9c3ac6cb8b174ad9e48fca8ca0217ba1
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.19 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.086 secs.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.276 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is e4f179f062de06aec9f18c0b3a9019fa
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key e4f179f062de06aec9f18c0b3a9019fa
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':',5,main]) completed. Took 0.245 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':',5,main]) started.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.223 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.076 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.303 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.459 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.399 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 00953e3d98a0217e2ef2170f8103984a
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 00953e3d98a0217e2ef2170f8103984a
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.175 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':',5,main]) completed. Took 0.268 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.286 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':',5,main]) completed. Took 0.034 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':',5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 6f445a1a8316cb13a67e5f2cef7c3ae4
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.121.98.243:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.121.98.243:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.018 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.026 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':',5,main]) completed. Took 3.744 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 34s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/s4ovbsa3ntzui
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4358
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4358/display/redirect>
Changes:
------------------------------------------
[...truncated 255.37 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is c8f5e44d75681b86711d0255986d45e6
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key c8f5e44d75681b86711d0255986d45e6
:sdks:java:io:google-cloud-platform:compileJava (Thread[Daemon ****,5,main]) completed. Took 0.564 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Daemon ****,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 9c3ac6cb8b174ad9e48fca8ca0217ba1
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.136 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 1.338 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.021 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Daemon ****,5,main]) completed. Took 0.257 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.11 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is e4f179f062de06aec9f18c0b3a9019fa
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key e4f179f062de06aec9f18c0b3a9019fa
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.251 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.078 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Daemon ****,5,main]) completed. Took 0.213 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Daemon ****,5,main]) completed. Took 0.067 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.342 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.431 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Daemon ****,5,main]) completed. Took 0.372 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 00953e3d98a0217e2ef2170f8103984a
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 00953e3d98a0217e2ef2170f8103984a
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Daemon ****,5,main]) completed. Took 0.164 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.262 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.241 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.033 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 7,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 6f445a1a8316cb13a67e5f2cef7c3ae4
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.122.136.179:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.122.136.179:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.021 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.028 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 3.775 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 30s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/i6fdeuvgczpvo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4357
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4357/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13509] Stop sharing SQS client between readers of same source.
[mmack] [BEAM-13587] Attempt to load AWS region from default provider chain in
------------------------------------------
[...truncated 255.21 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is c8f5e44d75681b86711d0255986d45e6
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key c8f5e44d75681b86711d0255986d45e6
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.524 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 9c3ac6cb8b174ad9e48fca8ca0217ba1
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.126 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 1.388 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.016 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.231 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.097 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is e4f179f062de06aec9f18c0b3a9019fa
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key e4f179f062de06aec9f18c0b3a9019fa
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.231 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.068 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.239 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.078 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.286 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.469 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.378 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.261 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 00953e3d98a0217e2ef2170f8103984a
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 00953e3d98a0217e2ef2170f8103984a
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Daemon ****,5,main]) completed. Took 0.188 secs.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.227 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.033 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 7,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 6f445a1a8316cb13a67e5f2cef7c3ae4
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.122.136.179:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.122.136.179:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.017 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.029 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 3.689 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 33s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/e4evpvxgp5ycs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4356
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4356/display/redirect>
Changes:
------------------------------------------
[...truncated 255.52 KB...]
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key c8f5e44d75681b86711d0255986d45e6
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.664 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 9c3ac6cb8b174ad9e48fca8ca0217ba1
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.175 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.25 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 1.39 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.021 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is e4f179f062de06aec9f18c0b3a9019fa
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key e4f179f062de06aec9f18c0b3a9019fa
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.232 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.129 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.249 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.077 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.09 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.325 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.451 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.576 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 00953e3d98a0217e2ef2170f8103984a
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 00953e3d98a0217e2ef2170f8103984a
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.185 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.274 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.244 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.035 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 9,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 6f445a1a8316cb13a67e5f2cef7c3ae4
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:35.194.0.192:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://35.194.0.192:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.018 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.026 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 4.308 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 32s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/w4645qnv7yqw6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4355
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4355/display/redirect>
Changes:
------------------------------------------
[...truncated 256.64 KB...]
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key c8f5e44d75681b86711d0255986d45e6
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.835 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 9c3ac6cb8b174ad9e48fca8ca0217ba1
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.176 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.324 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is e4f179f062de06aec9f18c0b3a9019fa
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key e4f179f062de06aec9f18c0b3a9019fa
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.282 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 1.597 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.033 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.272 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.15 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.078 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.36 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.088 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.453 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.572 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 00953e3d98a0217e2ef2170f8103984a
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 00953e3d98a0217e2ef2170f8103984a
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.231 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.284 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.26 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.033 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 6f445a1a8316cb13a67e5f2cef7c3ae4
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:35.225.121.145:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://35.225.121.145:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.018 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.028 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 5.668 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 41s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7mfllsqb2oyru
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4354
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4354/display/redirect>
Changes:
------------------------------------------
[...truncated 255.82 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is c8f5e44d75681b86711d0255986d45e6
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key c8f5e44d75681b86711d0255986d45e6
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.803 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 9c3ac6cb8b174ad9e48fca8ca0217ba1
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.17 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.267 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Daemon ****,5,main]) completed. Took 1.579 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Daemon ****,5,main]) completed. Took 0.021 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Daemon ****,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is e4f179f062de06aec9f18c0b3a9019fa
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key e4f179f062de06aec9f18c0b3a9019fa
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':',5,main]) completed. Took 0.245 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Daemon ****,5,main]) completed. Took 0.098 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.235 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Daemon ****,5,main]) completed. Took 0.095 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.088 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.349 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.426 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Daemon ****,5,main]) completed. Took 0.517 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 00953e3d98a0217e2ef2170f8103984a
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 00953e3d98a0217e2ef2170f8103984a
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.168 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Daemon ****,5,main]) completed. Took 0.264 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Daemon ****,5,main]) completed. Took 0.222 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Daemon ****,5,main]) completed. Took 0.038 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Daemon ****,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 6f445a1a8316cb13a67e5f2cef7c3ae4
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:35.193.42.108:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://35.193.42.108:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.027 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.025 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Daemon ****,5,main]) completed. Took 3.938 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 32s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ukailun3wgv2m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4353
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4353/display/redirect>
Changes:
------------------------------------------
[...truncated 256.49 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is c8f5e44d75681b86711d0255986d45e6
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key c8f5e44d75681b86711d0255986d45e6
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':',5,main]) completed. Took 0.642 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':',5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 9c3ac6cb8b174ad9e48fca8ca0217ba1
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.16 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Daemon ****,5,main]) completed. Took 1.405 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':',5,main]) completed. Took 0.239 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Daemon ****,5,main]) completed. Took 0.023 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Daemon ****,5,main]) completed. Took 0.088 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Daemon ****,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is e4f179f062de06aec9f18c0b3a9019fa
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key e4f179f062de06aec9f18c0b3a9019fa
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.245 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Daemon ****,5,main]) completed. Took 0.092 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':',5,main]) completed. Took 0.235 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':',5,main]) completed. Took 0.088 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.287 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Daemon ****,5,main]) completed. Took 0.515 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':',5,main]) completed. Took 0.407 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 00953e3d98a0217e2ef2170f8103984a
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 00953e3d98a0217e2ef2170f8103984a
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':',5,main]) completed. Took 0.169 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Daemon ****,5,main]) completed. Took 0.287 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Daemon ****,5,main]) completed. Took 0.231 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Daemon ****,5,main]) completed. Took 0.032 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Daemon ****,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 6f445a1a8316cb13a67e5f2cef7c3ae4
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.121.16.45:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.121.16.45:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.019 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.026 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Daemon ****,5,main]) completed. Took 3.845 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 34s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/crjuofb36smsq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4352
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4352/display/redirect>
Changes:
------------------------------------------
[...truncated 267.00 KB...]
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key c8f5e44d75681b86711d0255986d45e6
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':',5,main]) completed. Took 0.557 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':',5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 9c3ac6cb8b174ad9e48fca8ca0217ba1
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.177 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':',5,main]) completed. Took 0.305 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':',5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is e4f179f062de06aec9f18c0b3a9019fa
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key e4f179f062de06aec9f18c0b3a9019fa
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.348 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':',5,main]) completed. Took 0.237 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 1.427 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.02 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':',5,main]) completed. Took 0.103 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.114 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.076 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.335 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':',5,main]) completed. Took 0.464 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 00953e3d98a0217e2ef2170f8103984a
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 00953e3d98a0217e2ef2170f8103984a
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':',5,main]) completed. Took 0.175 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.478 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.264 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.281 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.038 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 6,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 6f445a1a8316cb13a67e5f2cef7c3ae4
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:130.211.125.84:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://130.211.125.84:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.025 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.037 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 4.811 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 35s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/s4n3ml4o2wfqc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4351
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4351/display/redirect>
Changes:
------------------------------------------
[...truncated 254.86 KB...]
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:direct-java:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:direct-java:shadowJar'.
Build cache key for task ':runners:direct-java:shadowJar' is 5ab68a2bd01d2fd609a2bd6525b31ce1
Task ':runners:direct-java:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowJar' with cache key 5ab68a2bd01d2fd609a2bd6525b31ce1
:runners:direct-java:shadowJar (Thread[Daemon ****,5,main]) completed. Took 0.349 secs.
:runners:direct-java:compileTestJava (Thread[Daemon ****,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 9c3ac6cb8b174ad9e48fca8ca0217ba1
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Daemon ****,5,main]) completed. Took 0.145 secs.
:runners:direct-java:testClasses (Thread[Daemon ****,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.312 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 1.406 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.019 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is e4f179f062de06aec9f18c0b3a9019fa
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key e4f179f062de06aec9f18c0b3a9019fa
:runners:direct-java:shadowTestJar (Thread[Daemon ****,5,main]) completed. Took 0.259 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.102 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.215 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.079 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.096 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Daemon ****,5,main]) completed. Took 0.267 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.382 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.448 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 00953e3d98a0217e2ef2170f8103984a
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 00953e3d98a0217e2ef2170f8103984a
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.159 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.262 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.197 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.031 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 3,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 6f445a1a8316cb13a67e5f2cef7c3ae4
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.135.103.105:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.135.103.105:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.016 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.023 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 3.909 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 31s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/z4uexui5sw6lo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4350
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4350/display/redirect>
Changes:
------------------------------------------
[...truncated 255.57 KB...]
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:direct-java:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:direct-java:shadowJar'.
Build cache key for task ':runners:direct-java:shadowJar' is 5ab68a2bd01d2fd609a2bd6525b31ce1
Task ':runners:direct-java:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowJar' with cache key 5ab68a2bd01d2fd609a2bd6525b31ce1
:runners:direct-java:shadowJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.369 secs.
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 1.303 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.017 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 9c3ac6cb8b174ad9e48fca8ca0217ba1
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.12 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.232 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.109 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.07 secs.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.179 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is e4f179f062de06aec9f18c0b3a9019fa
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key e4f179f062de06aec9f18c0b3a9019fa
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.242 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) started.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.089 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.253 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.389 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.349 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 00953e3d98a0217e2ef2170f8103984a
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 00953e3d98a0217e2ef2170f8103984a
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.155 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.261 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.218 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.031 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 11,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 6f445a1a8316cb13a67e5f2cef7c3ae4
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.122.32.138:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.122.32.138:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.018 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.022 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 3.454 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 31s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/q2ld4rql4l3my
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4349
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4349/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13498, BEAM-13522] Sickbay broken test and test category for Spark
------------------------------------------
[...truncated 255.77 KB...]
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key c8f5e44d75681b86711d0255986d45e6
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.635 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Daemon ****,5,main]) completed. Took 1.34 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Daemon ****,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 9c3ac6cb8b174ad9e48fca8ca0217ba1
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.112 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Daemon ****,5,main]) completed. Took 0.079 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Daemon ****,5,main]) completed. Took 0.073 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.232 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Daemon ****,5,main]) completed. Took 0.064 secs.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is e4f179f062de06aec9f18c0b3a9019fa
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key e4f179f062de06aec9f18c0b3a9019fa
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.346 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) started.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.302 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.068 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Daemon ****,5,main]) completed. Took 0.3 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.456 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.424 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.274 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.224 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 00953e3d98a0217e2ef2170f8103984a
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 00953e3d98a0217e2ef2170f8103984a
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.362 secs.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.031 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 5,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 6f445a1a8316cb13a67e5f2cef7c3ae4
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.135.189.65:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.135.189.65:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.016 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.022 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 4.712 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 35s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/525frshpnbvxy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4348
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4348/display/redirect>
Changes:
------------------------------------------
[...truncated 255.14 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is c8f5e44d75681b86711d0255986d45e6
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key c8f5e44d75681b86711d0255986d45e6
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.491 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 9c3ac6cb8b174ad9e48fca8ca0217ba1
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.291 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 1.396 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.375 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.021 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.08 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is e4f179f062de06aec9f18c0b3a9019fa
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key e4f179f062de06aec9f18c0b3a9019fa
:runners:direct-java:shadowTestJar (Thread[Daemon ****,5,main]) completed. Took 0.238 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.064 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.195 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.072 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Daemon ****,5,main]) completed. Took 0.313 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.495 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.417 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 00953e3d98a0217e2ef2170f8103984a
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 00953e3d98a0217e2ef2170f8103984a
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.182 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.268 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.257 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.042 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 4,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 6f445a1a8316cb13a67e5f2cef7c3ae4
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.133.190.163:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.133.190.163:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.018 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.026 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 3.847 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 31s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/le6xg3ndclujw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4347
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4347/display/redirect>
Changes:
------------------------------------------
[...truncated 256.91 KB...]
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.156 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is c8f5e44d75681b86711d0255986d45e6
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key c8f5e44d75681b86711d0255986d45e6
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.645 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.352 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is e4f179f062de06aec9f18c0b3a9019fa
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key e4f179f062de06aec9f18c0b3a9019fa
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.479 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.262 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.07 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.26 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 2.095 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.061 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.107 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.078 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.419 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 00953e3d98a0217e2ef2170f8103984a
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 00953e3d98a0217e2ef2170f8103984a
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.297 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.51 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.271 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.249 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.033 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 6f445a1a8316cb13a67e5f2cef7c3ae4
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.121.197.11:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.121.197.11:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.019 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.028 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 9.207 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 46s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/75b3f7jwtntwq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4346
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4346/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13541] Fix spotbugs issue with DLS in tail (#16407)
[noreply] [BEAM-13588] Add missing module for PVR tests and also sickbay known
[noreply] [BEAM-13575] Sickbay test that is flaky to restore precommit test signal
[noreply] [BEAM-12092] Bump jedis to version 3.8.0 (#16403)
------------------------------------------
[...truncated 255.77 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is c8f5e44d75681b86711d0255986d45e6
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key c8f5e44d75681b86711d0255986d45e6
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.66 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 9c3ac6cb8b174ad9e48fca8ca0217ba1
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.145 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.264 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 1.441 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is e4f179f062de06aec9f18c0b3a9019fa
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key e4f179f062de06aec9f18c0b3a9019fa
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.236 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.025 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.106 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.267 secs.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.067 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.273 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.094 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.437 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.354 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 00953e3d98a0217e2ef2170f8103984a
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 00953e3d98a0217e2ef2170f8103984a
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.177 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.27 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.26 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.034 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 3,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 6f445a1a8316cb13a67e5f2cef7c3ae4
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.134.45.148:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.134.45.148:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.018 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.026 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 3.945 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 37s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/aofnrd3uwibnc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4345
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4345/display/redirect>
Changes:
------------------------------------------
[...truncated 255.62 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is c8f5e44d75681b86711d0255986d45e6
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key c8f5e44d75681b86711d0255986d45e6
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.435 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 9c3ac6cb8b174ad9e48fca8ca0217ba1
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.159 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 1.206 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.274 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.02 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.118 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 30c7fdeec2725e1cd47ac45e6f631784
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 30c7fdeec2725e1cd47ac45e6f631784
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.277 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.198 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.094 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.075 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.477 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.565 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.615 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 0dca5a833b2f0a0539a425adec74269b
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 0dca5a833b2f0a0539a425adec74269b
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.18 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.276 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.243 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.033 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 11,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 356b746178d265f467bfc9f90f5f0208
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.70.162.216:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.70.162.216:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.017 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.024 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 3.838 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 31s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ot7wc432cbw5q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4344
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4344/display/redirect?page=changes>
Changes:
[stranniknm] [BEAM-13555] playground - quick fix for safari
[noreply] Merge pull request #15769 from [BEAM-13031] [Playground] Code editor -
------------------------------------------
[...truncated 257.56 KB...]
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key c8f5e44d75681b86711d0255986d45e6
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.486 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 9c3ac6cb8b174ad9e48fca8ca0217ba1
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.368 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.447 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 1.379 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.025 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 30c7fdeec2725e1cd47ac45e6f631784
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 30c7fdeec2725e1cd47ac45e6f631784
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.259 secs.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.122 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) started.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.197 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.094 secs.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.067 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.288 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.396 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.403 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 0dca5a833b2f0a0539a425adec74269b
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 0dca5a833b2f0a0539a425adec74269b
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.208 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.271 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.216 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.032 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 8,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 356b746178d265f467bfc9f90f5f0208
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:104.154.99.118:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://104.154.99.118:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.017 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.024 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 4.657 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 32s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/uvxrqzm7abrcy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4343
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4343/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13484][Playground] Improve Terraform Scripts For Deploy
[noreply] [BEAM-13541] More intelligent caching of CoGBK values. (#16354)
------------------------------------------
[...truncated 256.25 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is c8f5e44d75681b86711d0255986d45e6
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key c8f5e44d75681b86711d0255986d45e6
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.581 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 1.433 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 9c3ac6cb8b174ad9e48fca8ca0217ba1
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 9c3ac6cb8b174ad9e48fca8ca0217ba1
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.185 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 6476c0380e4bf415b14dfe0499ef5ac3
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 6476c0380e4bf415b14dfe0499ef5ac3
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.021 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 15f9886d17e568d813592e9a4d4ea3fd
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 15f9886d17e568d813592e9a4d4ea3fd
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.097 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.304 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.083 secs.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 30c7fdeec2725e1cd47ac45e6f631784
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 30c7fdeec2725e1cd47ac45e6f631784
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.307 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 22ff03d348958905b83627eaa447cbea
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 22ff03d348958905b83627eaa447cbea
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.243 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.083 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8559ffb4fe3a196bc12779191a407053
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8559ffb4fe3a196bc12779191a407053
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.316 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is decdc9a2578486f2a9d5ecae81c92a50
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key decdc9a2578486f2a9d5ecae81c92a50
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.417 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 76dc134c06de3b1efa5ebbe0ad3a4ef2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 76dc134c06de3b1efa5ebbe0ad3a4ef2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.589 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 0dca5a833b2f0a0539a425adec74269b
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 0dca5a833b2f0a0539a425adec74269b
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.166 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':',5,main]) completed. Took 0.275 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c10453ec727d56fcf83e87918a36bc81
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key c10453ec727d56fcf83e87918a36bc81
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.287 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':',5,main]) completed. Took 0.036 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':',5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 356b746178d265f467bfc9f90f5f0208
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.133.55.87:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.133.55.87:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.02 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.029 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':',5,main]) completed. Took 4.361 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 34s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/iklhv7gm6qxre
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4342
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4342/display/redirect?page=changes>
Changes:
[zyichi] Fix class not found in perf integration tests.
[noreply] Update
[noreply] [BEAM-13430] Re-enable dependency analysis for modules. (#16395)
------------------------------------------
[...truncated 260.42 KB...]
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is e44544a501ca99d5c08dfd70f3ce1b3c
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key e44544a501ca99d5c08dfd70f3ce1b3c
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.101 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.382 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.066 secs.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 39ec3fc6a0f0ce25b267ff9a4c901a26
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 39ec3fc6a0f0ce25b267ff9a4c901a26
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.264 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 9fea23e99184a4a8fc597688a5c32183
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 9fea23e99184a4a8fc597688a5c32183
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.266 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.086 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 8e34db58e0cd6d8a188765bf11a33915
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 8e34db58e0cd6d8a188765bf11a33915
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.335 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is d1bcb946269e364396df377f377aea5d
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key d1bcb946269e364396df377f377aea5d
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.557 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is e929226cb859aa13a32c41dc9dfeebd5
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key e929226cb859aa13a32c41dc9dfeebd5
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.456 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.263 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 3114519f699ffb48c249ef7755f49fe8
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 3114519f699ffb48c249ef7755f49fe8
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.177 secs.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is b7ee5fe6a9ee8ea0a937f286050af99d
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key b7ee5fe6a9ee8ea0a937f286050af99d
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.241 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.036 secs.
> Task :sdks:java:io:hadoop-file-system:compileJava
Class dependency analysis for incremental compilation took 0.586 secs.
Created classpath snapshot for incremental compilation in 0.276 secs.
Stored cache entry for task ':sdks:java:io:hadoop-file-system:compileJava' with cache key 94185198f0a6b4e359824dd7c0f4abb6
:sdks:java:io:hadoop-file-system:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 6.077 secs.
:sdks:java:io:hadoop-file-system:classes (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:hadoop-file-system:classes
Skipping task ':sdks:java:io:hadoop-file-system:classes' as it has no actions.
:sdks:java:io:hadoop-file-system:classes (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:sdks:java:io:hadoop-file-system:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:hadoop-file-system:compileTestJava
Custom actions are attached to task ':sdks:java:io:hadoop-file-system:compileTestJava'.
Build cache key for task ':sdks:java:io:hadoop-file-system:compileTestJava' is 18cdd59d3b4682fb266ceaa7e03126b8
Task ':sdks:java:io:hadoop-file-system:compileTestJava' is not up-to-date because:
No history is available.
The input changes require a full rebuild for incremental task ':sdks:java:io:hadoop-file-system:compileTestJava'.
Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments.
Compiling with toolchain '/usr/lib/jvm/java-8-openjdk-amd64'.
Compiling with JDK Java compiler API.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Class dependency analysis for incremental compilation took 0.002 secs.
Created classpath snapshot for incremental compilation in 0.151 secs.
Stored cache entry for task ':sdks:java:io:hadoop-file-system:compileTestJava' with cache key 18cdd59d3b4682fb266ceaa7e03126b8
:sdks:java:io:hadoop-file-system:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 2.663 secs.
:sdks:java:io:hadoop-file-system:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:hadoop-file-system:testClasses
Skipping task ':sdks:java:io:hadoop-file-system:testClasses' as it has no actions.
:sdks:java:io:hadoop-file-system:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:sdks:java:io:hadoop-file-system:testJar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:hadoop-file-system:testJar
Caching disabled for task ':sdks:java:io:hadoop-file-system:testJar' because:
Not worth caching
Task ':sdks:java:io:hadoop-file-system:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/hadoop-file-system/build/resources/test',> not found
:sdks:java:io:hadoop-file-system:testJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.007 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 2,5,main]) started.
Gradle Test Executor 2 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 3e9347b1f9a8b37977cee020d3054633
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 2'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.122.27.70:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.122.27.70:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 2'
Successfully started process 'Gradle Test Executor 2'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 2 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'hdfsConfiguration'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.015 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.02 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 3.186 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 31s
117 actionable tasks: 59 executed, 56 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ggf523icb5qhi
Stopped 1 **** daemon(s).
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4341
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4341/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13009] Fix tests to ensure absence of duplicates only per request
[mmack] [adhoc] Use predefined min/max combiners in SQS reader to gather stats
[noreply] [BEAM-13430] Fix class not found error for example integration tests and
------------------------------------------
[...truncated 290.50 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is c6c5ca8c5df52993f82ba3c25ab396fc
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key c6c5ca8c5df52993f82ba3c25ab396fc
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.469 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 1.305 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is d68bd58b889018deeb89993ccd734358
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key d68bd58b889018deeb89993ccd734358
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.152 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is b554a0897b67c5d6e97e4d0c18b42b7c
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key b554a0897b67c5d6e97e4d0c18b42b7c
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.015 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 868156cca177cbc06c03a356768cd4ca
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 868156cca177cbc06c03a356768cd4ca
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.103 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.294 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.073 secs.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 5db3beb26c00979882e5056107ff43d5
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 5db3beb26c00979882e5056107ff43d5
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.234 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is b45a0daa8df856dd573d3a2bfb4252f0
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key b45a0daa8df856dd573d3a2bfb4252f0
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.23 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.068 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 28c2fd959821ef1041c29d987a23dda5
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 28c2fd959821ef1041c29d987a23dda5
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Daemon ****,5,main]) completed. Took 0.269 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 0ba4f0494a0bb8d5a1543ca3c11bf52a
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 0ba4f0494a0bb8d5a1543ca3c11bf52a
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.402 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 507995e7fb0c1cc1a31d2a6ccee8fc57
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 507995e7fb0c1cc1a31d2a6ccee8fc57
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.415 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.312 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9e33711828ee9e73a7b5cbf3e321c9d1
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9e33711828ee9e73a7b5cbf3e321c9d1
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.17 secs.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is ac6bf85b0940ba0584c8e5a1c700077f
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key ac6bf85b0940ba0584c8e5a1c700077f
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.202 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Daemon ****,5,main]) completed. Took 0.086 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Daemon ****,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is c7c8346f28f1ed20ce0917359017defd
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.72.195.56:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.72.195.56:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.37.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.37.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.017 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.025 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Daemon ****,5,main]) completed. Took 3.27 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 32s
144 actionable tasks: 84 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/6ku2kbejg5uiq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4340
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4340/display/redirect>
Changes:
------------------------------------------
[...truncated 289.09 KB...]
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:direct-java:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:direct-java:shadowJar'.
Build cache key for task ':runners:direct-java:shadowJar' is 98bdde6864c7d9b242f54f76e49b271f
Task ':runners:direct-java:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowJar' with cache key 98bdde6864c7d9b242f54f76e49b271f
:runners:direct-java:shadowJar (Thread[Execution **** for ':',5,main]) completed. Took 0.392 secs.
:runners:direct-java:compileTestJava (Thread[Execution **** for ':',5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is d68bd58b889018deeb89993ccd734358
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key d68bd58b889018deeb89993ccd734358
:runners:direct-java:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.123 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.256 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 1.249 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is b554a0897b67c5d6e97e4d0c18b42b7c
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key b554a0897b67c5d6e97e4d0c18b42b7c
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.014 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 868156cca177cbc06c03a356768cd4ca
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 868156cca177cbc06c03a356768cd4ca
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.08 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 5db3beb26c00979882e5056107ff43d5
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 5db3beb26c00979882e5056107ff43d5
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':',5,main]) completed. Took 0.219 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is b45a0daa8df856dd573d3a2bfb4252f0
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key b45a0daa8df856dd573d3a2bfb4252f0
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.22 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.07 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 6,5,main]) started.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.095 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 28c2fd959821ef1041c29d987a23dda5
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 28c2fd959821ef1041c29d987a23dda5
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.32 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 0ba4f0494a0bb8d5a1543ca3c11bf52a
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 0ba4f0494a0bb8d5a1543ca3c11bf52a
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.461 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 507995e7fb0c1cc1a31d2a6ccee8fc57
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 507995e7fb0c1cc1a31d2a6ccee8fc57
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.415 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9e33711828ee9e73a7b5cbf3e321c9d1
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9e33711828ee9e73a7b5cbf3e321c9d1
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.181 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.258 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is ac6bf85b0940ba0584c8e5a1c700077f
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key ac6bf85b0940ba0584c8e5a1c700077f
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.197 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.03 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is c7c8346f28f1ed20ce0917359017defd
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.71.137.74:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.71.137.74:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.37.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
Gradle Test Executor 1 started executing tests.
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.37.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.017 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.022 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 4.012 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 29s
144 actionable tasks: 84 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/whewndzxcczw6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4339
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4339/display/redirect?page=changes>
Changes:
[emilyye] Moving to 2.37.0-SNAPSHOT on master branch.
[noreply] Release website update for Beam 2.35.0 (#16115)
[noreply] [BEAM-13430] Re-enable checkerframework for the project excluding the
------------------------------------------
[...truncated 293.29 KB...]
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key b554a0897b67c5d6e97e4d0c18b42b7c
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.012 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 5db3beb26c00979882e5056107ff43d5
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 5db3beb26c00979882e5056107ff43d5
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.218 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is b45a0daa8df856dd573d3a2bfb4252f0
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key b45a0daa8df856dd573d3a2bfb4252f0
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.204 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 868156cca177cbc06c03a356768cd4ca
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 868156cca177cbc06c03a356768cd4ca
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.089 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.071 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.065 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 28c2fd959821ef1041c29d987a23dda5
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 28c2fd959821ef1041c29d987a23dda5
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.295 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 507995e7fb0c1cc1a31d2a6ccee8fc57
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 507995e7fb0c1cc1a31d2a6ccee8fc57
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.425 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 0ba4f0494a0bb8d5a1543ca3c11bf52a
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 0ba4f0494a0bb8d5a1543ca3c11bf52a
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.43 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9e33711828ee9e73a7b5cbf3e321c9d1
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9e33711828ee9e73a7b5cbf3e321c9d1
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.194 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.281 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is ac6bf85b0940ba0584c8e5a1c700077f
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key ac6bf85b0940ba0584c8e5a1c700077f
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.2 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.033 secs.
> Task :sdks:java:io:hadoop-file-system:compileJava
Invalidating in-memory cache of /home/jenkins/.gradle/caches/7.3.2/javaCompile/jarAnalysis.bin
Invalidating in-memory cache of /home/jenkins/.gradle/caches/7.3.2/javaCompile/classAnalysis.bin
Class dependency analysis for incremental compilation took 0.007 secs.
Created classpath snapshot for incremental compilation in 0.221 secs.
Stored cache entry for task ':sdks:java:io:hadoop-file-system:compileJava' with cache key 6af0b9b59290c65ed0ee341584b5820b
:sdks:java:io:hadoop-file-system:compileJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 8.604 secs.
:sdks:java:io:hadoop-file-system:classes (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:hadoop-file-system:classes
Skipping task ':sdks:java:io:hadoop-file-system:classes' as it has no actions.
:sdks:java:io:hadoop-file-system:classes (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:sdks:java:io:hadoop-file-system:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:hadoop-file-system:compileTestJava
Custom actions are attached to task ':sdks:java:io:hadoop-file-system:compileTestJava'.
Build cache key for task ':sdks:java:io:hadoop-file-system:compileTestJava' is 001939637ee25f48d6b7693f1349e083
Task ':sdks:java:io:hadoop-file-system:compileTestJava' is not up-to-date because:
No history is available.
The input changes require a full rebuild for incremental task ':sdks:java:io:hadoop-file-system:compileTestJava'.
Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments.
Compiling with toolchain '/usr/lib/jvm/java-8-openjdk-amd64'.
Compiling with JDK Java compiler API.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Class dependency analysis for incremental compilation took 0.002 secs.
Created classpath snapshot for incremental compilation in 0.171 secs.
Stored cache entry for task ':sdks:java:io:hadoop-file-system:compileTestJava' with cache key 001939637ee25f48d6b7693f1349e083
:sdks:java:io:hadoop-file-system:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 2.837 secs.
:sdks:java:io:hadoop-file-system:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:hadoop-file-system:testClasses
Skipping task ':sdks:java:io:hadoop-file-system:testClasses' as it has no actions.
:sdks:java:io:hadoop-file-system:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:sdks:java:io:hadoop-file-system:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:hadoop-file-system:testJar
Caching disabled for task ':sdks:java:io:hadoop-file-system:testJar' because:
Not worth caching
Task ':sdks:java:io:hadoop-file-system:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/hadoop-file-system/build/resources/test',> not found
:sdks:java:io:hadoop-file-system:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.006 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 9,5,main]) started.
Gradle Test Executor 82 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is c7c8346f28f1ed20ce0917359017defd
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 82'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.133.176.214:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.133.176.214:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.37.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 82'
Successfully started process 'Gradle Test Executor 82'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.37.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 82 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.004 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.002 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 2.863 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 23s
144 actionable tasks: 86 executed, 56 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vp7tjutx4j262
Stopped 1 **** daemon(s).
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4338
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4338/display/redirect?page=changes>
Changes:
[Steve Niemitz] [BEAM-13488] Work around bug in classpath detection
[noreply] [BEAM-13430] Update comment over eclipse plugin. (#16387)
[zyichi] [BEAM-13430] Fix broken ULR validates runner tests
[noreply] Update venv creation commands in release scripts. (#16381)
[Steve Niemitz] [BEAM-13459] Cache artifacts across job runs on python+dataflow
[noreply] [BEAM-12777] Stable URL for current API docs (#16327)
[noreply] [BEAM-13539] correct resource override dependencies (#16392)
[Kyle Weaver] [BEAM-13581] Remove previous job name for Flink PVR precommit.
------------------------------------------
[...truncated 289.59 KB...]
Class dependency analysis for incremental compilation took 0.01 secs.
Created classpath snapshot for incremental compilation in 0.072 secs.
Stored cache entry for task ':sdks:java:extensions:google-cloud-platform-core:compileTestJava' with cache key d890cdbd3c9b08e436177d616eecb182
:sdks:java:extensions:google-cloud-platform-core:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 4.534 secs.
:sdks:java:extensions:google-cloud-platform-core:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:google-cloud-platform-core:testClasses
Skipping task ':sdks:java:extensions:google-cloud-platform-core:testClasses' as it has no actions.
:sdks:java:extensions:google-cloud-platform-core:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:google-cloud-platform-core:testJar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:direct-java:compileTestJava
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 2be783c84b7d039f7408c0260964e18f
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
The input changes require a full rebuild for incremental task ':runners:direct-java:compileTestJava'.
Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments.
Compiling with toolchain '/usr/lib/jvm/java-8-openjdk-amd64'.
Compiling with JDK Java compiler API.
> Task :sdks:java:extensions:google-cloud-platform-core:testJar
Caching disabled for task ':sdks:java:extensions:google-cloud-platform-core:testJar' because:
Not worth caching
Task ':sdks:java:extensions:google-cloud-platform-core:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/extensions/google-cloud-platform-core/build/resources/test',> not found
:sdks:java:extensions:google-cloud-platform-core:testJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.064 secs.
> Task :runners:direct-java:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Class dependency analysis for incremental compilation took 0.058 secs.
Created classpath snapshot for incremental compilation in 0.07 secs.
Stored cache entry for task ':runners:direct-java:compileTestJava' with cache key 2be783c84b7d039f7408c0260964e18f
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 8.977 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:direct-java:testClasses
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:direct-java:shadowTestJar
Build cache key for task ':runners:direct-java:shadowTestJar' is 0f11671e1edeaf4da39e0c54cf915a8b
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/direct-java/build/resources/test',> not found
*******************
GRADLE SHADOW STATS
Total Jars: 7 (includes project)
Total Time: 0.791s [791ms]
Average Time/Jar: 0.113s [113.0ms]
*******************
Stored cache entry for task ':runners:direct-java:shadowTestJar' with cache key 0f11671e1edeaf4da39e0c54cf915a8b
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 1.237 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) started.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is f6e050722c7ff597a2a70f3ecb4329a9
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
The input changes require a full rebuild for incremental task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments.
Compiling with toolchain '/usr/lib/jvm/java-8-openjdk-amd64'.
Compiling with JDK Java compiler API.
> Task :sdks:java:io:file-based-io-tests:compileTestJava
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 7165c81e98bcf52245ced48116eebeca
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
The input changes require a full rebuild for incremental task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments.
Compiling with toolchain '/usr/lib/jvm/java-8-openjdk-amd64'.
Compiling with JDK Java compiler API.
Note: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/src/test/java/org/apache/beam/sdk/io/tfrecord/TFRecordIOIT.java> uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Class dependency analysis for incremental compilation took 0.008 secs.
Created classpath snapshot for incremental compilation in 0.536 secs.
Stored cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 7165c81e98bcf52245ced48116eebeca
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 3.702 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Class dependency analysis for incremental compilation took 0.195 secs.
Created classpath snapshot for incremental compilation in 0.031 secs.
Stored cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 815c25444d831b5568cad159c3c0decb
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Daemon ****,5,main]) completed. Took 18.368 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 07779f015c86ec73bcec0f8e3fbc5f3e
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/resources/main',> not found
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/original_sources_to_package',> not found
*******************
GRADLE SHADOW STATS
Total Jars: 15 (includes project)
Total Time: 3.063s [3063ms]
Average Time/Jar: 0.2042s [204.2ms]
*******************
Stored cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 07779f015c86ec73bcec0f8e3fbc5f3e
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 4.078 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Class dependency analysis for incremental compilation took 0.089 secs.
Created classpath snapshot for incremental compilation in 0.093 secs.
Stored cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key f6e050722c7ff597a2a70f3ecb4329a9
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 16.056 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.476 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 46409f6901a87b8e12021b94207e7535
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
The input changes require a full rebuild for incremental task ':runners:google-cloud-dataflow-java:compileTestJava'.
Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments.
Compiling with toolchain '/usr/lib/jvm/java-8-openjdk-amd64'.
Compiling with JDK Java compiler API.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Class dependency analysis for incremental compilation took 0.03 secs.
Created classpath snapshot for incremental compilation in 0.158 secs.
Stored cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 46409f6901a87b8e12021b94207e7535
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 6.041 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.086 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 7,5,main]) started.
Gradle Test Executor 9 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is af0106e4c2b10eb8995a36be24b3b1ea
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 9'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.134.45.148:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.134.45.148:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 9'
Successfully started process 'Gradle Test Executor 9'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 9 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.017 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.02 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 2.809 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 22s
117 actionable tasks: 79 executed, 36 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/tquaiz4zrjzwe
Stopped 8 **** daemon(s).
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4337
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4337/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13578] Validate that repeatable PipelineOptions need to be
------------------------------------------
[...truncated 258.29 KB...]
> Task :runners:direct-java:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:direct-java:shadowJar'.
Build cache key for task ':runners:direct-java:shadowJar' is e35548c1db8436bb9cc7be71226352c3
Task ':runners:direct-java:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowJar' with cache key e35548c1db8436bb9cc7be71226352c3
:runners:direct-java:shadowJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 1.095 secs.
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is a0754ad3fc8ffcc05417ff95f8202c4c
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key a0754ad3fc8ffcc05417ff95f8202c4c
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.35 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is 172dc053d29c9ac99906100a2b7884e2
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key 172dc053d29c9ac99906100a2b7884e2
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 1.511 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.193 secs.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 25c2a5e85de496c8f3a85b616698014d
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 25c2a5e85de496c8f3a85b616698014d
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.311 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.634 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is a66e3cf8219725c0ef89ecf0583fa64e
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key a66e3cf8219725c0ef89ecf0583fa64e
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.608 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':',5,main]) started.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 482a6a68c6b0b46088fbbb03665a0e5f
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 482a6a68c6b0b46088fbbb03665a0e5f
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.787 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 72e301c68faa5f4eba0e4aac957e1d29
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 72e301c68faa5f4eba0e4aac957e1d29
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 1.036 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.308 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c6da8e58cbb200838a8febc99990fcc8
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c6da8e58cbb200838a8febc99990fcc8
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 1.569 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.885 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is efd5e4e8f3e499cc7b544d07469a75a1
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key efd5e4e8f3e499cc7b544d07469a75a1
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 1.771 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9508d56df238b05324ca53b3f6a851fa
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9508d56df238b05324ca53b3f6a851fa
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.827 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.087 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 104060c97b2788e4f1ad1992eecda797
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 104060c97b2788e4f1ad1992eecda797
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.615 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 3353a6b3636f1cad2757a644525fc578
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:35.188.106.129:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://35.188.106.129:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.068 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.113 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 16.222 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 52s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ji2gc7a6a75ay
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4336
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4336/display/redirect>
Changes:
------------------------------------------
[...truncated 256.19 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is 172dc053d29c9ac99906100a2b7884e2
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key 172dc053d29c9ac99906100a2b7884e2
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.471 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 25c2a5e85de496c8f3a85b616698014d
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 25c2a5e85de496c8f3a85b616698014d
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.162 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 1.426 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 429f90730142494b0e424b24972ffe77
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 429f90730142494b0e424b24972ffe77
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.021 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.225 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is a0754ad3fc8ffcc05417ff95f8202c4c
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key a0754ad3fc8ffcc05417ff95f8202c4c
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.111 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is a66e3cf8219725c0ef89ecf0583fa64e
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key a66e3cf8219725c0ef89ecf0583fa64e
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.255 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.069 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 72e301c68faa5f4eba0e4aac957e1d29
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 72e301c68faa5f4eba0e4aac957e1d29
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.237 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.082 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 482a6a68c6b0b46088fbbb03665a0e5f
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 482a6a68c6b0b46088fbbb03665a0e5f
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.298 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c6da8e58cbb200838a8febc99990fcc8
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c6da8e58cbb200838a8febc99990fcc8
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.484 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is efd5e4e8f3e499cc7b544d07469a75a1
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key efd5e4e8f3e499cc7b544d07469a75a1
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.404 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 104060c97b2788e4f1ad1992eecda797
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 104060c97b2788e4f1ad1992eecda797
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.164 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.266 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9508d56df238b05324ca53b3f6a851fa
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9508d56df238b05324ca53b3f6a851fa
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.219 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.032 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 8,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 3353a6b3636f1cad2757a644525fc578
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.121.96.53:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.121.96.53:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.019 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.025 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 3.224 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 29s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/iuemokd3ykycm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4335
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4335/display/redirect>
Changes:
------------------------------------------
[...truncated 256.88 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is 172dc053d29c9ac99906100a2b7884e2
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key 172dc053d29c9ac99906100a2b7884e2
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.584 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 25c2a5e85de496c8f3a85b616698014d
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 25c2a5e85de496c8f3a85b616698014d
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.121 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.231 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is a66e3cf8219725c0ef89ecf0583fa64e
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key a66e3cf8219725c0ef89ecf0583fa64e
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.223 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 1.283 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 429f90730142494b0e424b24972ffe77
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 429f90730142494b0e424b24972ffe77
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.019 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is a0754ad3fc8ffcc05417ff95f8202c4c
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key a0754ad3fc8ffcc05417ff95f8202c4c
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.113 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 72e301c68faa5f4eba0e4aac957e1d29
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 72e301c68faa5f4eba0e4aac957e1d29
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.252 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.086 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 482a6a68c6b0b46088fbbb03665a0e5f
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 482a6a68c6b0b46088fbbb03665a0e5f
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.253 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.093 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is efd5e4e8f3e499cc7b544d07469a75a1
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key efd5e4e8f3e499cc7b544d07469a75a1
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.374 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c6da8e58cbb200838a8febc99990fcc8
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c6da8e58cbb200838a8febc99990fcc8
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.437 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 104060c97b2788e4f1ad1992eecda797
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 104060c97b2788e4f1ad1992eecda797
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.158 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.262 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9508d56df238b05324ca53b3f6a851fa
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9508d56df238b05324ca53b3f6a851fa
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.213 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.031 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 10,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 3353a6b3636f1cad2757a644525fc578
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.133.137.79:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.133.137.79:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.018 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.023 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 3.497 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 28s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/rbmeqjowp6lt4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4334
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4334/display/redirect?page=changes>
Changes:
[dpcollins] [BEAM-13402] Simplify PubsubLiteSink
[Kyle Weaver] [BEAM-13571] Fix ClassNotFound exception in Flink tests
[Kyle Weaver] [BEAM-13498] [BEAM-13573] exclude new tests on Flink
[noreply] [BEAM-13052] Add Pub/Sub Lite xlang transforms in python (#15727)
[noreply] [BEAM-13402] Version bump Pub/Sub Lite and implement changes to ensure
------------------------------------------
[...truncated 256.71 KB...]
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:direct-java:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:direct-java:shadowJar'.
Build cache key for task ':runners:direct-java:shadowJar' is e35548c1db8436bb9cc7be71226352c3
Task ':runners:direct-java:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowJar' with cache key e35548c1db8436bb9cc7be71226352c3
:runners:direct-java:shadowJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.356 secs.
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is 25c2a5e85de496c8f3a85b616698014d
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key 25c2a5e85de496c8f3a85b616698014d
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.139 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 1.325 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 429f90730142494b0e424b24972ffe77
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 429f90730142494b0e424b24972ffe77
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.017 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.313 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is a0754ad3fc8ffcc05417ff95f8202c4c
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key a0754ad3fc8ffcc05417ff95f8202c4c
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.078 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.076 secs.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is a66e3cf8219725c0ef89ecf0583fa64e
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key a66e3cf8219725c0ef89ecf0583fa64e
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.274 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 72e301c68faa5f4eba0e4aac957e1d29
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 72e301c68faa5f4eba0e4aac957e1d29
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.247 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.089 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 482a6a68c6b0b46088fbbb03665a0e5f
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 482a6a68c6b0b46088fbbb03665a0e5f
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.285 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c6da8e58cbb200838a8febc99990fcc8
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c6da8e58cbb200838a8febc99990fcc8
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.454 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is efd5e4e8f3e499cc7b544d07469a75a1
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key efd5e4e8f3e499cc7b544d07469a75a1
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.354 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 104060c97b2788e4f1ad1992eecda797
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 104060c97b2788e4f1ad1992eecda797
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.158 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.259 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9508d56df238b05324ca53b3f6a851fa
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9508d56df238b05324ca53b3f6a851fa
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.212 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.045 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 4,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 3353a6b3636f1cad2757a644525fc578
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.72.208.82:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.72.208.82:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.018 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.024 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 3.137 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 28s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/la4jgifmti44a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4333
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4333/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-13521] flink pvr batch precommit
[noreply] Exclude UsesOnWindowExpiration by category from Dataflow v2 streaming
[noreply] [BEAM-13052] Increment pubsub python version and fix breakages. (#16126)
------------------------------------------
[...truncated 256.40 KB...]
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key 231c2bbe14ddc3602ff8d7abb73dbcb9
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.439 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is abf1ddae0b149097fc850a5341a1622b
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key abf1ddae0b149097fc850a5341a1622b
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.122 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 1.31 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is de23ded9c61f4037e001e29dd867f1a4
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key de23ded9c61f4037e001e29dd867f1a4
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.016 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.246 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 30d1af0efe54fc96c457b980127a12ae
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 30d1af0efe54fc96c457b980127a12ae
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.097 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.064 secs.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 4dd5c93c47da3663ada749342e198cef
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 4dd5c93c47da3663ada749342e198cef
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.24 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 25ff4bfca2d08a79648ab5e843c53ce2
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 25ff4bfca2d08a79648ab5e843c53ce2
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.225 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.07 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is bb879aecd8394f3534c93abe227d10b0
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key bb879aecd8394f3534c93abe227d10b0
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.264 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c983570ab9933d4de22e22eacddbcf6c
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c983570ab9933d4de22e22eacddbcf6c
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.448 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87d6bff36f2dc0ca75da68bda9290362
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87d6bff36f2dc0ca75da68bda9290362
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.37 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9cd95100921ed478bf26b1f1c7e68892
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9cd95100921ed478bf26b1f1c7e68892
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':',5,main]) completed. Took 0.162 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Daemon ****,5,main]) completed. Took 0.277 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is f326aa705b2e80b0f75fb66e14a41209
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key f326aa705b2e80b0f75fb66e14a41209
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Daemon ****,5,main]) completed. Took 0.217 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Daemon ****,5,main]) completed. Took 0.037 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Daemon ****,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 1d9da4f20066898c83ca4cf945e52c93
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.69.36.175:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.69.36.175:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.018 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.027 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Daemon ****,5,main]) completed. Took 5.365 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 38s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/jkprok2idieho
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4332
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4332/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13526] Kafka.IO: make DeserializerProvider a public interface
------------------------------------------
[...truncated 257.10 KB...]
:sdks:java:io:google-cloud-platform:classes (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Daemon ****,5,main]) started.
> Task :runners:direct-java:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:direct-java:shadowJar'.
Build cache key for task ':runners:direct-java:shadowJar' is ba56684e67e2deb4e77d82f57dbac91c
Task ':runners:direct-java:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowJar' with cache key ba56684e67e2deb4e77d82f57dbac91c
:runners:direct-java:shadowJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.494 secs.
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is abf1ddae0b149097fc850a5341a1622b
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key abf1ddae0b149097fc850a5341a1622b
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.156 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Daemon ****,5,main]) completed. Took 0.243 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 1.322 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is de23ded9c61f4037e001e29dd867f1a4
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key de23ded9c61f4037e001e29dd867f1a4
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.016 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 25ff4bfca2d08a79648ab5e843c53ce2
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 25ff4bfca2d08a79648ab5e843c53ce2
:runners:google-cloud-dataflow-java:compileJava (Thread[Daemon ****,5,main]) completed. Took 0.188 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Daemon ****,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 4dd5c93c47da3663ada749342e198cef
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 4dd5c93c47da3663ada749342e198cef
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.257 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Daemon ****,5,main]) completed. Took 0.079 secs.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 30d1af0efe54fc96c457b980127a12ae
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 30d1af0efe54fc96c457b980127a12ae
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.103 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Daemon ****,5,main]) started.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.06 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is bb879aecd8394f3534c93abe227d10b0
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key bb879aecd8394f3534c93abe227d10b0
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.284 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87d6bff36f2dc0ca75da68bda9290362
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87d6bff36f2dc0ca75da68bda9290362
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Daemon ****,5,main]) completed. Took 0.381 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c983570ab9933d4de22e22eacddbcf6c
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c983570ab9933d4de22e22eacddbcf6c
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.413 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9cd95100921ed478bf26b1f1c7e68892
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9cd95100921ed478bf26b1f1c7e68892
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Daemon ****,5,main]) completed. Took 0.166 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.256 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is f326aa705b2e80b0f75fb66e14a41209
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key f326aa705b2e80b0f75fb66e14a41209
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.212 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.03 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 6,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 1d9da4f20066898c83ca4cf945e52c93
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:35.223.90.241:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://35.223.90.241:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.018 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.023 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 4.153 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 29s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/rr6sgrvfgt2bk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4331
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4331/display/redirect>
Changes:
------------------------------------------
[...truncated 260.79 KB...]
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 1.457 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is de23ded9c61f4037e001e29dd867f1a4
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key de23ded9c61f4037e001e29dd867f1a4
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.016 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is abf1ddae0b149097fc850a5341a1622b
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key abf1ddae0b149097fc850a5341a1622b
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.125 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 30d1af0efe54fc96c457b980127a12ae
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 30d1af0efe54fc96c457b980127a12ae
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.078 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.24 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.083 secs.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 4dd5c93c47da3663ada749342e198cef
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 4dd5c93c47da3663ada749342e198cef
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.225 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is ab4be1a19fe16e0bfae9418c2c3dc234
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key ab4be1a19fe16e0bfae9418c2c3dc234
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.215 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.063 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is bb879aecd8394f3534c93abe227d10b0
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key bb879aecd8394f3534c93abe227d10b0
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.254 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c983570ab9933d4de22e22eacddbcf6c
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c983570ab9933d4de22e22eacddbcf6c
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.429 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87d6bff36f2dc0ca75da68bda9290362
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87d6bff36f2dc0ca75da68bda9290362
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.32 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.273 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Invalidating in-memory cache of /home/jenkins/.gradle/caches/7.3.2/fileHashes/fileHashes.bin
Invalidating in-memory cache of /home/jenkins/.gradle/caches/7.3.2/fileHashes/resourceHashesCache.bin
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9cd95100921ed478bf26b1f1c7e68892
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9cd95100921ed478bf26b1f1c7e68892
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.491 secs.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Invalidating in-memory cache of /home/jenkins/.gradle/caches/journal-1/file-access.bin
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9f32834befae7f2be107dcc7479c8976
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9f32834befae7f2be107dcc7479c8976
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.307 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.032 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Invalidating in-memory cache of /home/jenkins/.gradle/caches/7.3.2/fileHashes/fileHashes.bin
Invalidating in-memory cache of /home/jenkins/.gradle/caches/7.3.2/fileHashes/resourceHashesCache.bin
Invalidating in-memory cache of /home/jenkins/.gradle/caches/7.3.2/fileHashes/fileHashes.bin
Invalidating in-memory cache of /home/jenkins/.gradle/caches/7.3.2/fileHashes/resourceHashesCache.bin
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 156e54fc22f98a3e6513b5b74c9aaf3c
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:35.225.163.166:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://35.225.163.166:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.023 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.029 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 4.588 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 36s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vj3ep3rbf4lz2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4330
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4330/display/redirect>
Changes:
------------------------------------------
[...truncated 256.10 KB...]
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key abf1ddae0b149097fc850a5341a1622b
:runners:direct-java:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.13 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':',5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 4dd5c93c47da3663ada749342e198cef
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 4dd5c93c47da3663ada749342e198cef
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':',5,main]) completed. Took 0.229 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is 231c2bbe14ddc3602ff8d7abb73dbcb9
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key 231c2bbe14ddc3602ff8d7abb73dbcb9
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.782 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 1.499 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is de23ded9c61f4037e001e29dd867f1a4
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key de23ded9c61f4037e001e29dd867f1a4
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.057 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is bb879aecd8394f3534c93abe227d10b0
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key bb879aecd8394f3534c93abe227d10b0
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.272 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.23 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 30d1af0efe54fc96c457b980127a12ae
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 30d1af0efe54fc96c457b980127a12ae
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.106 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.068 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is ab4be1a19fe16e0bfae9418c2c3dc234
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key ab4be1a19fe16e0bfae9418c2c3dc234
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.21 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.064 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c983570ab9933d4de22e22eacddbcf6c
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c983570ab9933d4de22e22eacddbcf6c
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.466 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87d6bff36f2dc0ca75da68bda9290362
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87d6bff36f2dc0ca75da68bda9290362
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.379 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.274 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9cd95100921ed478bf26b1f1c7e68892
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9cd95100921ed478bf26b1f1c7e68892
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.5 secs.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9f32834befae7f2be107dcc7479c8976
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9f32834befae7f2be107dcc7479c8976
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.385 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.031 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 156e54fc22f98a3e6513b5b74c9aaf3c
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.136.15.78:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.136.15.78:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.018 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.025 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 7.661 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 37s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/33qqttywbfkhq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4329
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4329/display/redirect?page=changes>
Changes:
[mmack] [adhoc] Forbid to import guava and others from org.testcontainers.shaded
------------------------------------------
[...truncated 255.80 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is 231c2bbe14ddc3602ff8d7abb73dbcb9
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key 231c2bbe14ddc3602ff8d7abb73dbcb9
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':',5,main]) completed. Took 0.603 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':',5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is abf1ddae0b149097fc850a5341a1622b
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key abf1ddae0b149097fc850a5341a1622b
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.158 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':',5,main]) completed. Took 0.255 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 1.43 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is de23ded9c61f4037e001e29dd867f1a4
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key de23ded9c61f4037e001e29dd867f1a4
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.021 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 30d1af0efe54fc96c457b980127a12ae
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 30d1af0efe54fc96c457b980127a12ae
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.116 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 4dd5c93c47da3663ada749342e198cef
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 4dd5c93c47da3663ada749342e198cef
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.305 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is ab4be1a19fe16e0bfae9418c2c3dc234
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key ab4be1a19fe16e0bfae9418c2c3dc234
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':',5,main]) completed. Took 0.26 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.089 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':',5,main]) started.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':',5,main]) completed. Took 0.096 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is bb879aecd8394f3534c93abe227d10b0
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key bb879aecd8394f3534c93abe227d10b0
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.321 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c983570ab9933d4de22e22eacddbcf6c
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c983570ab9933d4de22e22eacddbcf6c
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.458 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87d6bff36f2dc0ca75da68bda9290362
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87d6bff36f2dc0ca75da68bda9290362
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':',5,main]) completed. Took 0.466 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.266 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9cd95100921ed478bf26b1f1c7e68892
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9cd95100921ed478bf26b1f1c7e68892
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':',5,main]) completed. Took 0.177 secs.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9f32834befae7f2be107dcc7479c8976
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9f32834befae7f2be107dcc7479c8976
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.231 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.031 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 8,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 156e54fc22f98a3e6513b5b74c9aaf3c
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.135.234.132:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.135.234.132:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.019 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.023 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 3.681 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 30s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/kfu7wqyayb2cq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4328
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4328/display/redirect>
Changes:
------------------------------------------
[...truncated 255.69 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is 231c2bbe14ddc3602ff8d7abb73dbcb9
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key 231c2bbe14ddc3602ff8d7abb73dbcb9
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':',5,main]) completed. Took 0.643 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':',5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is abf1ddae0b149097fc850a5341a1622b
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key abf1ddae0b149097fc850a5341a1622b
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.109 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':',5,main]) completed. Took 0.224 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':',5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 4dd5c93c47da3663ada749342e198cef
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 4dd5c93c47da3663ada749342e198cef
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.218 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 1.327 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is de23ded9c61f4037e001e29dd867f1a4
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key de23ded9c61f4037e001e29dd867f1a4
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.016 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is ab4be1a19fe16e0bfae9418c2c3dc234
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key ab4be1a19fe16e0bfae9418c2c3dc234
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':',5,main]) completed. Took 0.248 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 30d1af0efe54fc96c457b980127a12ae
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 30d1af0efe54fc96c457b980127a12ae
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.081 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':',5,main]) completed. Took 0.075 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.068 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is bb879aecd8394f3534c93abe227d10b0
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key bb879aecd8394f3534c93abe227d10b0
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.312 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87d6bff36f2dc0ca75da68bda9290362
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87d6bff36f2dc0ca75da68bda9290362
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':',5,main]) completed. Took 0.381 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c983570ab9933d4de22e22eacddbcf6c
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c983570ab9933d4de22e22eacddbcf6c
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.47 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9cd95100921ed478bf26b1f1c7e68892
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9cd95100921ed478bf26b1f1c7e68892
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':',5,main]) completed. Took 0.165 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.259 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9f32834befae7f2be107dcc7479c8976
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9f32834befae7f2be107dcc7479c8976
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.199 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.03 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 9,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 156e54fc22f98a3e6513b5b74c9aaf3c
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.123.207.127:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.123.207.127:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.016 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.025 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 3.241 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 32s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/gluxdfml677rq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4327
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4327/display/redirect>
Changes:
------------------------------------------
[...truncated 256.06 KB...]
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:direct-java:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:direct-java:shadowJar'.
Build cache key for task ':runners:direct-java:shadowJar' is ba56684e67e2deb4e77d82f57dbac91c
Task ':runners:direct-java:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowJar' with cache key ba56684e67e2deb4e77d82f57dbac91c
:runners:direct-java:shadowJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.422 secs.
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is abf1ddae0b149097fc850a5341a1622b
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key abf1ddae0b149097fc850a5341a1622b
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.138 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.218 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 1.315 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is de23ded9c61f4037e001e29dd867f1a4
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key de23ded9c61f4037e001e29dd867f1a4
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.015 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is ab4be1a19fe16e0bfae9418c2c3dc234
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key ab4be1a19fe16e0bfae9418c2c3dc234
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.189 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 30d1af0efe54fc96c457b980127a12ae
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 30d1af0efe54fc96c457b980127a12ae
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.111 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.067 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 4dd5c93c47da3663ada749342e198cef
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 4dd5c93c47da3663ada749342e198cef
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.286 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.09 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is bb879aecd8394f3534c93abe227d10b0
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key bb879aecd8394f3534c93abe227d10b0
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.312 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87d6bff36f2dc0ca75da68bda9290362
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87d6bff36f2dc0ca75da68bda9290362
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.395 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c983570ab9933d4de22e22eacddbcf6c
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c983570ab9933d4de22e22eacddbcf6c
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.443 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9cd95100921ed478bf26b1f1c7e68892
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9cd95100921ed478bf26b1f1c7e68892
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.162 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.265 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9f32834befae7f2be107dcc7479c8976
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9f32834befae7f2be107dcc7479c8976
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.231 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.046 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 10,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 156e54fc22f98a3e6513b5b74c9aaf3c
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.122.172.240:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.122.172.240:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.017 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.023 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 3.168 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 34s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/2kbmkjvax5syw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4326
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4326/display/redirect>
Changes:
------------------------------------------
[...truncated 256.92 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is 231c2bbe14ddc3602ff8d7abb73dbcb9
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key 231c2bbe14ddc3602ff8d7abb73dbcb9
:sdks:java:io:google-cloud-platform:compileJava (Thread[Daemon ****,5,main]) completed. Took 0.558 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Daemon ****,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is abf1ddae0b149097fc850a5341a1622b
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key abf1ddae0b149097fc850a5341a1622b
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.112 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 1.307 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is de23ded9c61f4037e001e29dd867f1a4
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key de23ded9c61f4037e001e29dd867f1a4
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.021 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Daemon ****,5,main]) completed. Took 0.218 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Daemon ****,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 4dd5c93c47da3663ada749342e198cef
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 4dd5c93c47da3663ada749342e198cef
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.216 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 30d1af0efe54fc96c457b980127a12ae
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 30d1af0efe54fc96c457b980127a12ae
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.091 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.066 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is ab4be1a19fe16e0bfae9418c2c3dc234
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key ab4be1a19fe16e0bfae9418c2c3dc234
:runners:google-cloud-dataflow-java:compileJava (Thread[Daemon ****,5,main]) completed. Took 0.257 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Daemon ****,5,main]) completed. Took 0.095 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is bb879aecd8394f3534c93abe227d10b0
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key bb879aecd8394f3534c93abe227d10b0
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.3 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c983570ab9933d4de22e22eacddbcf6c
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c983570ab9933d4de22e22eacddbcf6c
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.457 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87d6bff36f2dc0ca75da68bda9290362
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87d6bff36f2dc0ca75da68bda9290362
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Daemon ****,5,main]) completed. Took 0.402 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.262 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9cd95100921ed478bf26b1f1c7e68892
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9cd95100921ed478bf26b1f1c7e68892
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Daemon ****,5,main]) completed. Took 0.16 secs.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9f32834befae7f2be107dcc7479c8976
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9f32834befae7f2be107dcc7479c8976
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.234 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.032 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 9,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 156e54fc22f98a3e6513b5b74c9aaf3c
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:35.232.102.16:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://35.232.102.16:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.02 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.027 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 3.065 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 29s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/pzp67a36wku6c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4325
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4325/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #16285 from [BEAM-13492][Playground] Update backend
------------------------------------------
[...truncated 255.77 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is 231c2bbe14ddc3602ff8d7abb73dbcb9
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key 231c2bbe14ddc3602ff8d7abb73dbcb9
:sdks:java:io:google-cloud-platform:compileJava (Thread[Daemon ****,5,main]) completed. Took 0.534 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Daemon ****,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is abf1ddae0b149097fc850a5341a1622b
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key abf1ddae0b149097fc850a5341a1622b
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.136 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 1.457 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is de23ded9c61f4037e001e29dd867f1a4
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key de23ded9c61f4037e001e29dd867f1a4
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.017 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 30d1af0efe54fc96c457b980127a12ae
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 30d1af0efe54fc96c457b980127a12ae
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.099 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Daemon ****,5,main]) completed. Took 0.255 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Daemon ****,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 4dd5c93c47da3663ada749342e198cef
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 4dd5c93c47da3663ada749342e198cef
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.232 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.071 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is ab4be1a19fe16e0bfae9418c2c3dc234
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key ab4be1a19fe16e0bfae9418c2c3dc234
:runners:google-cloud-dataflow-java:compileJava (Thread[Daemon ****,5,main]) completed. Took 0.239 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is bb879aecd8394f3534c93abe227d10b0
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key bb879aecd8394f3534c93abe227d10b0
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.275 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Daemon ****,5,main]) completed. Took 0.074 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c983570ab9933d4de22e22eacddbcf6c
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c983570ab9933d4de22e22eacddbcf6c
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.437 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87d6bff36f2dc0ca75da68bda9290362
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87d6bff36f2dc0ca75da68bda9290362
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Daemon ****,5,main]) completed. Took 0.338 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Daemon ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.26 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9cd95100921ed478bf26b1f1c7e68892
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9cd95100921ed478bf26b1f1c7e68892
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Daemon ****,5,main]) completed. Took 0.186 secs.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9f32834befae7f2be107dcc7479c8976
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9f32834befae7f2be107dcc7479c8976
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.223 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.034 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 8,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 156e54fc22f98a3e6513b5b74c9aaf3c
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.132.205.213:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.132.205.213:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.021 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.026 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 3.375 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 31s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/kyv7ckkf2qyos
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4324
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4324/display/redirect>
Changes:
------------------------------------------
[...truncated 255.99 KB...]
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:direct-java:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:direct-java:shadowJar'.
Build cache key for task ':runners:direct-java:shadowJar' is ba56684e67e2deb4e77d82f57dbac91c
Task ':runners:direct-java:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowJar' with cache key ba56684e67e2deb4e77d82f57dbac91c
:runners:direct-java:shadowJar (Thread[Execution **** for ':',5,main]) completed. Took 0.336 secs.
:runners:direct-java:compileTestJava (Thread[Execution **** for ':',5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is abf1ddae0b149097fc850a5341a1622b
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key abf1ddae0b149097fc850a5341a1622b
:runners:direct-java:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.134 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.219 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 1.267 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is ab4be1a19fe16e0bfae9418c2c3dc234
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key ab4be1a19fe16e0bfae9418c2c3dc234
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.174 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is de23ded9c61f4037e001e29dd867f1a4
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key de23ded9c61f4037e001e29dd867f1a4
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.018 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 4dd5c93c47da3663ada749342e198cef
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 4dd5c93c47da3663ada749342e198cef
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':',5,main]) completed. Took 0.277 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.078 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 30d1af0efe54fc96c457b980127a12ae
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 30d1af0efe54fc96c457b980127a12ae
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.115 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.08 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is bb879aecd8394f3534c93abe227d10b0
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key bb879aecd8394f3534c93abe227d10b0
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.266 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87d6bff36f2dc0ca75da68bda9290362
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87d6bff36f2dc0ca75da68bda9290362
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.382 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c983570ab9933d4de22e22eacddbcf6c
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c983570ab9933d4de22e22eacddbcf6c
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.411 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9cd95100921ed478bf26b1f1c7e68892
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9cd95100921ed478bf26b1f1c7e68892
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.163 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.259 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9f32834befae7f2be107dcc7479c8976
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9f32834befae7f2be107dcc7479c8976
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.223 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.03 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 10,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 156e54fc22f98a3e6513b5b74c9aaf3c
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.136.47.83:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.136.47.83:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.018 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.024 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 3.147 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 28s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/o2nmz2mxqeosw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4323
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4323/display/redirect>
Changes:
------------------------------------------
[...truncated 256.04 KB...]
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:direct-java:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:direct-java:shadowJar'.
Build cache key for task ':runners:direct-java:shadowJar' is ba56684e67e2deb4e77d82f57dbac91c
Task ':runners:direct-java:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowJar' with cache key ba56684e67e2deb4e77d82f57dbac91c
:runners:direct-java:shadowJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.309 secs.
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is abf1ddae0b149097fc850a5341a1622b
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key abf1ddae0b149097fc850a5341a1622b
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.129 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.23 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 1.334 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is de23ded9c61f4037e001e29dd867f1a4
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key de23ded9c61f4037e001e29dd867f1a4
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.019 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 30d1af0efe54fc96c457b980127a12ae
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 30d1af0efe54fc96c457b980127a12ae
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.089 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 4dd5c93c47da3663ada749342e198cef
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 4dd5c93c47da3663ada749342e198cef
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.234 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is ab4be1a19fe16e0bfae9418c2c3dc234
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key ab4be1a19fe16e0bfae9418c2c3dc234
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.193 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.075 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.092 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is bb879aecd8394f3534c93abe227d10b0
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key bb879aecd8394f3534c93abe227d10b0
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.311 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c983570ab9933d4de22e22eacddbcf6c
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c983570ab9933d4de22e22eacddbcf6c
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.421 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87d6bff36f2dc0ca75da68bda9290362
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87d6bff36f2dc0ca75da68bda9290362
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.381 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9cd95100921ed478bf26b1f1c7e68892
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9cd95100921ed478bf26b1f1c7e68892
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.168 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.259 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9f32834befae7f2be107dcc7479c8976
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9f32834befae7f2be107dcc7479c8976
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.196 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.031 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 7,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 156e54fc22f98a3e6513b5b74c9aaf3c
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.133.174.0:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.133.174.0:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.016 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.023 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 3.152 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 28s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/tdxhep4o2cl7q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4322
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4322/display/redirect?page=changes>
Changes:
[alexander.zhuravlev] [BEAM-13530] Fixed scrollbar in the Output section
[noreply] Merge pull request #16355 from [BEAM-13529] [Playground] [Bugfix] Fix
[noreply] Fixed grammar error in Go ParDo function comments. (#16329)
------------------------------------------
[...truncated 256.87 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is 231c2bbe14ddc3602ff8d7abb73dbcb9
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key 231c2bbe14ddc3602ff8d7abb73dbcb9
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':',5,main]) completed. Took 0.609 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is abf1ddae0b149097fc850a5341a1622b
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key abf1ddae0b149097fc850a5341a1622b
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.132 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.256 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 4dd5c93c47da3663ada749342e198cef
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 4dd5c93c47da3663ada749342e198cef
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':',5,main]) completed. Took 0.281 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 1.392 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is de23ded9c61f4037e001e29dd867f1a4
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key de23ded9c61f4037e001e29dd867f1a4
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.024 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is ab4be1a19fe16e0bfae9418c2c3dc234
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key ab4be1a19fe16e0bfae9418c2c3dc234
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.27 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 30d1af0efe54fc96c457b980127a12ae
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 30d1af0efe54fc96c457b980127a12ae
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.109 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.098 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.075 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is bb879aecd8394f3534c93abe227d10b0
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key bb879aecd8394f3534c93abe227d10b0
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.364 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87d6bff36f2dc0ca75da68bda9290362
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87d6bff36f2dc0ca75da68bda9290362
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.51 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c983570ab9933d4de22e22eacddbcf6c
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c983570ab9933d4de22e22eacddbcf6c
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.564 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9cd95100921ed478bf26b1f1c7e68892
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9cd95100921ed478bf26b1f1c7e68892
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.18 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.262 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9f32834befae7f2be107dcc7479c8976
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9f32834befae7f2be107dcc7479c8976
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.257 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.032 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 8,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 156e54fc22f98a3e6513b5b74c9aaf3c
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:35.239.25.97:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://35.239.25.97:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.02 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.028 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 3.341 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 31s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/32ebe2x5oz4ca
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4321
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4321/display/redirect>
Changes:
------------------------------------------
[...truncated 255.46 KB...]
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:direct-java:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:direct-java:shadowJar'.
Build cache key for task ':runners:direct-java:shadowJar' is ba56684e67e2deb4e77d82f57dbac91c
Task ':runners:direct-java:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowJar' with cache key ba56684e67e2deb4e77d82f57dbac91c
:runners:direct-java:shadowJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.406 secs.
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is abf1ddae0b149097fc850a5341a1622b
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key abf1ddae0b149097fc850a5341a1622b
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.13 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.262 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':',5,main]) completed. Took 1.333 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is de23ded9c61f4037e001e29dd867f1a4
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key de23ded9c61f4037e001e29dd867f1a4
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':',5,main]) completed. Took 0.021 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 30d1af0efe54fc96c457b980127a12ae
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 30d1af0efe54fc96c457b980127a12ae
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.085 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':',5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 4dd5c93c47da3663ada749342e198cef
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 4dd5c93c47da3663ada749342e198cef
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.224 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':',5,main]) completed. Took 0.078 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is ab4be1a19fe16e0bfae9418c2c3dc234
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key ab4be1a19fe16e0bfae9418c2c3dc234
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.205 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.065 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is bb879aecd8394f3534c93abe227d10b0
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key bb879aecd8394f3534c93abe227d10b0
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.263 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c983570ab9933d4de22e22eacddbcf6c
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c983570ab9933d4de22e22eacddbcf6c
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.423 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87d6bff36f2dc0ca75da68bda9290362
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87d6bff36f2dc0ca75da68bda9290362
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.366 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9cd95100921ed478bf26b1f1c7e68892
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9cd95100921ed478bf26b1f1c7e68892
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.162 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':',5,main]) completed. Took 0.264 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9f32834befae7f2be107dcc7479c8976
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9f32834befae7f2be107dcc7479c8976
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.207 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':',5,main]) completed. Took 0.031 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':',5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 156e54fc22f98a3e6513b5b74c9aaf3c
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:35.188.128.236:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://35.188.128.236:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.018 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.023 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':',5,main]) completed. Took 3.095 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 28s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/eizqssdboanpe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4320
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4320/display/redirect>
Changes:
------------------------------------------
[...truncated 254.83 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:compileJava' is 231c2bbe14ddc3602ff8d7abb73dbcb9
Task ':sdks:java:io:google-cloud-platform:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileJava' with cache key 231c2bbe14ddc3602ff8d7abb73dbcb9
:sdks:java:io:google-cloud-platform:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.551 secs.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:classes' as it has no actions.
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is abf1ddae0b149097fc850a5341a1622b
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key abf1ddae0b149097fc850a5341a1622b
:runners:direct-java:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.155 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.238 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 1.274 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is de23ded9c61f4037e001e29dd867f1a4
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key de23ded9c61f4037e001e29dd867f1a4
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.017 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 30d1af0efe54fc96c457b980127a12ae
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 30d1af0efe54fc96c457b980127a12ae
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.097 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 4dd5c93c47da3663ada749342e198cef
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 4dd5c93c47da3663ada749342e198cef
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':',5,main]) completed. Took 0.283 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is ab4be1a19fe16e0bfae9418c2c3dc234
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key ab4be1a19fe16e0bfae9418c2c3dc234
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.239 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.092 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.088 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is bb879aecd8394f3534c93abe227d10b0
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key bb879aecd8394f3534c93abe227d10b0
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.326 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':',5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c983570ab9933d4de22e22eacddbcf6c
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c983570ab9933d4de22e22eacddbcf6c
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.455 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87d6bff36f2dc0ca75da68bda9290362
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87d6bff36f2dc0ca75da68bda9290362
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.403 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9cd95100921ed478bf26b1f1c7e68892
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9cd95100921ed478bf26b1f1c7e68892
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.163 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.26 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9f32834befae7f2be107dcc7479c8976
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9f32834befae7f2be107dcc7479c8976
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.2 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.031 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 5,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 156e54fc22f98a3e6513b5b74c9aaf3c
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:34.72.185.91:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://34.72.185.91:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.018 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.023 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 3.194 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 28s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/odhq2edrtpuq6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4319
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4319/display/redirect>
Changes:
------------------------------------------
[...truncated 255.96 KB...]
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:direct-java:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:direct-java:shadowJar'.
Build cache key for task ':runners:direct-java:shadowJar' is ba56684e67e2deb4e77d82f57dbac91c
Task ':runners:direct-java:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowJar' with cache key ba56684e67e2deb4e77d82f57dbac91c
:runners:direct-java:shadowJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.466 secs.
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 1.348 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is abf1ddae0b149097fc850a5341a1622b
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key abf1ddae0b149097fc850a5341a1622b
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.106 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is de23ded9c61f4037e001e29dd867f1a4
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key de23ded9c61f4037e001e29dd867f1a4
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.016 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.219 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 30d1af0efe54fc96c457b980127a12ae
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 30d1af0efe54fc96c457b980127a12ae
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.085 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.075 secs.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 4dd5c93c47da3663ada749342e198cef
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 4dd5c93c47da3663ada749342e198cef
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.217 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) started.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is ab4be1a19fe16e0bfae9418c2c3dc234
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key ab4be1a19fe16e0bfae9418c2c3dc234
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.217 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.065 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is bb879aecd8394f3534c93abe227d10b0
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key bb879aecd8394f3534c93abe227d10b0
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.265 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c983570ab9933d4de22e22eacddbcf6c
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c983570ab9933d4de22e22eacddbcf6c
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.414 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87d6bff36f2dc0ca75da68bda9290362
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87d6bff36f2dc0ca75da68bda9290362
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.346 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9cd95100921ed478bf26b1f1c7e68892
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9cd95100921ed478bf26b1f1c7e68892
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.156 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.267 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9f32834befae7f2be107dcc7479c8976
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9f32834befae7f2be107dcc7479c8976
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.216 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 11,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.03 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 11,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 156e54fc22f98a3e6513b5b74c9aaf3c
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:104.154.31.159:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://104.154.31.159:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.017 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.023 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 3.108 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 28s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7ac3elevbkjo4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #4318
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/4318/display/redirect>
Changes:
------------------------------------------
[...truncated 257.01 KB...]
:sdks:java:io:google-cloud-platform:classes (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:direct-java:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:direct-java:shadowJar'.
Build cache key for task ':runners:direct-java:shadowJar' is ba56684e67e2deb4e77d82f57dbac91c
Task ':runners:direct-java:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowJar' with cache key ba56684e67e2deb4e77d82f57dbac91c
:runners:direct-java:shadowJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.395 secs.
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:direct-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:direct-java:compileTestJava'.
Build cache key for task ':runners:direct-java:compileTestJava' is abf1ddae0b149097fc850a5341a1622b
Task ':runners:direct-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key abf1ddae0b149097fc850a5341a1622b
:runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.142 secs.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:direct-java:testClasses UP-TO-DATE
Skipping task ':runners:direct-java:testClasses' as it has no actions.
:runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:jar
Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found
:sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.211 secs.
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 1.267 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is de23ded9c61f4037e001e29dd867f1a4
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key de23ded9c61f4037e001e29dd867f1a4
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.018 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 4dd5c93c47da3663ada749342e198cef
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 4dd5c93c47da3663ada749342e198cef
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.236 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is ab4be1a19fe16e0bfae9418c2c3dc234
Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key ab4be1a19fe16e0bfae9418c2c3dc234
:runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.219 secs.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 30d1af0efe54fc96c457b980127a12ae
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 30d1af0efe54fc96c457b980127a12ae
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.121 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.076 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.067 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is bb879aecd8394f3534c93abe227d10b0
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key bb879aecd8394f3534c93abe227d10b0
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.275 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87d6bff36f2dc0ca75da68bda9290362
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87d6bff36f2dc0ca75da68bda9290362
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.419 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is c983570ab9933d4de22e22eacddbcf6c
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key c983570ab9933d4de22e22eacddbcf6c
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.439 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9cd95100921ed478bf26b1f1c7e68892
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9cd95100921ed478bf26b1f1c7e68892
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.161 secs.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.258 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9f32834befae7f2be107dcc7479c8976
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9f32834befae7f2be107dcc7479c8976
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.224 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.032 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 9,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 156e54fc22f98a3e6513b5b74c9aaf3c
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=many_files_textioit_hdfs_results","--influxMeasurement=many_files_textioit_hdfs_results","--reportGcsPerformanceMetrics=true","--gcsPerformanceMetrics=true","--numberOfRecords=25000000","--expectedHash=f8453256ccf861e8a312c125dfe0e436","--datasetSize=1062290000","--numberOfShards=1000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:35.224.178.71:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://35.224.178.71:9000/TEXTIO_IT_","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numWorkers'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1873)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:37)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:94)
1 test completed, 1 failed
Finished generating test XML results (0.019 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.026 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 3.062 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 28s
117 actionable tasks: 57 executed, 58 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/hfeyghoufmn7a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org