You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/03/29 12:24:15 UTC
Build failed in Jenkins: beam_PerformanceTests_ParquetIOIT #5603
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT/5603/display/redirect>
Changes:
------------------------------------------
[...truncated 276.15 KB...]
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.166 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:direct-java:shadowTestJar FROM-CACHE
Build cache key for task ':runners:direct-java:shadowTestJar' is 11ee470b718dd69b61f3e98c479397cd
Task ':runners:direct-java:shadowTestJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 11ee470b718dd69b61f3e98c479397cd
:runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.314 secs.
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:extractIncludeTestProto
Caching disabled for task ':sdks:java:extensions:protobuf:extractIncludeTestProto' because:
Caching has not been enabled for the task
Task ':sdks:java:extensions:protobuf:extractIncludeTestProto' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:extractIncludeTestProto (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 1.288 secs.
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is b2870bd3b885805f48f5490977a735c2
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key b2870bd3b885805f48f5490977a735c2
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.016 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:compileTestJava'.
Build cache key for task ':sdks:java:io:file-based-io-tests:compileTestJava' is 977a6ed95b1f4801a6382cf45783a8c0
Task ':sdks:java:io:file-based-io-tests:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:file-based-io-tests:compileTestJava' with cache key 977a6ed95b1f4801a6382cf45783a8c0
:sdks:java:io:file-based-io-tests:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.259 secs.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:file-based-io-tests:testClasses' as it has no actions.
:sdks:java:io:file-based-io-tests:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is e82c2f098df6ecc1ab5a4065446a55db
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key e82c2f098df6ecc1ab5a4065446a55db
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.083 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava FROM-CACHE
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 52d5d782b37ffdb4bc56af44dd4c0c4e
Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 52d5d782b37ffdb4bc56af44dd4c0c4e
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.358 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 4,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.066 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is bbf6be2c390341cf4a01d51baeed918c
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key bbf6be2c390341cf4a01d51baeed918c
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.358 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 6599f8cfe21138f5b0318eb81437fcaa
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 6599f8cfe21138f5b0318eb81437fcaa
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.445 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.285 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 4e61832a06310d5f39e003283e592f31
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 4e61832a06310d5f39e003283e592f31
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.228 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.032 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 2,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Custom actions are attached to task ':sdks:java:io:file-based-io-tests:integrationTest'.
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is 422f716330c27346a7bab2bd4c7bc450
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--filenamePrefix=gs://temp-storage-for-perf-tests/beam_PerformanceTests_ParquetIOIT/5603/","--bigQueryDataset=beam_performance","--bigQueryTable=parquetioit_results","--influxMeasurement=parquetioit_results","--numberOfRecords=225000000","--expectedHash=2f9f5ca33ea464b25109c0297eb6aecb","--datasetSize=1087370000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.39.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/src/sdks/java/io/file-based-io-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.parquet.ParquetIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.39.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
org.apache.beam.sdk.io.parquet.ParquetIOIT > writeThenReadAll STANDARD_ERROR
Mar 29, 2022 12:24:10 PM org.apache.beam.runners.dataflow.DataflowRunner validateSdkContainerImageOptions
WARNING: Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage.
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.parquet.ParquetIOIT > writeThenReadAll FAILED
java.lang.IllegalArgumentException: DataflowRunner requires gcpTempLocation, but failed to retrieve a value from PipelineOptions
at org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:281)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:217)
at org.apache.beam.sdk.util.InstanceBuilder.build(InstanceBuilder.java:158)
at org.apache.beam.sdk.PipelineRunner.fromOptions(PipelineRunner.java:55)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:317)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:399)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:335)
at org.apache.beam.sdk.io.parquet.ParquetIOIT.writeThenReadAll(ParquetIOIT.java:166)
Caused by:
java.lang.RuntimeException: Unable to verify project with ID apache-beam-testing
at org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.tryCreateDefaultBucket(GcpOptions.java:350)
at org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.create(GcpOptions.java:308)
at org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.create(GcpOptions.java:297)
at org.apache.beam.sdk.options.ProxyInvocationHandler.returnDefaultHelper(ProxyInvocationHandler.java:611)
at org.apache.beam.sdk.options.ProxyInvocationHandler.getDefault(ProxyInvocationHandler.java:552)
at org.apache.beam.sdk.options.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:169)
at com.sun.proxy.$Proxy13.getGcpTempLocation(Unknown Source)
at org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:279)
... 11 more
Caused by:
java.io.IOException: Unable to get project number
at org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.getProjectNumber(GcpOptions.java:416)
at org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.getProjectNumber(GcpOptions.java:391)
at org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.tryCreateDefaultBucket(GcpOptions.java:348)
... 18 more
Caused by:
java.io.IOException: Unexpected Error code 500 trying to get security access token from Compute Engine metadata for the default service account: "Failed to authenticate request (Type 0)"
at com.google.auth.oauth2.ComputeEngineCredentials.refreshAccessToken(ComputeEngineCredentials.java:206)
at com.google.auth.oauth2.OAuth2Credentials$1.call(OAuth2Credentials.java:257)
at com.google.auth.oauth2.OAuth2Credentials$1.call(OAuth2Credentials.java:254)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)
at com.google.auth.oauth2.OAuth2Credentials$AsyncRefreshResult.executeIfNew(OAuth2Credentials.java:580)
at com.google.auth.oauth2.OAuth2Credentials.asyncFetch(OAuth2Credentials.java:220)
at com.google.auth.oauth2.OAuth2Credentials.getRequestMetadata(OAuth2Credentials.java:170)
at com.google.auth.http.HttpCredentialsAdapter.initialize(HttpCredentialsAdapter.java:96)
at com.google.cloud.hadoop.util.ChainingHttpRequestInitializer.initialize(ChainingHttpRequestInitializer.java:50)
at com.google.api.client.http.HttpRequestFactory.buildRequest(HttpRequestFactory.java:91)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.buildHttpRequest(AbstractGoogleClientRequest.java:404)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:514)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:455)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:565)
at com.google.cloud.hadoop.util.ResilientOperation.retry(ResilientOperation.java:66)
at org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.getProjectNumber(GcpOptions.java:408)
... 20 more
1 test completed, 1 failed
Finished generating test XML results (0.026 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.033 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 6.934 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 49s
142 actionable tasks: 84 executed, 56 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/aq5epnb54jbbo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PerformanceTests_ParquetIOIT #5604
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_ParquetIOIT/5604/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org