You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/12/19 19:07:10 UTC
Build failed in Jenkins:
beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #6
See <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/6/display/redirect?page=changes>
Changes:
[mxm] [BEAM-6245] Set translation mode directly on PipelineOptions
[mxm] [BEAM-6245] Add integration test for FlinkTransformOverrides
[daniel.o.programmer] [BEAM-5449] Tagging failing ULR ValidatesRunner tests.
[mxm] [BEAM-6263] Prevent NullPointer on concurrent JobServer shutdown
[mxm] [BEAM-6263] Prevent port collisions in FlinkJobServerDriveTest
[mxm] [BEAM-6263] Prevent stderr->stdout redirection
[mxm] [BEAM-6263] Restore stderr on exceptions to print the error
[robertwb] [BEAM-6094] Add loopback environment for java.
[robertwb] More complete exception message.
[robertwb] [BEAM-6186] Finish moving optimization phases.
[pablo] [BEAM-5993] Create SideInput Load test (#7020)
------------------------------------------
[...truncated 125.18 KB...]
:beam-sdks-java-io-file-based-io-tests:classes (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 0.0 secs.
> Task :beam-sdks-java-io-xml:shadowTestJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-xml:shadowTestJar' is 3a80c809fb1059a4da9a8d43c247322e
Caching disabled for task ':beam-sdks-java-io-xml:shadowTestJar': Caching has not been enabled for the task
Skipping task ':beam-sdks-java-io-xml:shadowTestJar' as it is up-to-date.
:beam-sdks-java-io-xml:shadowTestJar (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.009 secs.
> Task :beam-sdks-java-io-parquet:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-parquet:compileTestJava' is f363e4d5b40d16fa4b691ff2c989ba61
Skipping task ':beam-sdks-java-io-parquet:compileTestJava' as it is up-to-date.
:beam-sdks-java-io-parquet:compileTestJava (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.033 secs.
:beam-sdks-java-io-parquet:testClasses (Thread[Task worker for ':' Thread 10,5,main]) started.
> Task :beam-sdks-java-io-parquet:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-io-parquet:testClasses' as it has no actions.
:beam-sdks-java-io-parquet:testClasses (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-parquet:shadowTestJar (Thread[Task worker for ':' Thread 10,5,main]) started.
> Task :beam-sdks-java-extensions-google-cloud-platform-core:shadowTestJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-extensions-google-cloud-platform-core:shadowTestJar' is 6c77573b6275b999e61bb3387bd734e8
Caching disabled for task ':beam-sdks-java-extensions-google-cloud-platform-core:shadowTestJar': Caching has not been enabled for the task
Skipping task ':beam-sdks-java-extensions-google-cloud-platform-core:shadowTestJar' as it is up-to-date.
:beam-sdks-java-extensions-google-cloud-platform-core:shadowTestJar (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 0.009 secs.
> Task :beam-sdks-java-io-hadoop-file-system:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-hadoop-file-system:compileTestJava' is 3921c5b28858fa772d1d27cd3d9980db
Skipping task ':beam-sdks-java-io-hadoop-file-system:compileTestJava' as it is up-to-date.
:beam-sdks-java-io-hadoop-file-system:compileTestJava (Thread[Daemon worker,5,main]) completed. Took 0.037 secs.
:beam-sdks-java-io-google-cloud-platform:compileTestJava (Thread[Task worker for ':' Thread 15,5,main]) started.
:beam-sdks-java-io-hadoop-file-system:testClasses (Thread[Daemon worker,5,main]) started.
> Task :beam-sdks-java-io-hadoop-file-system:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-io-hadoop-file-system:testClasses' as it has no actions.
:beam-sdks-java-io-hadoop-file-system:testClasses (Thread[Daemon worker,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-hadoop-file-system:shadowTestJar (Thread[Daemon worker,5,main]) started.
> Task :beam-sdks-java-io-parquet:shadowTestJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-parquet:shadowTestJar' is 085fed8e655098618022b81e05e5ac91
Caching disabled for task ':beam-sdks-java-io-parquet:shadowTestJar': Caching has not been enabled for the task
Skipping task ':beam-sdks-java-io-parquet:shadowTestJar' as it is up-to-date.
:beam-sdks-java-io-parquet:shadowTestJar (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.01 secs.
> Task :beam-sdks-java-io-hadoop-file-system:shadowTestJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-hadoop-file-system:shadowTestJar' is fae73285ff60d2e018c1e2431af607bf
Caching disabled for task ':beam-sdks-java-io-hadoop-file-system:shadowTestJar': Caching has not been enabled for the task
Skipping task ':beam-sdks-java-io-hadoop-file-system:shadowTestJar' as it is up-to-date.
:beam-sdks-java-io-hadoop-file-system:shadowTestJar (Thread[Daemon worker,5,main]) completed. Took 0.015 secs.
> Task :beam-sdks-java-io-google-cloud-platform:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:compileTestJava' is 735d796f824b6a787afae2aa50e7a599
Skipping task ':beam-sdks-java-io-google-cloud-platform:compileTestJava' as it is up-to-date.
:beam-sdks-java-io-google-cloud-platform:compileTestJava (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 0.07 secs.
:beam-sdks-java-io-google-cloud-platform:testClasses (Thread[Task worker for ':' Thread 15,5,main]) started.
> Task :beam-sdks-java-io-google-cloud-platform:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-io-google-cloud-platform:testClasses' as it has no actions.
:beam-sdks-java-io-google-cloud-platform:testClasses (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:shadowTestJar (Thread[Task worker for ':' Thread 15,5,main]) started.
> Task :beam-sdks-java-io-google-cloud-platform:shadowTestJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowTestJar' is 62f9dde0399523d78a8fc4b4ed08c28d
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowTestJar': Caching has not been enabled for the task
Skipping task ':beam-sdks-java-io-google-cloud-platform:shadowTestJar' as it is up-to-date.
:beam-sdks-java-io-google-cloud-platform:shadowTestJar (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 0.02 secs.
:beam-runners-google-cloud-dataflow-java:compileTestJava (Thread[Task worker for ':' Thread 15,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:compileTestJava UP-TO-DATE
Build cache key for task ':beam-runners-google-cloud-dataflow-java:compileTestJava' is 4c79d4b9959458dc090d61ddcbc55240
Skipping task ':beam-runners-google-cloud-dataflow-java:compileTestJava' as it is up-to-date.
:beam-runners-google-cloud-dataflow-java:compileTestJava (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 0.052 secs.
:beam-runners-google-cloud-dataflow-java:testClasses (Thread[Task worker for ':' Thread 15,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':beam-runners-google-cloud-dataflow-java:testClasses' as it has no actions.
:beam-runners-google-cloud-dataflow-java:testClasses (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 0.0 secs.
:beam-runners-google-cloud-dataflow-java:shadowTestJar (Thread[Task worker for ':' Thread 8,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:shadowTestJar UP-TO-DATE
Build cache key for task ':beam-runners-google-cloud-dataflow-java:shadowTestJar' is 61a5f3f64ba4683f73f16a48f17e6a63
Caching disabled for task ':beam-runners-google-cloud-dataflow-java:shadowTestJar': Caching has not been enabled for the task
Skipping task ':beam-runners-google-cloud-dataflow-java:shadowTestJar' as it is up-to-date.
:beam-runners-google-cloud-dataflow-java:shadowTestJar (Thread[Task worker for ':' Thread 8,5,main]) completed. Took 0.016 secs.
:beam-sdks-java-io-file-based-io-tests:compileTestJava (Thread[Task worker for ':' Thread 8,5,main]) started.
> Task :beam-sdks-java-io-file-based-io-tests:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-file-based-io-tests:compileTestJava' is ed531ea525a7f3023dba35f9c56030f8
Skipping task ':beam-sdks-java-io-file-based-io-tests:compileTestJava' as it is up-to-date.
:beam-sdks-java-io-file-based-io-tests:compileTestJava (Thread[Task worker for ':' Thread 8,5,main]) completed. Took 0.071 secs.
:beam-sdks-java-io-file-based-io-tests:testClasses (Thread[Task worker for ':' Thread 8,5,main]) started.
> Task :beam-sdks-java-io-file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-io-file-based-io-tests:testClasses' as it has no actions.
:beam-sdks-java-io-file-based-io-tests:testClasses (Thread[Task worker for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-file-based-io-tests:integrationTest (Thread[Task worker for ':',5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :beam-sdks-java-io-file-based-io-tests:integrationTest
Build cache key for task ':beam-sdks-java-io-file-based-io-tests:integrationTest' is c02c4663eb0a949341345f50368b13be
Task ':beam-sdks-java-io-file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Not loading task ':beam-sdks-java-io-file-based-io-tests:integrationTest' from cache because loading from cache is disabled for this task
Starting process 'Gradle Test Executor 1'. Working directory: <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/local/asfpackages/java/jdk1.8.0_172/bin/java -DbeamTestPipelineOptions=["--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--numberOfRecords=1000000","--numShards=1000","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs://107.178.213.148:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://107.178.213.148:9000/TEXTIO_IT_","--runner=TestDataflowRunner","--workerHarnessContainerImage=","--dataflowWorkerJar=${dataflowWorkerJar}"] -Djava.security.manager=worker.org.gradle.process.internal.worker.child.BootstrapSecurityManager -Dorg.gradle.native=false -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/4.10.2/workerMain/gradle-worker.jar worker.org.gradle.process.internal.worker.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.25/bccda40ebc8067491b32a88f49615a747d20082d/slf4j-jdk14-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.25/110cefe2df103412849d72ef7a67e4e91e4266b4/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :beam-sdks-java-io-file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numShards'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1531)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:111)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:294)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:451)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:41)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:75)
Finished generating test XML results (0.012 secs) into: <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.025 secs) into: <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:beam-sdks-java-io-file-based-io-tests:integrationTest (Thread[Task worker for ':',5,main]) completed. Took 2.313 secs.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
84 actionable tasks: 1 executed, 83 up-to-date
Publishing build scan...
https://gradle.com/s/vawowx5pk6c2a
STDERR:
1 test completed, 1 failed
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-io-file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
Run with --debug option to get more log output. Run with --scan to get full insights.
* Exception is:
org.gradle.api.tasks.TaskExecutionException: Execution failed for task ':beam-sdks-java-io-file-based-io-tests:integrationTest'.
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:110)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.execute(ExecuteActionsTaskExecuter.java:77)
at org.gradle.api.internal.tasks.execution.OutputDirectoryCreatingTaskExecuter.execute(OutputDirectoryCreatingTaskExecuter.java:51)
at org.gradle.api.internal.tasks.execution.SkipCachedTaskExecuter.execute(SkipCachedTaskExecuter.java:105)
at org.gradle.api.internal.tasks.execution.SkipUpToDateTaskExecuter.execute(SkipUpToDateTaskExecuter.java:59)
at org.gradle.api.internal.tasks.execution.ResolveTaskOutputCachingStateExecuter.execute(ResolveTaskOutputCachingStateExecuter.java:54)
at org.gradle.api.internal.tasks.execution.ResolveBuildCacheKeyExecuter.execute(ResolveBuildCacheKeyExecuter.java:79)
at org.gradle.api.internal.tasks.execution.ValidatingTaskExecuter.execute(ValidatingTaskExecuter.java:59)
at org.gradle.api.internal.tasks.execution.SkipEmptySourceFilesTaskExecuter.execute(SkipEmptySourceFilesTaskExecuter.java:101)
at org.gradle.api.internal.tasks.execution.FinalizeInputFilePropertiesTaskExecuter.execute(FinalizeInputFilePropertiesTaskExecuter.java:44)
at org.gradle.api.internal.tasks.execution.CleanupStaleOutputsExecuter.execute(CleanupStaleOutputsExecuter.java:91)
at org.gradle.api.internal.tasks.execution.ResolveTaskArtifactStateTaskExecuter.execute(ResolveTaskArtifactStateTaskExecuter.java:62)
at org.gradle.api.internal.tasks.execution.SkipTaskWithNoActionsExecuter.execute(SkipTaskWithNoActionsExecuter.java:59)
at org.gradle.api.internal.tasks.execution.SkipOnlyIfTaskExecuter.execute(SkipOnlyIfTaskExecuter.java:54)
at org.gradle.api.internal.tasks.execution.ExecuteAtMostOnceTaskExecuter.execute(ExecuteAtMostOnceTaskExecuter.java:43)
at org.gradle.api.internal.tasks.execution.CatchExceptionTaskExecuter.execute(CatchExceptionTaskExecuter.java:34)
at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter$1.run(EventFiringTaskExecuter.java:51)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:300)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:292)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:174)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:90)
at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31)
at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter.execute(EventFiringTaskExecuter.java:46)
at org.gradle.execution.taskgraph.LocalTaskInfoExecutor.execute(LocalTaskInfoExecutor.java:42)
at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$BuildOperationAwareWorkItemExecutor.execute(DefaultTaskExecutionGraph.java:277)
at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$BuildOperationAwareWorkItemExecutor.execute(DefaultTaskExecutionGraph.java:262)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:135)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:130)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.execute(DefaultTaskPlanExecutor.java:200)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.executeWithWork(DefaultTaskPlanExecutor.java:191)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.run(DefaultTaskPlanExecutor.java:130)
at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)
at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)
Caused by: org.gradle.api.GradleException: There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
at org.gradle.api.tasks.testing.AbstractTestTask.handleTestFailures(AbstractTestTask.java:612)
at org.gradle.api.tasks.testing.AbstractTestTask.executeTests(AbstractTestTask.java:484)
at org.gradle.api.tasks.testing.Test.executeTests(Test.java:603)
at org.gradle.internal.reflect.JavaMethod.invoke(JavaMethod.java:73)
at org.gradle.api.internal.project.taskfactory.StandardTaskAction.doExecute(StandardTaskAction.java:46)
at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:39)
at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:26)
at org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:801)
at org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:768)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$1.run(ExecuteActionsTaskExecuter.java:131)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:300)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:292)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:174)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:90)
at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeAction(ExecuteActionsTaskExecuter.java:120)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:99)
... 33 more
* Get more help at https://help.gradle.org
BUILD FAILED in 14s
2018-12-19 19:05:13,912 6ab9f084 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 719, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 580, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-12-19 19:05:13,913 6ab9f084 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-12-19 19:05:13,914 6ab9f084 MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/config-beam-performancetests-manyfiles-textioit-hdfs-6> delete -f <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml> --ignore-not-found
2018-12-19 19:07:05,521 6ab9f084 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 860, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 719, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 580, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-12-19 19:07:05,522 6ab9f084 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-12-19 19:07:05,522 6ab9f084 MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-12-19 19:07:05,522 6ab9f084 MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/runs/6ab9f084/pkb.log>
2018-12-19 19:07:05,522 6ab9f084 MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/runs/6ab9f084/completion_statuses.json>
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #9
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/9/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #8
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/8/display/redirect>
------------------------------------------
[...truncated 134.97 KB...]
> Task :beam-sdks-java-io-hadoop-file-system:shadowTestJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-hadoop-file-system:shadowTestJar' is d3bd0bf816a762889f618fb03a4c7ced
Caching disabled for task ':beam-sdks-java-io-hadoop-file-system:shadowTestJar': Caching has not been enabled for the task
Skipping task ':beam-sdks-java-io-hadoop-file-system:shadowTestJar' as it is up-to-date.
:beam-sdks-java-io-hadoop-file-system:shadowTestJar (Thread[Daemon worker,5,main]) completed. Took 0.01 secs.
> Task :beam-runners-core-java:shadowTestJar UP-TO-DATE
Build cache key for task ':beam-runners-core-java:shadowTestJar' is 7ea5d830848f00bd6e7b7752500c6ca8
Caching disabled for task ':beam-runners-core-java:shadowTestJar': Caching has not been enabled for the task
Skipping task ':beam-runners-core-java:shadowTestJar' as it is up-to-date.
:beam-runners-core-java:shadowTestJar (Thread[Task worker for ':' Thread 6,5,main]) completed. Took 0.009 secs.
:beam-runners-direct-java:compileTestJava (Thread[Task worker for ':' Thread 6,5,main]) started.
> Task :beam-sdks-java-io-google-cloud-platform:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:compileTestJava' is fab90308bab76a92c3cad9c8948838ef
Skipping task ':beam-sdks-java-io-google-cloud-platform:compileTestJava' as it is up-to-date.
:beam-sdks-java-io-google-cloud-platform:compileTestJava (Thread[Task worker for ':' Thread 5,5,main]) completed. Took 0.108 secs.
:beam-sdks-java-io-google-cloud-platform:testClasses (Thread[Task worker for ':' Thread 5,5,main]) started.
> Task :beam-sdks-java-io-google-cloud-platform:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-io-google-cloud-platform:testClasses' as it has no actions.
:beam-sdks-java-io-google-cloud-platform:testClasses (Thread[Task worker for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:shadowTestJar (Thread[Task worker for ':' Thread 15,5,main]) started.
> Task :beam-runners-direct-java:compileTestJava UP-TO-DATE
Build cache key for task ':beam-runners-direct-java:compileTestJava' is 6d1a41e9ad4d29de4e621100ea814c8c
Skipping task ':beam-runners-direct-java:compileTestJava' as it is up-to-date.
:beam-runners-direct-java:compileTestJava (Thread[Task worker for ':' Thread 6,5,main]) completed. Took 0.092 secs.
:beam-runners-direct-java:testClasses (Thread[Task worker for ':' Thread 6,5,main]) started.
> Task :beam-runners-direct-java:testClasses UP-TO-DATE
Skipping task ':beam-runners-direct-java:testClasses' as it has no actions.
:beam-runners-direct-java:testClasses (Thread[Task worker for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:beam-runners-direct-java:shadowTestJar (Thread[Task worker for ':' Thread 6,5,main]) started.
> Task :beam-sdks-java-io-google-cloud-platform:shadowTestJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowTestJar' is 3957015afa3a1883ff812a04b2cb45b0
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowTestJar': Caching has not been enabled for the task
Skipping task ':beam-sdks-java-io-google-cloud-platform:shadowTestJar' as it is up-to-date.
:beam-sdks-java-io-google-cloud-platform:shadowTestJar (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 0.023 secs.
> Task :beam-runners-direct-java:shadowTestJar UP-TO-DATE
Build cache key for task ':beam-runners-direct-java:shadowTestJar' is 6be1f30b6a1e370803f648c218ef4775
Caching disabled for task ':beam-runners-direct-java:shadowTestJar': Caching has not been enabled for the task
Skipping task ':beam-runners-direct-java:shadowTestJar' as it is up-to-date.
:beam-runners-direct-java:shadowTestJar (Thread[Task worker for ':' Thread 6,5,main]) completed. Took 0.021 secs.
:beam-runners-google-cloud-dataflow-java:compileTestJava (Thread[Task worker for ':' Thread 15,5,main]) started.
:beam-sdks-java-test-utils:compileTestJava (Thread[Task worker for ':' Thread 6,5,main]) started.
> Task :beam-sdks-java-test-utils:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-test-utils:compileTestJava' is 319966cfb9fd19f85151c8cf26879f8d
Skipping task ':beam-sdks-java-test-utils:compileTestJava' as it is up-to-date.
:beam-sdks-java-test-utils:compileTestJava (Thread[Task worker for ':' Thread 6,5,main]) completed. Took 0.022 secs.
:beam-sdks-java-test-utils:testClasses (Thread[Task worker for ':' Thread 7,5,main]) started.
> Task :beam-sdks-java-test-utils:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-test-utils:testClasses' as it has no actions.
:beam-sdks-java-test-utils:testClasses (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-test-utils:shadowTestJar (Thread[Task worker for ':' Thread 7,5,main]) started.
> Task :beam-sdks-java-test-utils:shadowTestJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-test-utils:shadowTestJar' is 760894dba89b7a8bbcb804409842529d
Caching disabled for task ':beam-sdks-java-test-utils:shadowTestJar': Caching has not been enabled for the task
Skipping task ':beam-sdks-java-test-utils:shadowTestJar' as it is up-to-date.
:beam-sdks-java-test-utils:shadowTestJar (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 0.008 secs.
> Task :beam-runners-google-cloud-dataflow-java:compileTestJava UP-TO-DATE
Build cache key for task ':beam-runners-google-cloud-dataflow-java:compileTestJava' is 5a733a93e47364ab70dd9504e9b2c74b
Skipping task ':beam-runners-google-cloud-dataflow-java:compileTestJava' as it is up-to-date.
:beam-runners-google-cloud-dataflow-java:compileTestJava (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 0.043 secs.
:beam-runners-google-cloud-dataflow-java:testClasses (Thread[Task worker for ':' Thread 15,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':beam-runners-google-cloud-dataflow-java:testClasses' as it has no actions.
:beam-runners-google-cloud-dataflow-java:testClasses (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 0.0 secs.
:beam-runners-google-cloud-dataflow-java:shadowTestJar (Thread[Task worker for ':' Thread 2,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:shadowTestJar UP-TO-DATE
Build cache key for task ':beam-runners-google-cloud-dataflow-java:shadowTestJar' is a8623c9db7bc4b6a75ad4f3fa5950326
Caching disabled for task ':beam-runners-google-cloud-dataflow-java:shadowTestJar': Caching has not been enabled for the task
Skipping task ':beam-runners-google-cloud-dataflow-java:shadowTestJar' as it is up-to-date.
:beam-runners-google-cloud-dataflow-java:shadowTestJar (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.014 secs.
:beam-sdks-java-io-file-based-io-tests:compileTestJava (Thread[Task worker for ':' Thread 2,5,main]) started.
> Task :beam-sdks-java-io-file-based-io-tests:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-file-based-io-tests:compileTestJava' is 41336710dd3fcc59f9cc82a6ee02f2a0
Skipping task ':beam-sdks-java-io-file-based-io-tests:compileTestJava' as it is up-to-date.
:beam-sdks-java-io-file-based-io-tests:compileTestJava (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.054 secs.
:beam-sdks-java-io-file-based-io-tests:testClasses (Thread[Task worker for ':' Thread 2,5,main]) started.
> Task :beam-sdks-java-io-file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-io-file-based-io-tests:testClasses' as it has no actions.
:beam-sdks-java-io-file-based-io-tests:testClasses (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-file-based-io-tests:integrationTest (Thread[Task worker for ':' Thread 15,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :beam-sdks-java-io-file-based-io-tests:integrationTest
Build cache key for task ':beam-sdks-java-io-file-based-io-tests:integrationTest' is 437143772883b6af977461bd7d525fc1
Task ':beam-sdks-java-io-file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Not loading task ':beam-sdks-java-io-file-based-io-tests:integrationTest' from cache because loading from cache is disabled for this task
Starting process 'Gradle Test Executor 1'. Working directory: <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/local/asfpackages/java/jdk1.8.0_172/bin/java -DbeamTestPipelineOptions=["--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--numberOfRecords=1000000","--numShards=1000","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs://35.202.16.103:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://35.202.16.103:9000/TEXTIO_IT_","--runner=TestDataflowRunner","--workerHarnessContainerImage=","--dataflowWorkerJar=${dataflowWorkerJar}"] -Djava.security.manager=worker.org.gradle.process.internal.worker.child.BootstrapSecurityManager -Dorg.gradle.native=false -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/4.10.2/workerMain/gradle-worker.jar worker.org.gradle.process.internal.worker.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.25/bccda40ebc8067491b32a88f49615a747d20082d/slf4j-jdk14-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.25/110cefe2df103412849d72ef7a67e4e91e4266b4/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.25/8dacf9514f0c707cbbcdd6fd699e8940d42fb54e/slf4j-simple-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :beam-sdks-java-io-file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numShards'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1531)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:111)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:294)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:451)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:41)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:87)
Finished generating test XML results (0.011 secs) into: <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.024 secs) into: <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:beam-sdks-java-io-file-based-io-tests:integrationTest (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 2.391 secs.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
92 actionable tasks: 1 executed, 91 up-to-date
Publishing build scan...
https://gradle.com/s/6pcymljvw6rf6
STDERR:
1 test completed, 1 failed
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-io-file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
Run with --debug option to get more log output. Run with --scan to get full insights.
* Exception is:
org.gradle.api.tasks.TaskExecutionException: Execution failed for task ':beam-sdks-java-io-file-based-io-tests:integrationTest'.
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:110)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.execute(ExecuteActionsTaskExecuter.java:77)
at org.gradle.api.internal.tasks.execution.OutputDirectoryCreatingTaskExecuter.execute(OutputDirectoryCreatingTaskExecuter.java:51)
at org.gradle.api.internal.tasks.execution.SkipCachedTaskExecuter.execute(SkipCachedTaskExecuter.java:105)
at org.gradle.api.internal.tasks.execution.SkipUpToDateTaskExecuter.execute(SkipUpToDateTaskExecuter.java:59)
at org.gradle.api.internal.tasks.execution.ResolveTaskOutputCachingStateExecuter.execute(ResolveTaskOutputCachingStateExecuter.java:54)
at org.gradle.api.internal.tasks.execution.ResolveBuildCacheKeyExecuter.execute(ResolveBuildCacheKeyExecuter.java:79)
at org.gradle.api.internal.tasks.execution.ValidatingTaskExecuter.execute(ValidatingTaskExecuter.java:59)
at org.gradle.api.internal.tasks.execution.SkipEmptySourceFilesTaskExecuter.execute(SkipEmptySourceFilesTaskExecuter.java:101)
at org.gradle.api.internal.tasks.execution.FinalizeInputFilePropertiesTaskExecuter.execute(FinalizeInputFilePropertiesTaskExecuter.java:44)
at org.gradle.api.internal.tasks.execution.CleanupStaleOutputsExecuter.execute(CleanupStaleOutputsExecuter.java:91)
at org.gradle.api.internal.tasks.execution.ResolveTaskArtifactStateTaskExecuter.execute(ResolveTaskArtifactStateTaskExecuter.java:62)
at org.gradle.api.internal.tasks.execution.SkipTaskWithNoActionsExecuter.execute(SkipTaskWithNoActionsExecuter.java:59)
at org.gradle.api.internal.tasks.execution.SkipOnlyIfTaskExecuter.execute(SkipOnlyIfTaskExecuter.java:54)
at org.gradle.api.internal.tasks.execution.ExecuteAtMostOnceTaskExecuter.execute(ExecuteAtMostOnceTaskExecuter.java:43)
at org.gradle.api.internal.tasks.execution.CatchExceptionTaskExecuter.execute(CatchExceptionTaskExecuter.java:34)
at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter$1.run(EventFiringTaskExecuter.java:51)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:300)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:292)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:174)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:90)
at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31)
at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter.execute(EventFiringTaskExecuter.java:46)
at org.gradle.execution.taskgraph.LocalTaskInfoExecutor.execute(LocalTaskInfoExecutor.java:42)
at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$BuildOperationAwareWorkItemExecutor.execute(DefaultTaskExecutionGraph.java:277)
at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$BuildOperationAwareWorkItemExecutor.execute(DefaultTaskExecutionGraph.java:262)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:135)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:130)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.execute(DefaultTaskPlanExecutor.java:200)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.executeWithWork(DefaultTaskPlanExecutor.java:191)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.run(DefaultTaskPlanExecutor.java:130)
at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)
at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)
Caused by: org.gradle.api.GradleException: There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
at org.gradle.api.tasks.testing.AbstractTestTask.handleTestFailures(AbstractTestTask.java:612)
at org.gradle.api.tasks.testing.AbstractTestTask.executeTests(AbstractTestTask.java:484)
at org.gradle.api.tasks.testing.Test.executeTests(Test.java:603)
at org.gradle.internal.reflect.JavaMethod.invoke(JavaMethod.java:73)
at org.gradle.api.internal.project.taskfactory.StandardTaskAction.doExecute(StandardTaskAction.java:46)
at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:39)
at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:26)
at org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:801)
at org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:768)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$1.run(ExecuteActionsTaskExecuter.java:131)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:300)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:292)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:174)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:90)
at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeAction(ExecuteActionsTaskExecuter.java:120)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:99)
... 33 more
* Get more help at https://help.gradle.org
BUILD FAILED in 14s
2019-01-02 21:36:14,265 fc5b44c1 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 719, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 580, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-01-02 21:36:14,266 fc5b44c1 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2019-01-02 21:36:14,266 fc5b44c1 MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/config-beam-performancetests-manyfiles-textioit-hdfs-8> delete -f <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml> --ignore-not-found
2019-01-02 21:37:54,757 fc5b44c1 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 860, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 719, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 580, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-01-02 21:37:54,758 fc5b44c1 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2019-01-02 21:37:54,758 fc5b44c1 MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2019-01-02 21:37:54,758 fc5b44c1 MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/runs/fc5b44c1/pkb.log>
2019-01-02 21:37:54,758 fc5b44c1 MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/runs/fc5b44c1/completion_statuses.json>
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_PerformanceTests_ManyFiles_TextIOIT_HDFS #7
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/7/display/redirect?page=changes>
Changes:
[ankurgoenka] [BEAM-6179] Fixing itterable comparison
[github] Fix whitespace.
[robbe.sneyders] Python 3 port io.filesystem module
[theosiu] Fix documentation for PCollection Type in XMLIO example
[scott] Rename v1_13_1 to v1p13p1.
[scott] Depend on local vendored jar instead of the one from Maven
[scott] Disable 'jar' task for vendoring projects.
[kenn] [BEAM-6268] Ignore failed HadoopFormatIOCassandraTest (#7325)
[melissapa] [BEAM-6273] Update dependencies pages with 2.9.0
------------------------------------------
[...truncated 127.60 KB...]
:beam-sdks-java-extensions-google-cloud-platform-core:shadowTestJar (Thread[Task worker for ':' Thread 2,5,main]) started.
> Task :beam-sdks-java-io-parquet:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-parquet:compileTestJava' is c7580344424b2dc69a7d8213f6b714d6
Skipping task ':beam-sdks-java-io-parquet:compileTestJava' as it is up-to-date.
:beam-sdks-java-io-parquet:compileTestJava (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 0.038 secs.
:beam-sdks-java-io-parquet:testClasses (Thread[Task worker for ':' Thread 11,5,main]) started.
> Task :beam-sdks-java-io-parquet:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-io-parquet:testClasses' as it has no actions.
:beam-sdks-java-io-parquet:testClasses (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-parquet:shadowTestJar (Thread[Task worker for ':' Thread 11,5,main]) started.
> Task :beam-sdks-java-io-hadoop-file-system:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-hadoop-file-system:compileTestJava' is f64948915ef60b65eee14e4ceef10265
Skipping task ':beam-sdks-java-io-hadoop-file-system:compileTestJava' as it is up-to-date.
:beam-sdks-java-io-hadoop-file-system:compileTestJava (Thread[Task worker for ':' Thread 8,5,main]) completed. Took 0.042 secs.
:beam-sdks-java-io-hadoop-file-system:testClasses (Thread[Task worker for ':' Thread 8,5,main]) started.
> Task :beam-sdks-java-io-hadoop-file-system:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-io-hadoop-file-system:testClasses' as it has no actions.
:beam-sdks-java-io-hadoop-file-system:testClasses (Thread[Task worker for ':' Thread 8,5,main]) completed. Took 0.0 secs.
> Task :beam-sdks-java-io-xml:shadowTestJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-xml:shadowTestJar' is 5bdbfe29f0ff628965392d36e44d4421
Caching disabled for task ':beam-sdks-java-io-xml:shadowTestJar': Caching has not been enabled for the task
Skipping task ':beam-sdks-java-io-xml:shadowTestJar' as it is up-to-date.
:beam-sdks-java-io-hadoop-file-system:shadowTestJar (Thread[Task worker for ':' Thread 8,5,main]) started.
:beam-sdks-java-io-xml:shadowTestJar (Thread[Task worker for ':',5,main]) completed. Took 0.008 secs.
> Task :beam-sdks-java-extensions-google-cloud-platform-core:shadowTestJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-extensions-google-cloud-platform-core:shadowTestJar' is 70e1b073d5fd1eb0096b5374f6f0d490
Caching disabled for task ':beam-sdks-java-extensions-google-cloud-platform-core:shadowTestJar': Caching has not been enabled for the task
Skipping task ':beam-sdks-java-extensions-google-cloud-platform-core:shadowTestJar' as it is up-to-date.
:beam-sdks-java-extensions-google-cloud-platform-core:shadowTestJar (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.006 secs.
:beam-sdks-java-io-google-cloud-platform:compileTestJava (Thread[Task worker for ':' Thread 2,5,main]) started.
> Task :beam-sdks-java-io-parquet:shadowTestJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-parquet:shadowTestJar' is 506294dbcc108ec401c605fec0fc7e87
Caching disabled for task ':beam-sdks-java-io-parquet:shadowTestJar': Caching has not been enabled for the task
Skipping task ':beam-sdks-java-io-parquet:shadowTestJar' as it is up-to-date.
:beam-sdks-java-io-parquet:shadowTestJar (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 0.008 secs.
> Task :beam-sdks-java-io-hadoop-file-system:shadowTestJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-hadoop-file-system:shadowTestJar' is 68f9354060a5a3e35b5bd606efb409a1
Caching disabled for task ':beam-sdks-java-io-hadoop-file-system:shadowTestJar': Caching has not been enabled for the task
Skipping task ':beam-sdks-java-io-hadoop-file-system:shadowTestJar' as it is up-to-date.
:beam-sdks-java-io-hadoop-file-system:shadowTestJar (Thread[Task worker for ':' Thread 8,5,main]) completed. Took 0.012 secs.
> Task :beam-sdks-java-io-google-cloud-platform:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:compileTestJava' is c9f6ba02219311b13789b28f12aecf27
Skipping task ':beam-sdks-java-io-google-cloud-platform:compileTestJava' as it is up-to-date.
:beam-sdks-java-io-google-cloud-platform:compileTestJava (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.063 secs.
:beam-sdks-java-io-google-cloud-platform:testClasses (Thread[Task worker for ':' Thread 2,5,main]) started.
> Task :beam-sdks-java-io-google-cloud-platform:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-io-google-cloud-platform:testClasses' as it has no actions.
:beam-sdks-java-io-google-cloud-platform:testClasses (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:shadowTestJar (Thread[Task worker for ':' Thread 2,5,main]) started.
> Task :beam-sdks-java-io-google-cloud-platform:shadowTestJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowTestJar' is a7ffbb49e6bb8038f9bb784502a9958b
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowTestJar': Caching has not been enabled for the task
Skipping task ':beam-sdks-java-io-google-cloud-platform:shadowTestJar' as it is up-to-date.
:beam-sdks-java-io-google-cloud-platform:shadowTestJar (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.014 secs.
:beam-runners-google-cloud-dataflow-java:compileTestJava (Thread[Task worker for ':' Thread 2,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:compileTestJava UP-TO-DATE
Build cache key for task ':beam-runners-google-cloud-dataflow-java:compileTestJava' is 08d8d5be3e77f9a70bd2121cb0299dc8
Skipping task ':beam-runners-google-cloud-dataflow-java:compileTestJava' as it is up-to-date.
:beam-runners-google-cloud-dataflow-java:compileTestJava (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.049 secs.
:beam-runners-google-cloud-dataflow-java:testClasses (Thread[Task worker for ':' Thread 2,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':beam-runners-google-cloud-dataflow-java:testClasses' as it has no actions.
:beam-runners-google-cloud-dataflow-java:testClasses (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:beam-runners-google-cloud-dataflow-java:shadowTestJar (Thread[Task worker for ':' Thread 2,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:shadowTestJar UP-TO-DATE
Build cache key for task ':beam-runners-google-cloud-dataflow-java:shadowTestJar' is 53f1e8883dd5b76cc114ebff0b4e47ad
Caching disabled for task ':beam-runners-google-cloud-dataflow-java:shadowTestJar': Caching has not been enabled for the task
Skipping task ':beam-runners-google-cloud-dataflow-java:shadowTestJar' as it is up-to-date.
:beam-runners-google-cloud-dataflow-java:shadowTestJar (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.017 secs.
:beam-sdks-java-io-file-based-io-tests:compileTestJava (Thread[Task worker for ':' Thread 2,5,main]) started.
> Task :beam-sdks-java-io-file-based-io-tests:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-file-based-io-tests:compileTestJava' is 82253130f27b3b5aacc6f8a485164704
Skipping task ':beam-sdks-java-io-file-based-io-tests:compileTestJava' as it is up-to-date.
:beam-sdks-java-io-file-based-io-tests:compileTestJava (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.067 secs.
:beam-sdks-java-io-file-based-io-tests:testClasses (Thread[Task worker for ':' Thread 2,5,main]) started.
> Task :beam-sdks-java-io-file-based-io-tests:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-io-file-based-io-tests:testClasses' as it has no actions.
:beam-sdks-java-io-file-based-io-tests:testClasses (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-file-based-io-tests:integrationTest (Thread[Task worker for ':' Thread 2,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :beam-sdks-java-io-file-based-io-tests:integrationTest
Build cache key for task ':beam-sdks-java-io-file-based-io-tests:integrationTest' is a19d3ed8ba545fd9a675faa5d1c1b23b
Task ':beam-sdks-java-io-file-based-io-tests:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Not loading task ':beam-sdks-java-io-file-based-io-tests:integrationTest' from cache because loading from cache is disabled for this task
Starting process 'Gradle Test Executor 1'. Working directory: <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests> Command: /usr/local/asfpackages/java/jdk1.8.0_172/bin/java -DbeamTestPipelineOptions=["--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--numberOfRecords=1000000","--numShards=1000","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs://104.154.145.232:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://104.154.145.232:9000/TEXTIO_IT_","--runner=TestDataflowRunner","--workerHarnessContainerImage=","--dataflowWorkerJar=${dataflowWorkerJar}"] -Djava.security.manager=worker.org.gradle.process.internal.worker.child.BootstrapSecurityManager -Dorg.gradle.native=false -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/4.10.2/workerMain/gradle-worker.jar worker.org.gradle.process.internal.worker.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.text.TextIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.25/bccda40ebc8067491b32a88f49615a747d20082d/slf4j-jdk14-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.25/110cefe2df103412849d72ef7a67e4e91e4266b4/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :beam-sdks-java-io-file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.text.TextIOIT > classMethod FAILED
java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.testing.TestPipelineOptions missing a property named 'numShards'.
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1531)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:111)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:294)
at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:451)
at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48)
at org.apache.beam.sdk.io.common.FileBasedIOITHelper.readFileBasedIOITPipelineOptions(FileBasedIOITHelper.java:41)
at org.apache.beam.sdk.io.text.TextIOIT.setup(TextIOIT.java:75)
Finished generating test XML results (0.011 secs) into: <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.023 secs) into: <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:beam-sdks-java-io-file-based-io-tests:integrationTest (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 2.25 secs.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
85 actionable tasks: 1 executed, 84 up-to-date
Publishing build scan...
https://gradle.com/s/7za6olnoemrgq
STDERR:
1 test completed, 1 failed
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-io-file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
Run with --debug option to get more log output. Run with --scan to get full insights.
* Exception is:
org.gradle.api.tasks.TaskExecutionException: Execution failed for task ':beam-sdks-java-io-file-based-io-tests:integrationTest'.
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:110)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.execute(ExecuteActionsTaskExecuter.java:77)
at org.gradle.api.internal.tasks.execution.OutputDirectoryCreatingTaskExecuter.execute(OutputDirectoryCreatingTaskExecuter.java:51)
at org.gradle.api.internal.tasks.execution.SkipCachedTaskExecuter.execute(SkipCachedTaskExecuter.java:105)
at org.gradle.api.internal.tasks.execution.SkipUpToDateTaskExecuter.execute(SkipUpToDateTaskExecuter.java:59)
at org.gradle.api.internal.tasks.execution.ResolveTaskOutputCachingStateExecuter.execute(ResolveTaskOutputCachingStateExecuter.java:54)
at org.gradle.api.internal.tasks.execution.ResolveBuildCacheKeyExecuter.execute(ResolveBuildCacheKeyExecuter.java:79)
at org.gradle.api.internal.tasks.execution.ValidatingTaskExecuter.execute(ValidatingTaskExecuter.java:59)
at org.gradle.api.internal.tasks.execution.SkipEmptySourceFilesTaskExecuter.execute(SkipEmptySourceFilesTaskExecuter.java:101)
at org.gradle.api.internal.tasks.execution.FinalizeInputFilePropertiesTaskExecuter.execute(FinalizeInputFilePropertiesTaskExecuter.java:44)
at org.gradle.api.internal.tasks.execution.CleanupStaleOutputsExecuter.execute(CleanupStaleOutputsExecuter.java:91)
at org.gradle.api.internal.tasks.execution.ResolveTaskArtifactStateTaskExecuter.execute(ResolveTaskArtifactStateTaskExecuter.java:62)
at org.gradle.api.internal.tasks.execution.SkipTaskWithNoActionsExecuter.execute(SkipTaskWithNoActionsExecuter.java:59)
at org.gradle.api.internal.tasks.execution.SkipOnlyIfTaskExecuter.execute(SkipOnlyIfTaskExecuter.java:54)
at org.gradle.api.internal.tasks.execution.ExecuteAtMostOnceTaskExecuter.execute(ExecuteAtMostOnceTaskExecuter.java:43)
at org.gradle.api.internal.tasks.execution.CatchExceptionTaskExecuter.execute(CatchExceptionTaskExecuter.java:34)
at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter$1.run(EventFiringTaskExecuter.java:51)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:300)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:292)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:174)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:90)
at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31)
at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter.execute(EventFiringTaskExecuter.java:46)
at org.gradle.execution.taskgraph.LocalTaskInfoExecutor.execute(LocalTaskInfoExecutor.java:42)
at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$BuildOperationAwareWorkItemExecutor.execute(DefaultTaskExecutionGraph.java:277)
at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$BuildOperationAwareWorkItemExecutor.execute(DefaultTaskExecutionGraph.java:262)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:135)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:130)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.execute(DefaultTaskPlanExecutor.java:200)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.executeWithWork(DefaultTaskPlanExecutor.java:191)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.run(DefaultTaskPlanExecutor.java:130)
at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)
at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)
Caused by: org.gradle.api.GradleException: There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
at org.gradle.api.tasks.testing.AbstractTestTask.handleTestFailures(AbstractTestTask.java:612)
at org.gradle.api.tasks.testing.AbstractTestTask.executeTests(AbstractTestTask.java:484)
at org.gradle.api.tasks.testing.Test.executeTests(Test.java:603)
at org.gradle.internal.reflect.JavaMethod.invoke(JavaMethod.java:73)
at org.gradle.api.internal.project.taskfactory.StandardTaskAction.doExecute(StandardTaskAction.java:46)
at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:39)
at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:26)
at org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:801)
at org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:768)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$1.run(ExecuteActionsTaskExecuter.java:131)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:300)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:292)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:174)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:90)
at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeAction(ExecuteActionsTaskExecuter.java:120)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:99)
... 33 more
* Get more help at https://help.gradle.org
BUILD FAILED in 14s
2018-12-20 13:02:08,327 bd8ef853 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 719, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 580, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-12-20 13:02:08,328 bd8ef853 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-12-20 13:02:08,329 bd8ef853 MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/config-beam-performancetests-manyfiles-textioit-hdfs-7> delete -f <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml> --ignore-not-found
2018-12-20 13:03:55,826 bd8ef853 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 860, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 719, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 580, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-12-20 13:03:55,826 bd8ef853 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-12-20 13:03:55,827 bd8ef853 MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-12-20 13:03:55,827 bd8ef853 MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/runs/bd8ef853/pkb.log>
2018-12-20 13:03:55,827 bd8ef853 MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT_HDFS/ws/runs/bd8ef853/completion_statuses.json>
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org