You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/12/11 06:12:53 UTC

Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #1008

See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/1008/display/redirect?page=changes>

Changes:

[heejong] [BEAM-5514] BigQueryIO doesn't handle quotaExceeded errors properly

------------------------------------------
[...truncated 174.56 KB...]
:beam-runners-google-cloud-dataflow-java-windmill:processResources (Thread[Task worker for ':' Thread 11,5,main]) started.

> Task :beam-runners-google-cloud-dataflow-java-windmill:processResources UP-TO-DATE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/worker/windmill/src/main/resources',> not found
Build cache key for task ':beam-runners-google-cloud-dataflow-java-windmill:processResources' is b971170178e93397723c23bedaf161ac
Caching disabled for task ':beam-runners-google-cloud-dataflow-java-windmill:processResources': Caching has not been enabled for the task
Skipping task ':beam-runners-google-cloud-dataflow-java-windmill:processResources' as it is up-to-date.
:beam-runners-google-cloud-dataflow-java-windmill:processResources (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 0.003 secs.
:beam-runners-google-cloud-dataflow-java-windmill:classes (Thread[Task worker for ':' Thread 12,5,main]) started.

> Task :beam-runners-google-cloud-dataflow-java-windmill:classes UP-TO-DATE
Skipping task ':beam-runners-google-cloud-dataflow-java-windmill:classes' as it has no actions.
:beam-runners-google-cloud-dataflow-java-windmill:classes (Thread[Task worker for ':' Thread 12,5,main]) completed. Took 0.0 secs.
:beam-runners-google-cloud-dataflow-java-windmill:shadowJar (Thread[Task worker for ':' Thread 12,5,main]) started.

> Task :beam-model-pipeline:compileJava UP-TO-DATE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/model/pipeline/src/main/java',> not found
Build cache key for task ':beam-model-pipeline:compileJava' is 9243392b0ae57c52f826d10605d05877
Skipping task ':beam-model-pipeline:compileJava' as it is up-to-date.
:beam-model-pipeline:compileJava (Thread[Task worker for ':',5,main]) completed. Took 0.204 secs.
:beam-model-pipeline:processResources (Thread[Task worker for ':',5,main]) started.

> Task :beam-runners-google-cloud-dataflow-java-windmill:shadowJar UP-TO-DATE
Build cache key for task ':beam-runners-google-cloud-dataflow-java-windmill:shadowJar' is e120afc2ee89d2348906050bd3b5d87d
Caching disabled for task ':beam-runners-google-cloud-dataflow-java-windmill:shadowJar': Caching has not been enabled for the task
Skipping task ':beam-runners-google-cloud-dataflow-java-windmill:shadowJar' as it is up-to-date.
:beam-runners-google-cloud-dataflow-java-windmill:shadowJar (Thread[Task worker for ':' Thread 12,5,main]) completed. Took 0.014 secs.

> Task :beam-model-pipeline:processResources UP-TO-DATE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/model/pipeline/src/main/resources',> not found
Build cache key for task ':beam-model-pipeline:processResources' is 685e5601acff5bafe5e085c6d5575ccc
Caching disabled for task ':beam-model-pipeline:processResources': Caching has not been enabled for the task
Skipping task ':beam-model-pipeline:processResources' as it is up-to-date.
:beam-model-pipeline:processResources (Thread[Task worker for ':',5,main]) completed. Took 0.003 secs.
:beam-model-pipeline:classes (Thread[Task worker for ':',5,main]) started.

> Task :beam-model-pipeline:classes UP-TO-DATE
Skipping task ':beam-model-pipeline:classes' as it has no actions.
:beam-model-pipeline:classes (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs.
:beam-model-pipeline:jar (Thread[Task worker for ':',5,main]) started.

> Task :beam-model-pipeline:jar UP-TO-DATE
Build cache key for task ':beam-model-pipeline:jar' is a0f0dac0a7a456df29f65840c6ac70d1
Caching disabled for task ':beam-model-pipeline:jar': Caching has not been enabled for the task
Skipping task ':beam-model-pipeline:jar' as it is up-to-date.
:beam-model-pipeline:jar (Thread[Task worker for ':',5,main]) completed. Took 0.024 secs.
:beam-model-job-management:extractIncludeProto (Thread[Task worker for ':',5,main]) started.
:beam-model-pipeline:shadowJar (Thread[Task worker for ':' Thread 10,5,main]) started.
:beam-model-fn-execution:extractIncludeProto (Thread[Task worker for ':' Thread 3,5,main]) started.

> Task :beam-model-pipeline:shadowJar UP-TO-DATE
Build cache key for task ':beam-model-pipeline:shadowJar' is aede88e9d50758e6e238674339bb8167
Caching disabled for task ':beam-model-pipeline:shadowJar': Caching has not been enabled for the task
Skipping task ':beam-model-pipeline:shadowJar' as it is up-to-date.
:beam-model-pipeline:shadowJar (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.015 secs.
:beam-sdks-java-core:compileJava (Thread[Task worker for ':' Thread 10,5,main]) started.

> Task :beam-model-job-management:extractIncludeProto UP-TO-DATE
Build cache key for task ':beam-model-job-management:extractIncludeProto' is 7407d43a2a12ec84bbfbe8cc0ceb0c65
Caching disabled for task ':beam-model-job-management:extractIncludeProto': Caching has not been enabled for the task
Skipping task ':beam-model-job-management:extractIncludeProto' as it is up-to-date.
:beam-model-job-management:extractIncludeProto (Thread[Task worker for ':',5,main]) completed. Took 0.019 secs.
:beam-model-job-management:generateProto (Thread[Task worker for ':',5,main]) started.

> Task :beam-model-fn-execution:extractIncludeProto UP-TO-DATE
Build cache key for task ':beam-model-fn-execution:extractIncludeProto' is 7407d43a2a12ec84bbfbe8cc0ceb0c65
Caching disabled for task ':beam-model-fn-execution:extractIncludeProto': Caching has not been enabled for the task
Skipping task ':beam-model-fn-execution:extractIncludeProto' as it is up-to-date.
:beam-model-fn-execution:extractIncludeProto (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.019 secs.
:beam-model-fn-execution:generateProto (Thread[Task worker for ':' Thread 3,5,main]) started.

> Task :beam-model-fn-execution:generateProto UP-TO-DATE
Build cache key for task ':beam-model-fn-execution:generateProto' is c4449d48a1f20273c49697a385c865c3
Caching disabled for task ':beam-model-fn-execution:generateProto': Caching has not been enabled for the task
Skipping task ':beam-model-fn-execution:generateProto' as it is up-to-date.
:beam-model-fn-execution:generateProto (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.013 secs.

> Task :beam-model-job-management:generateProto UP-TO-DATE
Build cache key for task ':beam-model-job-management:generateProto' is 22497607797bb478f407eca5cb15a870
Caching disabled for task ':beam-model-job-management:generateProto': Caching has not been enabled for the task
Skipping task ':beam-model-job-management:generateProto' as it is up-to-date.
:beam-model-job-management:generateProto (Thread[Task worker for ':',5,main]) completed. Took 0.014 secs.
:beam-model-fn-execution:compileJava (Thread[Task worker for ':' Thread 3,5,main]) started.
:beam-model-job-management:compileJava (Thread[Task worker for ':',5,main]) started.

> Task :beam-model-job-management:compileJava UP-TO-DATE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/model/job-management/src/main/java',> not found
Build cache key for task ':beam-model-job-management:compileJava' is a4a94869d75d61bd2ec250b1a5f8ed7d
Skipping task ':beam-model-job-management:compileJava' as it is up-to-date.
:beam-model-job-management:compileJava (Thread[Task worker for ':',5,main]) completed. Took 0.029 secs.
:beam-model-job-management:classes (Thread[Task worker for ':',5,main]) started.

> Task :beam-model-job-management:classes UP-TO-DATE
Skipping task ':beam-model-job-management:classes' as it has no actions.
:beam-model-job-management:classes (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs.
:beam-model-job-management:shadowJar (Thread[Task worker for ':' Thread 15,5,main]) started.

> Task :beam-model-job-management:shadowJar UP-TO-DATE
Build cache key for task ':beam-model-job-management:shadowJar' is c1a98b2d3bb506c4964dd039160f40ce
Caching disabled for task ':beam-model-job-management:shadowJar': Caching has not been enabled for the task
Skipping task ':beam-model-job-management:shadowJar' as it is up-to-date.
:beam-model-job-management:shadowJar (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 0.011 secs.

> Task :beam-model-fn-execution:compileJava UP-TO-DATE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/model/fn-execution/src/main/java',> not found
Build cache key for task ':beam-model-fn-execution:compileJava' is b8f187648f32d19f92b970530bd6e813
Skipping task ':beam-model-fn-execution:compileJava' as it is up-to-date.
:beam-model-fn-execution:compileJava (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.174 secs.
:beam-model-fn-execution:classes (Thread[Task worker for ':' Thread 3,5,main]) started.

> Task :beam-model-fn-execution:classes UP-TO-DATE
Skipping task ':beam-model-fn-execution:classes' as it has no actions.
:beam-model-fn-execution:classes (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:beam-model-fn-execution:shadowJar (Thread[Task worker for ':' Thread 3,5,main]) started.

> Task :beam-model-fn-execution:shadowJar UP-TO-DATE
Build cache key for task ':beam-model-fn-execution:shadowJar' is cd8dbe5cadcd6c3d713ac7f01b39fd14
Caching disabled for task ':beam-model-fn-execution:shadowJar': Caching has not been enabled for the task
Skipping task ':beam-model-fn-execution:shadowJar' as it is up-to-date.
:beam-model-fn-execution:shadowJar (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.01 secs.

> Task :beam-sdks-java-core:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-core:compileJava' is ea10d494e510f943360554a68383eec6
Skipping task ':beam-sdks-java-core:compileJava' as it is up-to-date.
:beam-sdks-java-core:compileJava (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.347 secs.
:beam-sdks-java-core:classes (Thread[Task worker for ':' Thread 10,5,main]) started.

> Task :beam-sdks-java-core:classes UP-TO-DATE
Skipping task ':beam-sdks-java-core:classes' as it has no actions.
:beam-sdks-java-core:classes (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-core:shadowJar (Thread[Task worker for ':' Thread 10,5,main]) started.

> Task :beam-sdks-java-core:shadowJar
Deleting stale output file: <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/java/core/build/libs/beam-sdks-java-core-2.10.0-SNAPSHOT.jar>
Build cache key for task ':beam-sdks-java-core:shadowJar' is 325419c18d50f854fd59251ab35b05d7
Caching disabled for task ':beam-sdks-java-core:shadowJar': Caching has not been enabled for the task
Task ':beam-sdks-java-core:shadowJar' is not up-to-date because:
  No history is available.


STDERR: The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=1217eb80-2ad9-403a-b2bf-0d1798792358, currentDir=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 16314
  log file: /home/jenkins/.gradle/daemon/4.10.2/daemon-16314.out.log
----- Last  20 lines from daemon log file - daemon-16314.out.log -----
:beam-model-fn-execution:classes (Thread[Task worker for ':' Thread 3,5,main]) started.
Skipping task ':beam-model-fn-execution:classes' as it has no actions.
:beam-model-fn-execution:classes (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:beam-model-fn-execution:shadowJar (Thread[Task worker for ':' Thread 3,5,main]) started.
Build cache key for task ':beam-model-fn-execution:shadowJar' is cd8dbe5cadcd6c3d713ac7f01b39fd14
Caching disabled for task ':beam-model-fn-execution:shadowJar': Caching has not been enabled for the task
Skipping task ':beam-model-fn-execution:shadowJar' as it is up-to-date.
:beam-model-fn-execution:shadowJar (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.01 secs.
Build cache key for task ':beam-sdks-java-core:compileJava' is ea10d494e510f943360554a68383eec6
Skipping task ':beam-sdks-java-core:compileJava' as it is up-to-date.
:beam-sdks-java-core:compileJava (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.347 secs.
:beam-sdks-java-core:classes (Thread[Task worker for ':' Thread 10,5,main]) started.
Skipping task ':beam-sdks-java-core:classes' as it has no actions.
:beam-sdks-java-core:classes (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-core:shadowJar (Thread[Task worker for ':' Thread 10,5,main]) started.
Deleting stale output file: <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/java/core/build/libs/beam-sdks-java-core-2.10.0-SNAPSHOT.jar>
Build cache key for task ':beam-sdks-java-core:shadowJar' is 325419c18d50f854fd59251ab35b05d7
Caching disabled for task ':beam-sdks-java-core:shadowJar': Caching has not been enabled for the task
Task ':beam-sdks-java-core:shadowJar' is not up-to-date because:
  No history is available.
----- End of the daemon log -----


FAILURE: Build failed with an exception.

* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed)

* Try:
Run with --debug option to get more log output. Run with --scan to get full insights.

* Exception is:
org.gradle.launcher.daemon.client.DaemonDisappearedException: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed)
	at org.gradle.launcher.daemon.client.DaemonClient.handleDaemonDisappearance(DaemonClient.java:242)
	at org.gradle.launcher.daemon.client.DaemonClient.monitorBuild(DaemonClient.java:218)
	at org.gradle.launcher.daemon.client.DaemonClient.executeBuild(DaemonClient.java:179)
	at org.gradle.launcher.daemon.client.SingleUseDaemonClient.execute(SingleUseDaemonClient.java:54)
	at org.gradle.launcher.daemon.client.SingleUseDaemonClient.execute(SingleUseDaemonClient.java:37)
	at org.gradle.launcher.cli.RunBuildAction.run(RunBuildAction.java:52)
	at org.gradle.internal.Actions$RunnableActionAdapter.execute(Actions.java:207)
	at org.gradle.launcher.cli.CommandLineActionFactory$ParseAndBuildAction.execute(CommandLineActionFactory.java:402)
	at org.gradle.launcher.cli.CommandLineActionFactory$ParseAndBuildAction.execute(CommandLineActionFactory.java:375)
	at org.gradle.launcher.cli.ExceptionReportingAction.execute(ExceptionReportingAction.java:37)
	at org.gradle.launcher.cli.ExceptionReportingAction.execute(ExceptionReportingAction.java:23)
	at org.gradle.launcher.cli.CommandLineActionFactory$WithLogging.execute(CommandLineActionFactory.java:368)
	at org.gradle.launcher.cli.CommandLineActionFactory$WithLogging.execute(CommandLineActionFactory.java:298)
	at org.gradle.launcher.Main.doAction(Main.java:36)
	at org.gradle.launcher.bootstrap.EntryPoint.run(EntryPoint.java:45)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.gradle.launcher.bootstrap.ProcessBootstrap.runNoExit(ProcessBootstrap.java:60)
	at org.gradle.launcher.bootstrap.ProcessBootstrap.run(ProcessBootstrap.java:37)
	at org.gradle.launcher.GradleMain.main(GradleMain.java:23)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.gradle.wrapper.BootstrapMainStarter.start(BootstrapMainStarter.java:31)
	at org.gradle.wrapper.WrapperExecutor.execute(WrapperExecutor.java:108)
	at org.gradle.wrapper.GradleWrapperMain.main(GradleWrapperMain.java:61)


* Get more help at https://help.gradle.org

2018-12-11 06:10:35,084 cec6f831 MainThread beam_integration_benchmark(1/1) ERROR    Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
  File "<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 719, in RunBenchmark
    DoRunPhase(spec, collector, detailed_timer)
  File "<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 580, in DoRunPhase
    samples = spec.BenchmarkRun(spec)
  File "<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
    job_type=job_type)
  File "<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
    assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-12-11 06:10:35,284 cec6f831 MainThread beam_integration_benchmark(1/1) INFO     Cleaning up benchmark beam_integration_benchmark
2018-12-11 06:10:35,285 cec6f831 MainThread beam_integration_benchmark(1/1) INFO     Running: kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-1008> delete -f <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml> --ignore-not-found
2018-12-11 06:12:43,658 cec6f831 MainThread beam_integration_benchmark(1/1) ERROR    Exception running benchmark
Traceback (most recent call last):
  File "<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 860, in RunBenchmarkTask
    RunBenchmark(spec, collector)
  File "<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 719, in RunBenchmark
    DoRunPhase(spec, collector, detailed_timer)
  File "<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 580, in DoRunPhase
    samples = spec.BenchmarkRun(spec)
  File "<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
    job_type=job_type)
  File "<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
    assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-12-11 06:12:43,658 cec6f831 MainThread beam_integration_benchmark(1/1) ERROR    Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-12-11 06:12:43,659 cec6f831 MainThread beam_integration_benchmark(1/1) INFO     Benchmark run statuses:
---------------------------------------------------------------------------------
Name                        UID                          Status  Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark  beam_integration_benchmark0  FAILED                  
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-12-11 06:12:43,659 cec6f831 MainThread beam_integration_benchmark(1/1) INFO     Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/runs/cec6f831/pkb.log>
2018-12-11 06:12:43,659 cec6f831 MainThread beam_integration_benchmark(1/1) INFO     Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/runs/cec6f831/completion_statuses.json>
Build step 'Execute shell' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PerformanceTests_AvroIOIT_HDFS #1009

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/1009/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org