You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/03/05 00:23:33 UTC
Build failed in Jenkins:
beam_PerformanceTests_Compressed_TextIOIT_HDFS #1338
See <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/1338/display/redirect?page=changes>
Changes:
[katarzyna.kucharczyk] [BEAM-5995] Created Jenkins DSL for Python Load Tests
[katarzyna.kucharczyk] [BEAM-5995] Updated Python load tests documentation with gradle run
[katarzyna.kucharczyk] [BEAM-5995] Changed build dir in test gradle for getting sdist package.
[katarzyna.kucharczyk] [BEAM-5995] Extracted enum for SDK. Getting runner dependency by given
[katarzyna.kucharczyk] [BEAM-5995] Used SDK enum to have only one function to run LoadTest task
[github] [BEAM-6768] BigQuery dynamic destinations for Python SDK Streaming
------------------------------------------
[...truncated 24.70 KB...]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.gradle.wrapper.BootstrapMainStarter.start(BootstrapMainStarter.java:31)
at org.gradle.wrapper.WrapperExecutor.execute(WrapperExecutor.java:108)
at org.gradle.wrapper.GradleWrapperMain.main(GradleWrapperMain.java:61)
* Get more help at https://help.gradle.org
2019-03-05 00:20:35,403 64a83480 MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/config-beam-performancetests-compressed-textioit-hdfs-1338> create -f <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml>
2019-03-05 00:20:35,892 64a83480 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2019-03-05 00:20:35,900 64a83480 MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/config-beam-performancetests-compressed-textioit-hdfs-1338> get svc hadoop -ojsonpath={.status.loadBalancer.ingress[0].ip}
2019-03-05 00:20:46,101 64a83480 MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/config-beam-performancetests-compressed-textioit-hdfs-1338> get svc hadoop -ojsonpath={.status.loadBalancer.ingress[0].ip}
2019-03-05 00:20:56,241 64a83480 MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/config-beam-performancetests-compressed-textioit-hdfs-1338> get svc hadoop -ojsonpath={.status.loadBalancer.ingress[0].ip}
2019-03-05 00:21:06,405 64a83480 MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/config-beam-performancetests-compressed-textioit-hdfs-1338> get svc hadoop -ojsonpath={.status.loadBalancer.ingress[0].ip}
2019-03-05 00:21:06,419 64a83480 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 734, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 589, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 149, in Run
dynamic_pipeline_options)
File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_pipeline_options.py",> line 100, in GenerateAllPipelineOptions
EvaluateDynamicPipelineOptions(dynamic_pipeline_options))
File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_pipeline_options.py",> line 67, in EvaluateDynamicPipelineOptions
argValue = RetrieveLoadBalancerIp(optionDescriptor)
File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_pipeline_options.py",> line 151, in RetrieveLoadBalancerIp
'svc', serviceName, '', '.status.loadBalancer.ingress[0].ip')
File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/kubernetes_helper.py",> line 80, in GetWithWaitForContents
ret = Get(resource, resourceInstanceName, filter, jsonFilter)
File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/kubernetes_helper.py",> line 71, in Get
raise Exception("Error received from kubectl get: " + stderr)
Exception: Error received from kubectl get: runtime: failed to create new OS thread (have 3 already; errno=28)
fatal error: newosproc
runtime stack:
runtime.throw(0x1c50a42, 0x9)
/usr/local/go/src/runtime/panic.go:605 +0x95
runtime.newosproc(0xc420044380, 0xc420050000)
/usr/local/go/src/runtime/os_linux.go:164 +0x1ad
runtime.newm(0x1d0ddd8, 0xc420025300)
/usr/local/go/src/runtime/proc.go:1657 +0x158
runtime.startm(0x0, 0x7ffc00000801)
/usr/local/go/src/runtime/proc.go:1728 +0x13f
runtime.wakep()
/usr/local/go/src/runtime/proc.go:1809 +0x48
runtime.newproc1(0x1d0dca8, 0xc420055f48, 0x0, 0x42c4c5, 0x0)
/usr/local/go/src/runtime/proc.go:3038 +0x34a
runtime.newproc.func1()
/usr/local/go/src/runtime/proc.go:2933 +0x51
runtime.systemstack(0x2c0e300)
/usr/local/go/src/runtime/asm_amd64.s:344 +0x79
runtime.mstart()
/usr/local/go/src/runtime/proc.go:1135
goroutine 1 [running, locked to thread]:
runtime.systemstack_switch()
/usr/local/go/src/runtime/asm_amd64.s:298 fp=0xc420055ef0 sp=0xc420055ee8 pc=0x456910
runtime.newproc(0x0, 0x1d0dca8)
/usr/local/go/src/runtime/proc.go:2932 +0x8b fp=0xc420055f38 sp=0xc420055ef0 pc=0x433ebb
runtime.init.4()
/usr/local/go/src/runtime/proc.go:234 +0x35 fp=0xc420055f58 sp=0xc420055f38 pc=0x42c4c5
runtime.init()
<autogenerated>:1 +0xe3 fp=0xc420055f80 sp=0xc420055f58 pc=0x456493
runtime.main()
/usr/local/go/src/runtime/proc.go:144 +0xe8 fp=0xc420055fe0 sp=0xc420055f80 pc=0x42c198
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:2337 +0x1 fp=0xc420055fe8 sp=0xc420055fe0 pc=0x4594d1
2019-03-05 00:21:06,421 64a83480 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2019-03-05 00:21:06,421 64a83480 MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/config-beam-performancetests-compressed-textioit-hdfs-1338> delete -f <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml> --ignore-not-found
2019-03-05 00:21:06,434 64a83480 MainThread beam_integration_benchmark(1/1) INFO Ran: {kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/config-beam-performancetests-compressed-textioit-hdfs-1338> delete -f <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml> --ignore-not-found} ReturnCode:2
STDOUT:
STDERR: runtime: failed to create new OS thread (have 3 already; errno=28)
fatal error: newosproc
runtime stack:
runtime.throw(0x1c50a42, 0x9)
/usr/local/go/src/runtime/panic.go:605 +0x95
runtime.newosproc(0xc420044380, 0xc420050000)
/usr/local/go/src/runtime/os_linux.go:164 +0x1ad
runtime.newm(0x1d0ddd8, 0xc420025300)
/usr/local/go/src/runtime/proc.go:1657 +0x158
runtime.startm(0x0, 0x7ffd00000801)
/usr/local/go/src/runtime/proc.go:1728 +0x13f
runtime.wakep()
/usr/local/go/src/runtime/proc.go:1809 +0x48
runtime.newproc1(0x1d0dca8, 0xc420055f48, 0x0, 0x42c4c5, 0x0)
/usr/local/go/src/runtime/proc.go:3038 +0x34a
runtime.newproc.func1()
/usr/local/go/src/runtime/proc.go:2933 +0x51
runtime.systemstack(0x2c0e300)
/usr/local/go/src/runtime/asm_amd64.s:344 +0x79
runtime.mstart()
/usr/local/go/src/runtime/proc.go:1135
goroutine 1 [running, locked to thread]:
runtime.systemstack_switch()
/usr/local/go/src/runtime/asm_amd64.s:298 fp=0xc420055ef0 sp=0xc420055ee8 pc=0x456910
runtime.newproc(0x0, 0x1d0dca8)
/usr/local/go/src/runtime/proc.go:2932 +0x8b fp=0xc420055f38 sp=0xc420055ef0 pc=0x433ebb
runtime.init.4()
/usr/local/go/src/runtime/proc.go:234 +0x35 fp=0xc420055f58 sp=0xc420055f38 pc=0x42c4c5
runtime.init()
<autogenerated>:1 +0xe3 fp=0xc420055f80 sp=0xc420055f58 pc=0x456493
runtime.main()
/usr/local/go/src/runtime/proc.go:144 +0xe8 fp=0xc420055fe0 sp=0xc420055f80 pc=0x42c198
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:2337 +0x1 fp=0xc420055fe8 sp=0xc420055fe0 pc=0x4594d1
2019-03-05 00:21:06,435 64a83480 MainThread beam_integration_benchmark(1/1) INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2019-03-05 00:21:28,753 64a83480 MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/config-beam-performancetests-compressed-textioit-hdfs-1338> delete -f <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml> --ignore-not-found
2019-03-05 00:21:28,768 64a83480 MainThread beam_integration_benchmark(1/1) INFO Ran: {kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/config-beam-performancetests-compressed-textioit-hdfs-1338> delete -f <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml> --ignore-not-found} ReturnCode:2
STDOUT:
STDERR: runtime: failed to create new OS thread (have 4 already; errno=28)
fatal error: newosproc
runtime: failed to create new OS thread (have 5 already; errno=28)
fatal error: newosproc
runtime stack:
runtime.throw(0x1c50a42, 0x9)
/usr/local/go/src/runtime/panic.go:605 +0x95
runtime.newosproc(0xc420044700, 0xc420052000)
/usr/local/go/src/runtime/os_linux.go:164 +0x1ad
runtime.newm(0x0, 0xc420024000)
/usr/local/go/src/runtime/proc.go:1657 +0x158
runtime.startm(0xc420024000, 0x2c0ec00)
/usr/local/go/src/runtime/proc.go:1728 +0x13f
runtime.handoffp(0xc420024000)
/usr/local/go/src/runtime/proc.go:1755 +0x55
runtime.stoplockedm()
/usr/local/go/src/runtime/proc.go:1823 +0x101
runtime.schedule()
/usr/local/go/src/runtime/proc.go:2213 +0x2cf
runtime.park_m(0xc420000180)
/usr/local/go/src/runtime/proc.go:2318 +0xb6
runtime.mcall(0x7ffd5db0dd70)
/usr/local/go/src/runtime/asm_amd64.s:286 +0x5b
goroutine 1 [chan receive, locked to thread]:
runtime.gopark(0x1d0de30, 0xc4200220c8, 0x1c5478b, 0xc, 0xc420024e17, 0x3)
/usr/local/go/src/runtime/proc.go:287 +0x12c
runtime.goparkunlock(0xc4200220c8, 0x1c5478b, 0xc, 0x100110100000017, 0x3)
/usr/local/go/src/runtime/proc.go:293 +0x5e
runtime.chanrecv(0xc420022070, 0x0, 0xc420055f01, 0x416c88)
/usr/local/go/src/runtime/chan.go:506 +0x304
runtime.chanrecv1(0xc420022070, 0x0)
/usr/local/go/src/runtime/chan.go:388 +0x2b
runtime.gcenable()
/usr/local/go/src/runtime/mgc.go:217 +0x6f
runtime.main()
/usr/local/go/src/runtime/proc.go:161 +0x13e
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:2337 +0x1
runtime stack:
runtime.throw(0x1c50a42, 0x9)
/usr/local/go/src/runtime/panic.go:605 +0x95
runtime.newosproc(0xc420072000, 0xc420084000)
/usr/local/go/src/runtime/os_linux.go:164 +0x1ad
runtime.newm(0x1d0ddd8, 0xc420026600)
/usr/local/go/src/runtime/proc.go:1657 +0x158
runtime.startm(0x0, 0xc42004ff01)
/usr/local/go/src/runtime/proc.go:1728 +0x13f
runtime.wakep()
/usr/local/go/src/runtime/proc.go:1809 +0x48
runtime.resetspinning()
/usr/local/go/src/runtime/proc.go:2174 +0x71
runtime.schedule()
/usr/local/go/src/runtime/proc.go:2262 +0x116
runtime.mstart1()
/usr/local/go/src/runtime/proc.go:1192 +0xd8
runtime.mstart()
/usr/local/go/src/runtime/proc.go:1152 +0x64
2019-03-05 00:21:28,769 64a83480 MainThread beam_integration_benchmark(1/1) INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2019-03-05 00:21:52,006 64a83480 MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/config-beam-performancetests-compressed-textioit-hdfs-1338> delete -f <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml> --ignore-not-found
2019-03-05 00:23:32,633 64a83480 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 874, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 734, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 589, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 149, in Run
dynamic_pipeline_options)
File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_pipeline_options.py",> line 100, in GenerateAllPipelineOptions
EvaluateDynamicPipelineOptions(dynamic_pipeline_options))
File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_pipeline_options.py",> line 67, in EvaluateDynamicPipelineOptions
argValue = RetrieveLoadBalancerIp(optionDescriptor)
File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_pipeline_options.py",> line 151, in RetrieveLoadBalancerIp
'svc', serviceName, '', '.status.loadBalancer.ingress[0].ip')
File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/kubernetes_helper.py",> line 80, in GetWithWaitForContents
ret = Get(resource, resourceInstanceName, filter, jsonFilter)
File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/kubernetes_helper.py",> line 71, in Get
raise Exception("Error received from kubectl get: " + stderr)
Exception: Error received from kubectl get: runtime: failed to create new OS thread (have 3 already; errno=28)
fatal error: newosproc
runtime stack:
runtime.throw(0x1c50a42, 0x9)
/usr/local/go/src/runtime/panic.go:605 +0x95
runtime.newosproc(0xc420044380, 0xc420050000)
/usr/local/go/src/runtime/os_linux.go:164 +0x1ad
runtime.newm(0x1d0ddd8, 0xc420025300)
/usr/local/go/src/runtime/proc.go:1657 +0x158
runtime.startm(0x0, 0x7ffc00000801)
/usr/local/go/src/runtime/proc.go:1728 +0x13f
runtime.wakep()
/usr/local/go/src/runtime/proc.go:1809 +0x48
runtime.newproc1(0x1d0dca8, 0xc420055f48, 0x0, 0x42c4c5, 0x0)
/usr/local/go/src/runtime/proc.go:3038 +0x34a
runtime.newproc.func1()
/usr/local/go/src/runtime/proc.go:2933 +0x51
runtime.systemstack(0x2c0e300)
/usr/local/go/src/runtime/asm_amd64.s:344 +0x79
runtime.mstart()
/usr/local/go/src/runtime/proc.go:1135
goroutine 1 [running, locked to thread]:
runtime.systemstack_switch()
/usr/local/go/src/runtime/asm_amd64.s:298 fp=0xc420055ef0 sp=0xc420055ee8 pc=0x456910
runtime.newproc(0x0, 0x1d0dca8)
/usr/local/go/src/runtime/proc.go:2932 +0x8b fp=0xc420055f38 sp=0xc420055ef0 pc=0x433ebb
runtime.init.4()
/usr/local/go/src/runtime/proc.go:234 +0x35 fp=0xc420055f58 sp=0xc420055f38 pc=0x42c4c5
runtime.init()
<autogenerated>:1 +0xe3 fp=0xc420055f80 sp=0xc420055f58 pc=0x456493
runtime.main()
/usr/local/go/src/runtime/proc.go:144 +0xe8 fp=0xc420055fe0 sp=0xc420055f80 pc=0x42c198
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:2337 +0x1 fp=0xc420055fe8 sp=0xc420055fe0 pc=0x4594d1
2019-03-05 00:23:32,634 64a83480 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2019-03-05 00:23:32,634 64a83480 MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2019-03-05 00:23:32,634 64a83480 MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/runs/64a83480/pkb.log>
2019-03-05 00:23:32,635 64a83480 MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/runs/64a83480/completion_statuses.json>
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PerformanceTests_Compressed_TextIOIT_HDFS #1339
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/1339/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org