You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ahmet Altay (JIRA)" <ji...@apache.org> on 2018/11/02 23:45:00 UTC

[jira] [Commented] (BEAM-5957) [beam_PerformanceTests_Python] Consistently failing due to failing integration test.

    [ https://issues.apache.org/jira/browse/BEAM-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16673821#comment-16673821 ] 

Ahmet Altay commented on BEAM-5957:
-----------------------------------

[~markflyhigh] [~alanmyrvold] How can we debug this failures? The log has information about some job failing with a non-zero return code but it does not have a link to the job or does not have additional logs.

Can we update the perfkitbenchmarker plugin to include this additional information?

> [beam_PerformanceTests_Python] Consistently failing due to failing integration test.
> ------------------------------------------------------------------------------------
>
>                 Key: BEAM-5957
>                 URL: https://issues.apache.org/jira/browse/BEAM-5957
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-py-core, test-failures
>            Reporter: Daniel Oliveira
>            Assignee: Ahmet Altay
>            Priority: Major
>
> Most recent failure: [https://builds.apache.org/job/beam_PerformanceTests_Python/1634/]
> I haven't been able to debug the root cause of the failure with what I know. From what I can tell the performance test fails because one of the integration tests it's benchmarking has failed. But I can't tell what integration test is causing the failure.
> Relevant parts of the logs:
> {noformat}
> 11:19:01 BUILD FAILED in 36s
> 11:19:01 
> 11:19:01 2018-11-02 18:19:01,413 3c18295b MainThread beam_integration_benchmark(1/1) ERROR    Error during benchmark beam_integration_benchmark
> 11:19:01 Traceback (most recent call last):
> 11:19:01   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py", line 719, in RunBenchmark
> 11:19:01     DoRunPhase(spec, collector, detailed_timer)
> 11:19:01   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py", line 580, in DoRunPhase
> 11:19:01     samples = spec.BenchmarkRun(spec)
> 11:19:01   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py", line 160, in Run
> 11:19:01     job_type=job_type)
> 11:19:01   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py", line 90, in SubmitJob
> 11:19:01     assert retcode == 0, "Integration Test Failed."
> 11:19:01 AssertionError: Integration Test Failed.
> 11:19:01 2018-11-02 18:19:01,414 3c18295b MainThread beam_integration_benchmark(1/1) INFO     Cleaning up benchmark beam_integration_benchmark
> 11:19:01 2018-11-02 18:19:01,416 3c18295b MainThread beam_integration_benchmark(1/1) ERROR    Exception running benchmark
> 11:19:01 Traceback (most recent call last):
> 11:19:01   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py", line 860, in RunBenchmarkTask
> 11:19:01     RunBenchmark(spec, collector)
> 11:19:01   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py", line 719, in RunBenchmark
> 11:19:01     DoRunPhase(spec, collector, detailed_timer)
> 11:19:01   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py", line 580, in DoRunPhase
> 11:19:01     samples = spec.BenchmarkRun(spec)
> 11:19:01   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py", line 160, in Run
> 11:19:01     job_type=job_type)
> 11:19:01   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py", line 90, in SubmitJob
> 11:19:01     assert retcode == 0, "Integration Test Failed."
> 11:19:01 AssertionError: Integration Test Failed.
> 11:19:01 2018-11-02 18:19:01,416 3c18295b MainThread beam_integration_benchmark(1/1) ERROR    Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)