You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Chamikara Jayalath (Jira)" <ji...@apache.org> on 2019/09/12 20:18:00 UTC
[jira] [Commented] (BEAM-8215) Wordcount 1GB Python PKB benchmarks
sometimes fail with uninformative error
[ https://issues.apache.org/jira/browse/BEAM-8215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928866#comment-16928866 ]
Chamikara Jayalath commented on BEAM-8215:
------------------------------------------
Seems like this is making Python 3 post commits extremely flaky (but not Python 2 strangely).
Some recent examples.
[https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/479/console]
[https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/456/console]
> Wordcount 1GB Python PKB benchmarks sometimes fail with uninformative error
> ---------------------------------------------------------------------------
>
> Key: BEAM-8215
> URL: https://issues.apache.org/jira/browse/BEAM-8215
> Project: Beam
> Issue Type: Bug
> Components: testing
> Reporter: Valentyn Tymofieiev
> Assignee: Mark Liu
> Priority: Major
>
> Example:
> https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/452/console
> {noformat}
> 12:09:27 2019-09-11 19:09:27,655 a47400ce MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
> 12:09:27 Traceback (most recent call last):
> 12:09:27 File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py36/PerfKitBenchmarker/perfkitbenchmarker/pkb.py", line 841, in RunBenchmark
> 12:09:27 DoRunPhase(spec, collector, detailed_timer)
> 12:09:27 File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py36/PerfKitBenchmarker/perfkitbenchmarker/pkb.py", line 687, in DoRunPhase
> 12:09:27 samples = spec.BenchmarkRun(spec)
> 12:09:27 File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py36/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py", line 160, in Run
> 12:09:27 job_type=job_type)
> 12:09:27 File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py36/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py", line 91, in SubmitJob
> 12:09:27 assert retcode == 0, "Integration Test Failed."
> 12:09:27 AssertionError: Integration Test Failed.
> {noformat}
> It seems like Job submission failed, but there are no details. I talked with [~markflyhigh], and sounds like we plan to stop using PKB in favor of another framework.
> Assigning to Mark for now to triage follow up or reassign as appropriate.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)