You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Łukasz Gajowy (JIRA)" <ji...@apache.org> on 2018/03/15 17:18:00 UTC
[jira] [Assigned] (BEAM-3798) Performance tests flaky due to
Dataflow transient errors
[ https://issues.apache.org/jira/browse/BEAM-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Łukasz Gajowy reassigned BEAM-3798:
-----------------------------------
Assignee: Łukasz Gajowy (was: Thomas Groh)
> Performance tests flaky due to Dataflow transient errors
> --------------------------------------------------------
>
> Key: BEAM-3798
> URL: https://issues.apache.org/jira/browse/BEAM-3798
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow
> Reporter: Łukasz Gajowy
> Assignee: Łukasz Gajowy
> Priority: Major
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> Performance tests are flaky due to transient errors that happened during data processing (eg. SocketTimeoutException while connecting to DB). Currently exceptions that happen on Dataflow runner but are retried successfully, fail the test regardless of the final job state (giving a false-negative result).
> Possible solution for batch scenarios:
> We could "rethrow" exceptions that happened due to transient errors *only* if the job status is other than DONE.
> Possible solution for streaming scenarios:
> (don't know yet)
> [Link to discussion on dev list |https://lists.apache.org/thread.html/e480f8181913dc81d2d4cd1430557a646537473ccf29fe6390229098@%3Cdev.beam.apache.org%3E]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)