[jira] [Comment Edited] (BEAM-2671) CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner

["Aviem Zur (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106440#comment-16106440 ] 

Aviem Zur edited comment on BEAM-2671 at 8/2/17 6:44 AM:
---------------------------------------------------------

CreateStreamTest has flakiness issues.
20820fa5477ffcdd4a9ef2e9340353ed3c5691a9
May have added to this element of flakiness and may have not, but we decided to move the flaky tests to Spark runner postcommit tests in 22dbb500289675fe95b6d149c8550e09dc26feac

However, it appears that now the Spark runner tests are failing consistently, which IIRC was not the case.
The build history doesn't go far back enough to show when the tests started failing but it does keep the last successful build
which built the revision 3785b5baf4d3c47ea6625fff9babe5854e2e5fdb which happened after the commits mentioned above https://builds.apache.org/view/Beam/job/beam_PostCommit_Java_ValidatesRunner_Spark/2446/

It appears that a commit has been made since then that makes the tests fail consistently (locally as well as on Jenkins).


was (Author: aviemzur):
CreateStreamTest has flakiness issues.
20820fa5477ffcdd4a9ef2e9340353ed3c5691a9
May have added to this element of flakiness and may have not, but we decided to move the flaky tests to Spark runner postcommit tests in 22dbb500289675fe95b6d149c8550e09dc26feac

However, it appears that now the Spark runner tests are failing consistently, which IIRC was not the case.
The build history doesn't go far back enough to show when the tests started failing but it does keep the last successful build
which built the revision 3785b5baf4d3c47ea6625fff9babe5854e2e5fdb which happened after the commits mentioned above https://builds.apache.org/view/Beam/job/beam_PostCommit_Java_ValidatesRunner_Spark/2446/

There are 2 possibilities:
1. Something in Jenkins env has changed in a way that the flakiness occurs 100% of the time now.
2. A commit has been made since then that makes the tests fail consistently.

> CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner
> --------------------------------------------------------------------------------
>
>                 Key: BEAM-2671
>                 URL: https://issues.apache.org/jira/browse/BEAM-2671
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-spark
>            Reporter: Etienne Chauchot
>            Assignee: Jean-Baptiste Onofré
>             Fix For: 2.1.0, 2.2.0
>
>
> Error message:
> Flatten.Iterables/FlattenIterables/FlatMap/ParMultiDo(Anonymous).out0: 
> Expected: iterable over [] in any order
>      but: Not matched: "late"



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)