You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@geode.apache.org by "Dan Smith (JIRA)" <ji...@apache.org> on 2018/07/11 19:04:00 UTC
[jira] [Commented] (GEODE-5417) All UITest tests are flaky and
failing in CI
[ https://issues.apache.org/jira/browse/GEODE-5417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16540542#comment-16540542 ]
Dan Smith commented on GEODE-5417:
----------------------------------
Here is the most recent list of failures from concourse:
org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.clickServGrpGridButtonShowsGridTest: 1 failures (98.9795918367347% success rate)
Failed build 144 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/144
org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.testClusterAverageReadsWidget: 1 failures (98.9795918367347% success rate)
Failed build 141 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/141
org.apache.geode.tools.pulse.tests.ui.PulseNoAuthTest.testClusterNumSubscriptions: 1 failures (98.9795918367347% success rate)
Failed build 141 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/141
org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.testDataBrowserColocatedRegions: 1 failures (98.9795918367347% success rate)
Failed build 136 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/136
org.apache.geode.tools.pulse.ui.PulseAcceptanceAuthTest.testDropDownList: 2 failures (97.95918367346938% success rate)
Failed build 133 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/133
Failed build 67 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/67
org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.clickRZGridMembersNavigationTest: 2 failures (97.95918367346938% success rate)
Failed build 131 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/131
Failed build 63 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/63
org.apache.geode.tools.pulse.tests.ui.PulseAuthTest.testClusterGridViewCPUUsage: 2 failures (97.95918367346938% success rate)
Failed build 127 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/127
Failed build 51 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/51
org.apache.geode.tools.pulse.tests.ui.PulseNoAuthTest.testRegionViewTreeMapPopUpData: 1 failures (98.9795918367347% success rate)
Failed build 125 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/125
org.apache.geode.tools.pulse.tests.ui.PulseAuthTest.testClusterGridViewMemberName: 2 failures (97.95918367346938% success rate)
Failed build 124 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/124
Failed build 123 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/123
org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.testSortingUsingHeapUsageOnRedundancyView: 1 failures (98.9795918367347% success rate)
Failed build 123 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/123
org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.testClusterNumSubscriptions: 1 failures (98.9795918367347% success rate)
Failed build 123 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/123
org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.clickRZGridShowingGridTest: 2 failures (97.95918367346938% success rate)
Failed build 120 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/120
Failed build 78 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/78
org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.clickTreeMapViewShowingTreeMapTest: 1 failures (98.9795918367347% success rate)
Failed build 105 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/105
org.apache.geode.tools.pulse.ui.PulseAcceptanceAuthTest.testClusterDetailsAndWidgets: 1 failures (98.9795918367347% success rate)
Failed build 98 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/98
org.apache.geode.tools.pulse.tests.ui.PulseAuthTest.testClusterMemberCount: 1 failures (98.9795918367347% success rate)
Failed build 98 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/98
org.apache.geode.tools.pulse.ui.PulseAcceptanceNoAuthTest.testClusterDetailsAndWidgets: 1 failures (98.9795918367347% success rate)
Failed build 91 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/91
org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.regionType: 1 failures (98.9795918367347% success rate)
Failed build 86 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/86
org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.testClusterGridViewMemberID: 1 failures (98.9795918367347% success rate)
Failed build 86 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/86
org.apache.geode.tools.pulse.tests.ui.PulseAuthTest.testClusterNumRunningFunction: 2 failures (97.95918367346938% success rate)
Failed build 81 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/81
Failed build 53 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/53
org.apache.geode.tools.pulse.ui.PulseAcceptanceNoAuthTest.testRegionViewTreeMapPopUpData: 1 failures (98.9795918367347% success rate)
Failed build 69 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/69
org.apache.geode.tools.pulse.tests.ui.PulseNoAuthTest.testClusterRegionCount: 1 failures (98.9795918367347% success rate)
Failed build 69 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/69
org.apache.geode.tools.pulse.tests.ui.PulseAuthTest.testClusterGridViewMemberID: 1 failures (98.9795918367347% success rate)
Failed build 67 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/67
org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.clickOnGridMemNameNavigatingToCorrespondingRegionTest: 1 failures (98.9795918367347% success rate)
Failed build 63 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/63
org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.testDataViewTreeMapPopUpData: 1 failures (98.9795918367347% success rate)
Failed build 63 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/63
org.apache.geode.tools.pulse.ui.PulseAcceptanceAuthTest.testDataViewTreeMapPopUpData: 1 failures (98.9795918367347% success rate)
Failed build 58 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/58
org.apache.geode.tools.pulse.ui.PulseAcceptanceNoAuthTest.testDropDownList: 1 failures (98.9795918367347% success rate)
Failed build 58 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/58
org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.verifySortingOptionsTest: 1 failures (98.9795918367347% success rate)
Failed build 58 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/58
org.apache.geode.tools.pulse.tests.ui.PulseNoAuthTest.testClusterGridViewMemberHost: 1 failures (98.9795918367347% success rate)
Failed build 58 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/58
org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.regionEmptyNodes: 1 failures (98.9795918367347% success rate)
Failed build 52 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/52
> All UITest tests are flaky and failing in CI
> --------------------------------------------
>
> Key: GEODE-5417
> URL: https://issues.apache.org/jira/browse/GEODE-5417
> Project: Geode
> Issue Type: Bug
> Components: pulse, tests
> Reporter: Dan Smith
> Priority: Major
> Labels: swat
>
> All of these tests with the UITest category seem to be flaky, with the exception of those that extend BaseServiceTest. I've attached the results of the metrics job against the current concourse pipeline with 144 runs.
> We should fix the systematic failures in these tests, or replace/remove them if we have coverage elsewhere.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)