You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Lukasz Gajowy (Jira)" <ji...@apache.org> on 2019/12/19 15:33:00 UTC

[jira] [Resolved] (BEAM-4041) Performance tests fail due to kubernetes load balancer problems

     [ https://issues.apache.org/jira/browse/BEAM-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Lukasz Gajowy resolved BEAM-4041.
---------------------------------
    Fix Version/s: Not applicable
       Resolution: Fixed

> Performance tests fail due to kubernetes load balancer problems
> ---------------------------------------------------------------
>
>                 Key: BEAM-4041
>                 URL: https://issues.apache.org/jira/browse/BEAM-4041
>             Project: Beam
>          Issue Type: Bug
>          Components: testing
>            Reporter: Lukasz Gajowy
>            Priority: Major
>             Fix For: Not applicable
>
>          Time Spent: 1h
>  Remaining Estimate: 0h
>
> Recently, as we added more IOITs to be run on jenkins using kubernetes, some of them started to fail randomly, because they couldn't retrieve LoadBalancer address. Normally obtaining the address took about one minute. Perfkit waits for the address (actively checking for it) for 3 minutes. This should be enough for getting the address, yet it recently started to exceed the 3 minutes limit. I also noticed that this error didn't happen when there were fewer tests.
> Example logs:
> https://builds.apache.org/view/A-D/view/Beam/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/31/console



--
This message was sent by Atlassian Jira
(v8.3.4#803005)