You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Beam JIRA Bot (Jira)" <ji...@apache.org> on 2020/11/02 17:11:00 UTC
[jira] [Updated] (BEAM-10852) Combine Python streaming load test is
too slow on Flink
[ https://issues.apache.org/jira/browse/BEAM-10852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Beam JIRA Bot updated BEAM-10852:
---------------------------------
Labels: stale-P2 (was: )
> Combine Python streaming load test is too slow on Flink
> -------------------------------------------------------
>
> Key: BEAM-10852
> URL: https://issues.apache.org/jira/browse/BEAM-10852
> Project: Beam
> Issue Type: Bug
> Components: testing
> Reporter: Kamil Wasilewski
> Priority: P2
> Labels: stale-P2
>
> One of the Combine load test cases, which involves a global combiner and data stream of 200M elements, takes too long on Flink. Flink is able to process only a half of that data stream within 1 hour, which is too long for a Jenkins job.
> Job's definition: https://github.com/apache/beam/blob/master/.test-infra/jenkins/job_LoadTests_Combine_Flink_Python.groovy#L36
> Test pipeline: https://github.com/apache/beam/blob/master/sdks/python/apache_beam/testing/load_tests/combine_test.py
--
This message was sent by Atlassian Jira
(v8.3.4#803005)