You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kamil Wasilewski (Jira)" <ji...@apache.org> on 2020/09/03 13:39:00 UTC
[jira] [Created] (BEAM-10852) Combine Python streaming load test is
too slow on Flink
Kamil Wasilewski created BEAM-10852:
---------------------------------------
Summary: Combine Python streaming load test is too slow on Flink
Key: BEAM-10852
URL: https://issues.apache.org/jira/browse/BEAM-10852
Project: Beam
Issue Type: Bug
Components: testing
Reporter: Kamil Wasilewski
One of the Combine load test cases, which involves a global combiner and data stream of 200M elements, takes too long on Flink. Flink is able to process only a half of that data stream within 1 hour, which is too long for a Jenkins job.
Job's definition: https://github.com/apache/beam/blob/master/.test-infra/jenkins/job_LoadTests_Combine_Flink_Python.groovy#L36
Test pipeline: https://github.com/apache/beam/blob/master/sdks/python/apache_beam/testing/load_tests/combine_test.py
--
This message was sent by Atlassian Jira
(v8.3.4#803005)