[jira] [Commented] (BEAM-5758) Load tests for SyntheticSources in Python

["Kasia Kucharczyk (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653437#comment-16653437 ] 

Kasia Kucharczyk commented on BEAM-5758:
----------------------------------------

While [testing ParDo|https://github.com/apache/beam/blob/faff82860c66e4050f0cfa5e874ffe6035ed0c1c/sdks/python/apache_beam/testing/load_tests/par_do_test.py#L133] I encountered some problems with DirectRunner. The test contains a loop of no operation ParDos where the number of iterations is parametrized in pipeline options. With ~200 iterations the test fails and returns whole INFO logs of pipeline steps. The only Exception that sometimes appears is:  
{code:java}
RuntimeError: maximum recursion depth exceeded{code}
I created another issue with further details about this problem. 

> Load tests for SyntheticSources in Python
> -----------------------------------------
>
>                 Key: BEAM-5758
>                 URL: https://issues.apache.org/jira/browse/BEAM-5758
>             Project: Beam
>          Issue Type: Test
>          Components: testing
>            Reporter: Kasia Kucharczyk
>            Assignee: Kasia Kucharczyk
>            Priority: Major
>
> For purpose of load testing the SyntheticSources there should be created tests with following transformations:
>  * ParDo
>  * Combine
>  * GroupByKey
>  * CoGroupByKey.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)