You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Kyle Weaver (Jira)" <ji...@apache.org> on 2019/09/03 23:10:00 UTC

[jira] [Assigned] (BEAM-8141) Add an integration test suite for cross-language transforms for Spark runner

     [ https://issues.apache.org/jira/browse/BEAM-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kyle Weaver reassigned BEAM-8141:
---------------------------------

    Assignee: Kyle Weaver  (was: Heejong Lee)

> Add an integration test suite for cross-language transforms for Spark runner
> ----------------------------------------------------------------------------
>
>                 Key: BEAM-8141
>                 URL: https://issues.apache.org/jira/browse/BEAM-8141
>             Project: Beam
>          Issue Type: Test
>          Components: testing
>            Reporter: Kyle Weaver
>            Assignee: Kyle Weaver
>            Priority: Major
>             Fix For: 2.15.0
>
>
> We should add an integration test suite that covers following.
> (1) Currently available Java IO connectors that do not use UDFs work for Python SDK on Flink runner.
> (2) Currently available Python IO connectors that do not use UDFs work for Java SDK on Flink runner.
> (3) Currently available Java/Python pipelines work in a scalable manner for cross-language pipelines (for example, try 10GB, 100GB input for textio/avroio for Java and Python). 
>  



--
This message was sent by Atlassian Jira
(v8.3.2#803003)