You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ismaël Mejía (Jira)" <ji...@apache.org> on 2019/10/16 08:12:00 UTC
[jira] [Updated] (BEAM-8141) Add an integration test suite for
cross-language transforms for Spark runner
[ https://issues.apache.org/jira/browse/BEAM-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ismaël Mejía updated BEAM-8141:
-------------------------------
Status: Open (was: Triage Needed)
> Add an integration test suite for cross-language transforms for Spark runner
> ----------------------------------------------------------------------------
>
> Key: BEAM-8141
> URL: https://issues.apache.org/jira/browse/BEAM-8141
> Project: Beam
> Issue Type: Test
> Components: testing
> Reporter: Kyle Weaver
> Assignee: Kyle Weaver
> Priority: Major
> Fix For: 2.15.0
>
>
> We should add an integration test suite that covers following.
> (1) Currently available Java IO connectors that do not use UDFs work for Python SDK on Spark runner.
> (2) Currently available Python IO connectors that do not use UDFs work for Java SDK on Spark runner.
> (3) Currently available Java/Python pipelines work in a scalable manner for cross-language pipelines (for example, try 10GB, 100GB input for textio/avroio for Java and Python).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)