You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Jean-Baptiste Onofré (JIRA)" <ji...@apache.org> on 2016/11/27 12:36:58 UTC

[jira] [Created] (BEAM-1051) Extend the TestSparkRunner with its own TransformTranslator containing test evaluators

Jean-Baptiste Onofré created BEAM-1051:
------------------------------------------

             Summary: Extend the TestSparkRunner with its own TransformTranslator containing test evaluators
                 Key: BEAM-1051
                 URL: https://issues.apache.org/jira/browse/BEAM-1051
             Project: Beam
          Issue Type: Improvement
          Components: runner-spark
            Reporter: Jean-Baptiste Onofré
            Assignee: Jean-Baptiste Onofré


When we have to test low level features in the Spark runner, requiring access to the {{RDDs}} or {{DStreams}}, we have to create a "fake" {{PTransform}} with a custom evaluators in the core Spark runner.

In order to avoid to pollute the core runner, this should be done in {{TestSparkRunner}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)