You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Stas Levin (JIRA)" <ji...@apache.org> on 2017/06/18 16:14:01 UTC
[jira] [Assigned] (BEAM-2464) Create.of(...) does not work as
expected when runner is configured to streaming mode
[ https://issues.apache.org/jira/browse/BEAM-2464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stas Levin reassigned BEAM-2464:
--------------------------------
Assignee: Stas Levin (was: Amit Sela)
> Create.of(...) does not work as expected when runner is configured to streaming mode
> ------------------------------------------------------------------------------------
>
> Key: BEAM-2464
> URL: https://issues.apache.org/jira/browse/BEAM-2464
> Project: Beam
> Issue Type: Bug
> Components: runner-spark
> Affects Versions: 2.0.0
> Reporter: Stas Levin
> Assignee: Stas Levin
> Priority: Minor
>
> When the Spark runner is set to streaming mode, and the input {{PCollection}} is created via {{Create.of(...)}}, things do not work as expected.
> This happens due to the fact the {{EVALUATORS}} map in {{StreamingTransformTranslator}} does not have a matching {{TransformEvaluator}} for the {{Create.Values}} transform.
> I believe this can be fixed by employing a similar approach to the one used for translating {{CreateStream}}. In fact, it might be quite possible to move things around so that the translation of {{Create.of(..)}} uses {{CreateStream.of(...)}} under the hood.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)