You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/03 18:30:13 UTC

[GitHub] [beam] kennknowles opened a new issue, #18408: Create.of(...) does not work as expected when spark-runner is configured to streaming mode

kennknowles opened a new issue, #18408:
URL: https://github.com/apache/beam/issues/18408

   When the Spark runner is set to streaming mode, and the input `PCollection` is created via `Create.of(...)`, things do not work as expected.
   
   This happens due to the fact the `EVALUATORS` map in `StreamingTransformTranslator` does not have a matching `TransformEvaluator` for the `Create.Values` transform.
   
   I believe this can be fixed by employing a similar approach to the one used for translating `CreateStream`. In fact, it might be quite possible to move things around so that the translation of `Create.of(..)` uses `CreateStream.of(...)` under the hood.
   
   Imported from Jira [BEAM-2464](https://issues.apache.org/jira/browse/BEAM-2464). Original Jira may contain additional context.
   Reported by: staslev.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org