You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Amit Sela (JIRA)" <ji...@apache.org> on 2016/07/27 20:03:20 UTC

[jira] [Commented] (BEAM-492) Spark runner should call Pipeline.run() instead of SparkRunner.run()

    [ https://issues.apache.org/jira/browse/BEAM-492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15396252#comment-15396252 ] 

Amit Sela commented on BEAM-492:
--------------------------------

I suggest to remove the SparkStreamingPipelineOptions while we're at it. We can move the timeout property to the SparkPipelineOptions, and ignore it in batch.

> Spark runner should call Pipeline.run() instead of SparkRunner.run()
> --------------------------------------------------------------------
>
>                 Key: BEAM-492
>                 URL: https://issues.apache.org/jira/browse/BEAM-492
>             Project: Beam
>          Issue Type: Bug
>    Affects Versions: 0.1.0-incubating
>            Reporter: Amit Sela
>            Assignee: Amit Sela
>
> Currently, in some places (streaming examples, etc.), the Pipeline executes by calling SparkRunner.run() instead of calling Pipeline.run() which is kind of "backwards" to the Beam API.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)