You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Łukasz Gajowy (JIRA)" <ji...@apache.org> on 2017/12/12 19:50:00 UTC

[jira] [Comment Edited] (BEAM-1603) Enable programmatic execution of spark pipelines.

    [ https://issues.apache.org/jira/browse/BEAM-1603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16288166#comment-16288166 ] 

Łukasz Gajowy edited comment on BEAM-1603 at 12/12/17 7:49 PM:
---------------------------------------------------------------

[~jasonkuster] I'll take this if you don't mind as I've been investigating the topic lately (see related 981 issue). 


was (Author: łukaszg):
[~jasonkuster] I'll take this if you don't mind as I've been investigating the topic lately (see: https://github.com/apache/beam/pull/4246). 

> Enable programmatic execution of spark pipelines.
> -------------------------------------------------
>
>                 Key: BEAM-1603
>                 URL: https://issues.apache.org/jira/browse/BEAM-1603
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-spark, testing
>            Reporter: Jason Kuster
>            Assignee: Łukasz Gajowy
>
> In order to enable execution of Spark Integration Tests against a cluster, it is necessary to have the ability to execute Spark pipelines via maven, rather than spark-submit. The minimum necessary is to enable this in the TestSparkRunner.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)