You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Łukasz Gajowy (JIRA)" <ji...@apache.org> on 2017/12/19 16:16:00 UTC

[jira] [Commented] (BEAM-3371) Add ability to stage directories with compiled classes to Spark

    [ https://issues.apache.org/jira/browse/BEAM-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16297026#comment-16297026 ] 

Łukasz Gajowy commented on BEAM-3371:
-------------------------------------

FYI: [~jasonkuster] [~chamikara]

> Add ability to stage directories with compiled classes to Spark
> ---------------------------------------------------------------
>
>                 Key: BEAM-3371
>                 URL: https://issues.apache.org/jira/browse/BEAM-3371
>             Project: Beam
>          Issue Type: New Feature
>          Components: runner-spark
>            Reporter: Łukasz Gajowy
>            Assignee: Amit Sela
>            Priority: Minor
>
> This one is basically the same issue as
>  [this Flink's one|https://issues.apache.org/jira/browse/BEAM-3370], except of two things:
> - a detection of files to stage has to be provided in Spark, which is already being developed [here|https://issues.apache.org/jira/browse/BEAM-981]
> - the test execution is not interrupted by FileNotFoundException but by *the effect* of the directory not being staged (absence of test classes on the Spark's classpath, hence ClassNotFoundException).
> Again, this probably could be resolved analogously as in flink, while BEAM-981 issue is resolved. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)