You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Alexey Romanenko (JIRA)" <ji...@apache.org> on 2018/10/02 10:01:00 UTC
[jira] [Resolved] (BEAM-3371) Add ability to stage directories with
compiled classes to Spark
[ https://issues.apache.org/jira/browse/BEAM-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alexey Romanenko resolved BEAM-3371.
------------------------------------
Resolution: Fixed
Fix Version/s: 2.8.0
> Add ability to stage directories with compiled classes to Spark
> ---------------------------------------------------------------
>
> Key: BEAM-3371
> URL: https://issues.apache.org/jira/browse/BEAM-3371
> Project: Beam
> Issue Type: Sub-task
> Components: runner-spark
> Reporter: Lukasz Gajowy
> Assignee: Lukasz Gajowy
> Priority: Minor
> Fix For: 2.8.0
>
> Time Spent: 6h 10m
> Remaining Estimate: 0h
>
> This one is basically the same issue as
> [this Flink's one|https://issues.apache.org/jira/browse/BEAM-3370], except of two things:
> - a detection of files to stage has to be provided in Spark, which is already being developed [here|https://issues.apache.org/jira/browse/BEAM-981]
> - the test execution is not interrupted by FileNotFoundException but by *the effect* of the directory not being staged (absence of test classes on the Spark's classpath, hence ClassNotFoundException).
> Again, this probably could be resolved analogously as in flink, while BEAM-981 issue is resolved.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)