You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Stas Levin (JIRA)" <ji...@apache.org> on 2016/11/22 19:10:58 UTC

[jira] [Assigned] (BEAM-1039) Spark context is never actually re-used in tests

     [ https://issues.apache.org/jira/browse/BEAM-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stas Levin reassigned BEAM-1039:
--------------------------------

    Assignee: Stas Levin  (was: Amit Sela)

> Spark context is never actually re-used in tests
> ------------------------------------------------
>
>                 Key: BEAM-1039
>                 URL: https://issues.apache.org/jira/browse/BEAM-1039
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-spark
>            Reporter: Stas Levin
>            Assignee: Stas Levin
>
> I think that due to a slight typo {{Boolean.getBoolean(TEST_REUSE_SPARK_CONTEXT)}} got mixed up with
> {{Boolean.getBoolean(System.getProperty(TEST_REUSE_SPARK_CONTEXT))}} in the following 2 places, which may have caused {{SparkContext}} to behave not quite as expected.
> *  https://github.com/apache/incubator-beam/blob/master/runners/spark/src/main/java/org/apache/beam/runners/spark/translation/SparkContextFactory.java#L52
> *  https://github.com/apache/incubator-beam/blob/master/runners/spark/src/main/java/org/apache/beam/runners/spark/translation/SparkContextFactory.java#L70
> I'll take care of it as part of something I'm working on, so a PR should follow shortly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)