You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Jean-Baptiste Onofré (JIRA)" <ji...@apache.org> on 2017/05/30 13:00:06 UTC

[jira] [Created] (BEAM-2381) Extend the SparkContextOptions

Jean-Baptiste Onofré created BEAM-2381:
------------------------------------------

             Summary: Extend the SparkContextOptions
                 Key: BEAM-2381
                 URL: https://issues.apache.org/jira/browse/BEAM-2381
             Project: Beam
          Issue Type: Improvement
          Components: runner-spark
            Reporter: Jean-Baptiste Onofré
            Assignee: Jean-Baptiste Onofré


Currently, it's possible to use the {{SparkContextOptions}} to "pass" a custom {{SparkContext}} to the Spark runner.

However, more than constructing a complete {{SparkContext}} outside of the runner, an user may want to "tweak" the context created internally by the runner.
We could "extend" the {{SparkContextOptions}} to pass additional options used to construct and populate the {{JavaSparkContext}} like security, dependencies management, additional properties.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)