You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Michael Armbrust (JIRA)" <ji...@apache.org> on 2014/06/02 23:03:03 UTC

[jira] [Updated] (SPARK-1508) Add support for reading from SparkConf

     [ https://issues.apache.org/jira/browse/SPARK-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael Armbrust updated SPARK-1508:
------------------------------------

    Description: 
Right now we have no ability to configure things in Spark SQL.  A good start would be passing a SparkConf though the planner such that users could override the number of partitions used during an Exchange.

Note that while current spark confs are immutable after the context is created, we want some ability to change settings on a per query basis.

  was:Right now we have no ability to configure things in Spark SQL.  A good start would be passing a SparkConf though the planner such that users could override the number of partitions used during an Exchange.


> Add support for reading from SparkConf
> --------------------------------------
>
>                 Key: SPARK-1508
>                 URL: https://issues.apache.org/jira/browse/SPARK-1508
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>            Reporter: Michael Armbrust
>             Fix For: 1.1.0
>
>
> Right now we have no ability to configure things in Spark SQL.  A good start would be passing a SparkConf though the planner such that users could override the number of partitions used during an Exchange.
> Note that while current spark confs are immutable after the context is created, we want some ability to change settings on a per query basis.



--
This message was sent by Atlassian JIRA
(v6.2#6252)