You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Michael Armbrust (JIRA)" <ji...@apache.org> on 2014/06/04 21:29:01 UTC

[jira] [Comment Edited] (SPARK-1508) Add support for reading from SparkConf

    [ https://issues.apache.org/jira/browse/SPARK-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14018053#comment-14018053 ] 

Michael Armbrust edited comment on SPARK-1508 at 6/4/14 7:27 PM:
-----------------------------------------------------------------

It is likely we will fix a related issue regarding calling collect on NativeCommands through the solution here.


was (Author: marmbrus):
It is likely we will fix this issue through the solution here.

> Add support for reading from SparkConf
> --------------------------------------
>
>                 Key: SPARK-1508
>                 URL: https://issues.apache.org/jira/browse/SPARK-1508
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>            Reporter: Michael Armbrust
>            Assignee: Zongheng Yang
>             Fix For: 1.1.0
>
>
> Right now we have no ability to configure things in Spark SQL.  A good start would be passing a SparkConf though the planner such that users could override the number of partitions used during an Exchange.
> Note that while current spark confs are immutable after the context is created, we want some ability to change settings on a per query basis.



--
This message was sent by Atlassian JIRA
(v6.2#6252)