You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Michael Armbrust (JIRA)" <ji...@apache.org> on 2014/06/04 21:29:01 UTC
[jira] [Comment Edited] (SPARK-1508) Add support for reading from
SparkConf
[ https://issues.apache.org/jira/browse/SPARK-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14018053#comment-14018053 ]
Michael Armbrust edited comment on SPARK-1508 at 6/4/14 7:27 PM:
-----------------------------------------------------------------
It is likely we will fix a related issue regarding calling collect on NativeCommands through the solution here.
was (Author: marmbrus):
It is likely we will fix this issue through the solution here.
> Add support for reading from SparkConf
> --------------------------------------
>
> Key: SPARK-1508
> URL: https://issues.apache.org/jira/browse/SPARK-1508
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Michael Armbrust
> Assignee: Zongheng Yang
> Fix For: 1.1.0
>
>
> Right now we have no ability to configure things in Spark SQL. A good start would be passing a SparkConf though the planner such that users could override the number of partitions used during an Exchange.
> Note that while current spark confs are immutable after the context is created, we want some ability to change settings on a per query basis.
--
This message was sent by Atlassian JIRA
(v6.2#6252)