You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2016/01/13 11:20:39 UTC

[jira] [Updated] (SPARK-9843) Catalyst: Allow adding custom optimizers

     [ https://issues.apache.org/jira/browse/SPARK-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen updated SPARK-9843:
-----------------------------
    Assignee: Robert Kruszewski

> Catalyst: Allow adding custom optimizers
> ----------------------------------------
>
>                 Key: SPARK-9843
>                 URL: https://issues.apache.org/jira/browse/SPARK-9843
>             Project: Spark
>          Issue Type: New Feature
>          Components: SQL
>    Affects Versions: 1.4.1
>            Reporter: Robert Kruszewski
>            Assignee: Robert Kruszewski
>             Fix For: 2.0.0
>
>
> Currently there's only option to plug into query planning. This provides limited capability for optimizing queries.
> Allowing specifying custom optimizers would allow applications that make use of spark sql tune their workflows. One example would be inserting repartitions into query plan which isn't generally applicable but if you know range of possible queries you can do that on the backend.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org