[jira] [Resolved] (SPARK-9843) Catalyst: Allow adding custom optimizers

["Michael Armbrust (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael Armbrust resolved SPARK-9843.
-------------------------------------
       Resolution: Fixed
    Fix Version/s: 2.0.0

Issue resolved by pull request 10210
[https://github.com/apache/spark/pull/10210]

> Catalyst: Allow adding custom optimizers
> ----------------------------------------
>
>                 Key: SPARK-9843
>                 URL: https://issues.apache.org/jira/browse/SPARK-9843
>             Project: Spark
>          Issue Type: New Feature
>          Components: SQL
>    Affects Versions: 1.4.1
>            Reporter: Robert Kruszewski
>             Fix For: 2.0.0
>
>
> Currently there's only option to plug into query planning. This provides limited capability for optimizing queries.
> Allowing specifying custom optimizers would allow applications that make use of spark sql tune their workflows. One example would be inserting repartitions into query plan which isn't generally applicable but if you know range of possible queries you can do that on the backend.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org