You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Robert Kruszewski (JIRA)" <ji...@apache.org> on 2015/12/09 01:05:10 UTC

[jira] [Reopened] (SPARK-9843) Catalyst: Allow adding custom optimizers

     [ https://issues.apache.org/jira/browse/SPARK-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Kruszewski reopened SPARK-9843:
--------------------------------------

Made a new PR. Let me know if anyone have feedback

> Catalyst: Allow adding custom optimizers
> ----------------------------------------
>
>                 Key: SPARK-9843
>                 URL: https://issues.apache.org/jira/browse/SPARK-9843
>             Project: Spark
>          Issue Type: New Feature
>          Components: SQL
>    Affects Versions: 1.4.1
>            Reporter: Robert Kruszewski
>
> Currently there's only option to plug into query planning. This provides limited capability for optimizing queries.
> Allowing specifying custom optimizers would allow applications that make use of spark sql tune their workflows. One example would be inserting repartitions into query plan which isn't generally applicable but if you know range of possible queries you can do that on the backend.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org