You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Robert Kruszewski (JIRA)" <ji...@apache.org> on 2015/08/11 22:28:45 UTC

[jira] [Created] (SPARK-9843) Catalyst: Allow adding custom optimizers

Robert Kruszewski created SPARK-9843:
----------------------------------------

             Summary: Catalyst: Allow adding custom optimizers
                 Key: SPARK-9843
                 URL: https://issues.apache.org/jira/browse/SPARK-9843
             Project: Spark
          Issue Type: New Feature
          Components: SQL
    Affects Versions: 1.4.1
            Reporter: Robert Kruszewski


Currently there's only option to plug into query planning. This provides limited capability for optimizing queries.

Allowing specifying custom optimizers would allow applications that make use of spark sql tune their workflows. One example would be inserting repartitions into query plan which isn't generally applicable but if you know range of possible queries you can do that on the backend.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org