You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Anton Okolnychyi (Jira)" <ji...@apache.org> on 2020/12/01 19:46:00 UTC

[jira] [Updated] (SPARK-33621) Add a way to inject data source rewrite rules

     [ https://issues.apache.org/jira/browse/SPARK-33621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Anton Okolnychyi updated SPARK-33621:
-------------------------------------
    Summary: Add a way to inject data source rewrite rules  (was: Add a way to inject optimization rules after expression optimization)

> Add a way to inject data source rewrite rules
> ---------------------------------------------
>
>                 Key: SPARK-33621
>                 URL: https://issues.apache.org/jira/browse/SPARK-33621
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.1.0
>            Reporter: Anton Okolnychyi
>            Priority: Major
>
> {{SparkSessionExtensions}} allow us to inject optimization rules but they are added to operator optimization batch. There are cases when users need to run rules after the operator optimization batch. Currently, this is not possible.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org