You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2020/12/02 21:27:00 UTC

[jira] [Commented] (SPARK-33621) Add a way to inject data source rewrite rules

    [ https://issues.apache.org/jira/browse/SPARK-33621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17242740#comment-17242740 ] 

Apache Spark commented on SPARK-33621:
--------------------------------------

User 'aokolnychyi' has created a pull request for this issue:
https://github.com/apache/spark/pull/30577

> Add a way to inject data source rewrite rules
> ---------------------------------------------
>
>                 Key: SPARK-33621
>                 URL: https://issues.apache.org/jira/browse/SPARK-33621
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.1.0
>            Reporter: Anton Okolnychyi
>            Priority: Major
>
> {{SparkSessionExtensions}} allow us to inject optimization rules but they are added to operator optimization batch. There are cases when users need to run rules after the operator optimization batch. Currently, this is not possible.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org