You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Anton Okolnychyi (Jira)" <ji...@apache.org> on 2020/12/01 11:18:00 UTC

[jira] [Commented] (SPARK-33621) Add a way to inject optimization rules after expression optimization

    [ https://issues.apache.org/jira/browse/SPARK-33621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17241450#comment-17241450 ] 

Anton Okolnychyi commented on SPARK-33621:
------------------------------------------

I am going to submit a PR soon.

> Add a way to inject optimization rules after expression optimization
> --------------------------------------------------------------------
>
>                 Key: SPARK-33621
>                 URL: https://issues.apache.org/jira/browse/SPARK-33621
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.1.0
>            Reporter: Anton Okolnychyi
>            Priority: Major
>
> {{SparkSessionExtensions}} allow us to inject optimization rules but they are added to operator optimization batch. There are cases when users need to run rules after the operator optimization batch. Currently, this is not possible.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org