You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/02 10:28:00 UTC

[jira] [Updated] (SPARK-37518) inject a early scan push down rule

     [ https://issues.apache.org/jira/browse/SPARK-37518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

jiaan.geng updated SPARK-37518:
-------------------------------
    Description: 
Currently, Spark supports push down filters, aggregates and limit. All the job is completed by V2ScanRelationPushDown.
But, V2ScanRelationPushDown have a lot limit.
Users want apply custom rule for push down after V2ScanRelationPushDown failed.

> inject a early scan push down rule
> ----------------------------------
>
>                 Key: SPARK-37518
>                 URL: https://issues.apache.org/jira/browse/SPARK-37518
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.3.0
>            Reporter: jiaan.geng
>            Priority: Major
>
> Currently, Spark supports push down filters, aggregates and limit. All the job is completed by V2ScanRelationPushDown.
> But, V2ScanRelationPushDown have a lot limit.
> Users want apply custom rule for push down after V2ScanRelationPushDown failed.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org