You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/11/15 11:09:00 UTC
[jira] [Resolved] (SPARK-26018) Support Scalar subqueries in
predicate push down to datasources
[ https://issues.apache.org/jira/browse/SPARK-26018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Marco Gaido resolved SPARK-26018.
---------------------------------
Resolution: Won't Fix
This may be very hard to do as we now add filters to datasources from logical plans, hence we cannot get the result from ScalarSubqueries there. This may be probably easier to be done in the context of adaptive execution. Hence I am closing this as "Won't Fix" for now.
Please [~cloud_fan] feel free to reopen if you don't agree with my analysis above and/or you think this can be achieved also now. Thanks.
> Support Scalar subqueries in predicate push down to datasources
> ---------------------------------------------------------------
>
> Key: SPARK-26018
> URL: https://issues.apache.org/jira/browse/SPARK-26018
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Marco Gaido
> Priority: Major
>
> As of now, existing datasources are not using filters containing scalar subqueries for their predicate pushdown. This ticket aims to support that as a result of the discussion in https://github.com/apache/spark/pull/22518.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org