You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "ygf11 (via GitHub)" <gi...@apache.org> on 2023/02/13 12:34:50 UTC
[GitHub] [arrow-datafusion] ygf11 opened a new issue, #5265: Some In/Exists Subqueries will generate wrong PhysicalPlan
ygf11 opened a new issue, #5265:
URL: https://github.com/apache/arrow-datafusion/issues/5265
**Describe the bug**
Datafusion can't execute non-correlated subquery now, like in/exists.
So these queries should return `NotImplemented("Physical plan does not support logical expression In/Exists` error. But currently the filter will be pushdown to the TableScan.
```sql
> explain select * from t1 where exists(select 1 from t2 where t2.t2_id > 0);
+---------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+
| plan_type | plan |
+---------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+
| logical_plan | Projection: t1.t1_id, t1.t1_name, t1.t1_int |
| | TableScan: t1 projection=[t1_id, t1_name, t1_int], full_filters=[EXISTS (<subquery>)] |
| | Subquery: |
| | Projection: Int64(1) |
| | Filter: CAST(t2.t2_id AS Int64) > Int64(0) |
| | TableScan: t2 |
| physical_plan | ProjectionExec: expr=[t1_id@0 as t1_id, t1_name@1 as t1_name, t1_int@2 as t1_int] |
| | CsvExec: files={1 group: [[home/work/tools/datafusion-test-data/join-context/t1.csv]]}, has_header=false, limit=None, projection=[t1_id, t1_name, t1_int] |
| | |
+---------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+
```
For the above query, the subquery filter will be lost in the final `physical_plan`.
**To Reproduce**
As above.
**Expected behavior**
The query should return `NotImplemented("Physical plan does not support logical expression In/Exists` error.
**Additional context**
Add any other context about the problem here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] mingmwang commented on issue #5265: Some In/Exists Subqueries will generate wrong PhysicalPlan
Posted by "mingmwang (via GitHub)" <gi...@apache.org>.
mingmwang commented on issue #5265:
URL: https://github.com/apache/arrow-datafusion/issues/5265#issuecomment-1432532905
I remember the filters will be added to wrong side. I can work on this and provide a fix.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org