You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/05/07 20:09:51 UTC
[GitHub] [arrow-datafusion] jon-chuang opened a new issue, #2480: [Feature] Logical optimizer should walk subqueries
jon-chuang opened a new issue, #2480:
URL: https://github.com/apache/arrow-datafusion/issues/2480
**Describe the solution you'd like**
Logical optimizer only walks LogicalPlan node inputs. However, realistically, every optimizer should now also walk every subquery by matching on `Filter(Filter { expr: conjunction(vec![.., InSubquery/Exists { subquery }, ..] }` and optimize the subquery too.
One solution may be to declare subqueries as one of the inputs to the plan nodes...? However, this may "denormalize" certain things, so it may be better to add a helper function (based on e.g. visit/accept) that makes it easy for all optimizations to detect and walk subqueries.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] (All) logical optimizers should optimize subqueries [datafusion]
Posted by "LorrensP-2158466 (via GitHub)" <gi...@apache.org>.
LorrensP-2158466 commented on issue #2480:
URL: https://github.com/apache/datafusion/issues/2480#issuecomment-2736410806
I'm interested in applying for GSoC this year for this [project idea](https://github.com/apache/datafusion/issues/5483) which links the EPIC where this issue is mentioned in. Since I'm interested I thought about contributing again to Datafusion.
Is there still work to be done on this or did this [pr](https://github.com/apache/datafusion/pull/13066) already implement it?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [Feature] (All) logical optimizers should optimize subqueries [datafusion]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed issue #2480: [Feature] (All) logical optimizers should optimize subqueries
URL: https://github.com/apache/datafusion/issues/2480
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [Feature] (All) logical optimizers should optimize subqueries [datafusion]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #2480:
URL: https://github.com/apache/datafusion/issues/2480#issuecomment-3927665995
> Is there still work to be done on this or did this https://github.com/apache/datafusion/pull/13066 already implement it?
I agree I think this is already complete
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org