You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "mohammadnaqvi04 (via GitHub)" <gi...@apache.org> on 2026/10/01 15:19:43 UTC
Re: [I] General framework to decorrelate the subqueries [datafusion]
mohammadnaqvi04 commented on issue #5492:
URL: https://github.com/apache/datafusion/issues/5492#issuecomment-5934476405
👋 I'm picking back up on this work as part of a directed study for my graduate degree. I put together a doc proposing a correctness target we can implement against which is essentially a catalog of query shapes that the current decorrelator gets wrong (either a hard failure or a plan that returns the wrong answer). This'll give any new implementation something to verify against as it grows.
Plan doc: https://docs.google.com/document/d/1rZoOeiNcJw0OLSDgSqjA7PoA8cf2yAvU6Bc-4o4K4L4/edit?usp=sharing
Shape catalog: https://docs.google.com/document/d/10dQRna0Dc8XBB74SkKbfKvPE1SvjNkXKMAcPeK8DiEw/edit?usp=sharing
I'm working on a theoretical mapping from Neumann's paper to DataFusion's plan structures next. Would appreciate early feedback on the approach before I start building against it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org