You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "Dandandan (via GitHub)" <gi...@apache.org> on 2024/10/18 17:36:00 UTC
Re: [I] CrossJoin Implementation on (M x N) Partitions [datafusion]
Dandandan commented on issue #9941:
URL: https://github.com/apache/datafusion/issues/9941#issuecomment-2422941548
How would this work?
At this moment the entire left side is loaded in memory, basically performing a
https://en.m.wikipedia.org/wiki/Block_nested_loop with all data loaded into memory.
The left child plan can be executed in parallel.
Not loading all seems to require scanning one side more than once?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org