You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "ozankabak (via GitHub)" <gi...@apache.org> on 2023/03/17 19:27:03 UTC

[GitHub] [arrow-datafusion] ozankabak commented on issue #5220: Use `MemoryManager` in Join operators, and return errors if the memory budget is exceeded

ozankabak commented on issue #5220:
URL: https://github.com/apache/arrow-datafusion/issues/5220#issuecomment-1474307707

   > My proposal here would be to file separate issue for SymmetricHashJoinExec memory management, and (as I see it) implement memory limitation along with data spilling. Maybe, we can go for it when we have reliable spilling for HashJoinExec, however, prior to it is also an option.
   
   At a quick glance, this sounds reasonable. But we will do some deeper thinking on this and come back to share our thoughts.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org