You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/11/03 13:10:53 UTC

[GitHub] [arrow-datafusion] Dandandan commented on issue #4093: Use roaring bitmap in hash join for tracking hash collisions

Dandandan commented on issue #4093:
URL: https://github.com/apache/arrow-datafusion/issues/4093#issuecomment-1302092719

   Hi - what parts exactly do you want to compress?
   Hash collisions are handled when matching the rows, they don't need to be kept in memory across batches.
   For joins that need to remember visited rows (left joins / left semi/left anti joins I believe) we are already using a bitmap based on Arrow.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org