Re: [PR] WIP: experiment with SMJ last buffered batch [datafusion]

["korowa (via GitHub)" <gi...@apache.org>]

korowa commented on PR #12082:
URL: https://github.com/apache/datafusion/pull/12082#issuecomment-2323295998

   > `range` are the row indices of the `batch` in the `BufferedBatch` which have the same join key. Not related to match or not.
   
   That matches my understanding of these ranges in buffered batches.
   
   > Like `[1..3]` for join key 1 and then `[0..1]` for join key 2, which looks weird for me and it seems like unexpected? WDYT?
   
   @comphead, I've tried your example and what I see while debugging, there are 3 "versions" of buffered data with the following ranges
   ```
   0..1 // join key 0
   
   1..3 // join key 1, first right batch
   0..2 // join key 1, second right batch
   
   2..3 // join key 2
   ```
   I'm able to see them before and after `join_partial` call.
   
   At what point in the code you are able to observe `0..1` for the key 2?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org