You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "neilconway (via GitHub)" <gi...@apache.org> on 2026/06/16 02:20:40 UTC

[I] Hash join dynamic filters are unsafe with null-equal joins [datafusion]

neilconway opened a new issue, #22964:
URL: https://github.com/apache/datafusion/issues/22964

   ### Describe the bug
   
   Hash join dynamic filter pushdown is unsafe when the join uses `NullEquality::NullEqualsNull`, such as joins with `IS NOT DISTINCT FROM` or set operations like `INTERSECT`.
   
   Dynamic filters derived from the build side can be pushed into the probe-side input, where they will not be evaluated with the required null-equal join semantics. i.e., NULL-containing rows might be pruned somewhere within the probe-side plan and won't make it to the join operator.
   
   ### To Reproduce
   
   _No response_
   
   ### Expected behavior
   
   _No response_
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [I] Hash join dynamic filters are unsafe with null-equal joins [datafusion]

Posted by "adriangb (via GitHub)" <gi...@apache.org>.
adriangb closed issue #22964: Hash join dynamic filters are unsafe with null-equal joins
URL: https://github.com/apache/datafusion/issues/22964


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [I] Hash join dynamic filters are unsafe with null-equal joins [datafusion]

Posted by "neilconway (via GitHub)" <gi...@apache.org>.
neilconway commented on issue #22964:
URL: https://github.com/apache/datafusion/issues/22964#issuecomment-4714248517

   take


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [I] Hash join dynamic filters are unsafe with null-equal joins [datafusion]

Posted by "adriangb (via GitHub)" <gi...@apache.org>.
adriangb commented on issue #22964:
URL: https://github.com/apache/datafusion/issues/22964#issuecomment-4719282402

   Fixed 😄 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org