You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Ian Cook (Jira)" <ji...@apache.org> on 2022/06/22 20:01:00 UTC
[jira] [Commented] (ARROW-16882) Allow to pick comparison function for pyarrow joins
[ https://issues.apache.org/jira/browse/ARROW-16882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557673#comment-17557673 ]
Ian Cook commented on ARROW-16882:
----------------------------------
To clarify: Do you want the ability for null values in the key column of the left table to match null values in the key column of the right table in a join?
The way that some SQL databases deal with this is by using the {{IS NOT DISTINCT FROM}} operator in join conditions:
{code:java}
x IS NOT DISTINCT FROM y{code}
There is also a shorthand for this:
{code:java}
x <=> y {code}
> Allow to pick comparison function for pyarrow joins
> ---------------------------------------------------
>
> Key: ARROW-16882
> URL: https://issues.apache.org/jira/browse/ARROW-16882
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Python
> Affects Versions: 8.0.0
> Reporter: Alessandro Molina
> Assignee: Alessandro Molina
> Priority: Critical
> Fix For: 9.0.0
>
>
> See https://github.com/apache/arrow/issues/13408
> We probably want to allow end users to pick {{JoinKeyCmp::EQ}} or {{JoinKeyCmp::IS}} to perform the comparison
--
This message was sent by Atlassian Jira
(v8.20.7#820007)