You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "lccnl (via GitHub)" <gi...@apache.org> on 2023/05/26 10:14:38 UTC
[GitHub] [arrow] lccnl opened a new issue, #35785: Support joinining tables with null columns
lccnl opened a new issue, #35785:
URL: https://github.com/apache/arrow/issues/35785
### Describe the enhancement requested
Hello,
currently pyarrow does not support performing a join between two tables if one has null columns even when it is not the joining column. For instance, this code will fail with pyarrow.lib.ArrowInvalid: Data type null is not supported in join non-key field:
```
import pyarrow as pa
tab1=pa.Table.from_arrays([pa.array([1,2]),pa.array([None,None])],names=['pk','null'])
tab2=pa.Table.from_arrays([pa.array([1,1]),pa.array(['a','b'])],names=['fk','some'])
tab1.join(right_table=tab2,keys='pk',right_keys='fk')
```
It would be nice to enable this!
### Component(s)
C, Python
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python] Support joinining tables with null columns [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #35785:
URL: https://github.com/apache/arrow/issues/35785#issuecomment-4343373812
This issue has been marked as stale because it has had no activity in the past 365 days. Please remove the stale label or comment below, or this issue will be closed in 14 days. If this improvement is still desired but has no current owner, please add the 'Status: needs champion' label.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python] Support joinining tables with null columns [arrow]
Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko commented on issue #35785:
URL: https://github.com/apache/arrow/issues/35785#issuecomment-2677742336
We're also running into this at PyIceberg: https://github.com/apache/iceberg-python/issues/1711
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python] Support joinining tables with null columns [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #35785: [Python] Support joinining tables with null columns
URL: https://github.com/apache/arrow/issues/35785
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org