You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "lccnl (via GitHub)" <gi...@apache.org> on 2023/05/26 10:14:38 UTC

[GitHub] [arrow] lccnl opened a new issue, #35785: Support joinining tables with null columns

lccnl opened a new issue, #35785:
URL: https://github.com/apache/arrow/issues/35785

   ### Describe the enhancement requested
   
   Hello,
   currently pyarrow does not support performing a join between two tables if one has null columns even when it is not the joining column. For instance, this code will fail with pyarrow.lib.ArrowInvalid: Data type null is not supported in join non-key field:
   
   ```
   import pyarrow as pa
   
   
   tab1=pa.Table.from_arrays([pa.array([1,2]),pa.array([None,None])],names=['pk','null'])
   tab2=pa.Table.from_arrays([pa.array([1,1]),pa.array(['a','b'])],names=['fk','some'])
   
   tab1.join(right_table=tab2,keys='pk',right_keys='fk')
   ```
   
   It would be nice to enable this! 
   
   ### Component(s)
   
   C, Python


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Python] Support joinining tables with null columns [arrow]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #35785:
URL: https://github.com/apache/arrow/issues/35785#issuecomment-4343373812

   This issue has been marked as stale because it has had no activity in the past 365 days. Please remove the stale label or comment below, or this issue will be closed in 14 days. If this improvement is still desired but has no current owner, please add the 'Status: needs champion' label.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Python] Support joinining tables with null columns [arrow]

Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko commented on issue #35785:
URL: https://github.com/apache/arrow/issues/35785#issuecomment-2677742336

   We're also running into this at PyIceberg: https://github.com/apache/iceberg-python/issues/1711


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Python] Support joinining tables with null columns [arrow]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #35785: [Python] Support joinining tables with null columns
URL: https://github.com/apache/arrow/issues/35785


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org