You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "AlenkaF (via GitHub)" <gi...@apache.org> on 2023/10/03 13:45:25 UTC
[I] [Python][Interchange protocol] Export boolean columns as bit-packed values [arrow]
AlenkaF opened a new issue, #37991:
URL: https://github.com/apache/arrow/issues/37991
### Describe the enhancement requested
Currently we export boolean data as `unit8` in the DataFrame Interchange Protocol implementation. The reason for it is that other libraries did not support bit-packed boolean columns when consuming interchange objects at that time. Also it was not clear in the spec if bit- and byte-packed booleans are supported. See https://github.com/data-apis/dataframe-api/issues/227.
For this reason we could start exporting Arrow booleans as bit-packed in our implementation of the protocol. _I think_ this should not cause any breaking change, but can be wrong.
With this we will also be able to test the support of bit-packed booleans in the `from_dataframe`, see https://github.com/apache/arrow/pull/37975#issuecomment-1744941395.
cc @jorisvandenbossche
### Component(s)
Python
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][Interchange protocol] Export boolean columns as bit-packed values [arrow]
Posted by "AlenkaF (via GitHub)" <gi...@apache.org>.
AlenkaF closed issue #37991: [Python][Interchange protocol] Export boolean columns as bit-packed values
URL: https://github.com/apache/arrow/issues/37991
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][Interchange protocol] Export boolean columns as bit-packed values [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on issue #37991:
URL: https://github.com/apache/arrow/issues/37991#issuecomment-4388409750
If we are going to deprecate the interchange protocol (https://github.com/apache/arrow/issues/49629), this can probably be closed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][Interchange protocol] Export boolean columns as bit-packed values [arrow]
Posted by "stinodego (via GitHub)" <gi...@apache.org>.
stinodego commented on issue #37991:
URL: https://github.com/apache/arrow/issues/37991#issuecomment-1874170462
@AlenkaF I would support exporting booleans as bit-packed booleans. It is more in line with the protocol: zero copy if possible. It is up to the person implementing `from_dataframe` to handle reading bit-packed booleans. That is how I have implemented it in Polars.
I now have a special case for pyarrow's 8-bit boolean type, but I'd like to get rid of it if at all possible, as it doesn't make much sense, in my opinion.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][Interchange protocol] Export boolean columns as bit-packed values [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on issue #37991:
URL: https://github.com/apache/arrow/issues/37991#issuecomment-3921813629
This issue has been marked as stale because it has had no activity in the past 2 years. Please remove the stale label or comment below, or this issue will be closed in 14 days.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org