You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "paleolimbot (via GitHub)" <gi...@apache.org> on 2024/02/13 17:23:13 UTC
[I] [Python] Support `requested_schema` in `__arrow_c_stream__` implementations [arrow]
paleolimbot opened a new issue, #40066:
URL: https://github.com/apache/arrow/issues/40066
### Describe the enhancement requested
As noted in https://github.com/apache/arrow/pull/39985#discussion_r1486364432 , we have a few ways available to us to cast a stream of record batches, and ideally we would do this batch-wise. In https://github.com/apache/arrow/pull/39985 I attempted a simple solution using `Table.cast()`; however, this was a little too simple and lazily-cast-per-batch solution will also make this work for the `RecordBatchReader` implementation.
I'm game to attempt a C++ solution to this...it is possible to do this using the "record batch from iterable" approach, too, but I think the C++ is reasonably compact and would avoid any involvement of the GIL/Python interpreter that could impact performance when using `requested_schema`.
### Component(s)
Python
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python] Support `requested_schema` in `__arrow_c_stream__` implementations [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche closed issue #40066: [Python] Support `requested_schema` in `__arrow_c_stream__` implementations
URL: https://github.com/apache/arrow/issues/40066
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org