You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "wjones127 (via GitHub)" <gi...@apache.org> on 2023/05/15 23:27:30 UTC
[GitHub] [arrow-rs] wjones127 opened a new issue, #4222: Make ArrowArrayStreamReader Send
wjones127 opened a new issue, #4222:
URL: https://github.com/apache/arrow-rs/issues/4222
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
ArrowArrayStreamReader is not Send, which makes is very difficult to work with in async contexts.
While [FFI_ArrowArrayStream](https://docs.rs/arrow/39.0.0/arrow/ffi_stream/struct.FFI_ArrowArrayStream.html) shouldn't be Sync, I do think it should be marked Send. From the [docs](https://arrow.apache.org/docs/format/CStreamInterface.html#thread-safety):
> The stream source is not assumed to be thread-safe. Consumers wanting to call `get_next` from several threads should ensure those calls are serialized.
**Describe the solution you'd like**
If `FFI_ArrowArrayStream` were marked `Send` and `ArrowArrayStreamReader` were refactored to hold the inner type in a Box rather than an Arc, then it would be `Send`.
**Describe alternatives you've considered**
<!--
A clear and concise description of any alternative solutions or features you've considered.
-->
**Additional context**
<!--
Add any other context or screenshots about the feature request here.
-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] tustvold commented on issue #4222: Make ArrowArrayStreamReader Send
Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold commented on issue #4222:
URL: https://github.com/apache/arrow-rs/issues/4222#issuecomment-1573883497
`label_issue.py` automatically added labels {'arrow'} from #4232
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] tustvold closed issue #4222: Make ArrowArrayStreamReader Send
Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold closed issue #4222: Make ArrowArrayStreamReader Send
URL: https://github.com/apache/arrow-rs/issues/4222
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org