You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "Neltherion (via GitHub)" <gi...@apache.org> on 2023/01/24 16:42:20 UTC
[GitHub] [arrow] Neltherion commented on issue #11239: [Python] Any replacements for `pa.serialize()` and `pa.deserialize()` ?
Neltherion commented on issue #11239:
URL: https://github.com/apache/arrow/issues/11239#issuecomment-1402251969
It's not about ZMQ: Pickle5 gives us a list of buffers and a serialized object. If we want to send them together, we have to somehow stick them together which results in memory copies, and sending them one by one would result in complexities along the way (packets not getting there, book-keeping the received data and sticking them using `pickle.load()`, etc...). If there is a way to stick them together in a serialized state, not ZMQ nor any other legacy code would have difficulties but as of now, I haven't found a way to keep these two objects together.
So how are we able to fully use this new feature, without somehow keeping these two different objects separate?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org