You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Steven (Jira)" <ji...@apache.org> on 2020/05/06 17:10:00 UTC
[jira] [Created] (ARROW-8719) Stream data easily- function to
convert record batch to streamable format
Steven created ARROW-8719:
-----------------------------
Summary: Stream data easily- function to convert record batch to streamable format
Key: ARROW-8719
URL: https://issues.apache.org/jira/browse/ARROW-8719
Project: Apache Arrow
Issue Type: Wish
Components: C
Environment: Linux
Reporter: Steven
Attachments: code.zip
I am currently working on a project that need to send the data in different processes. Instead of storing it in a file, I am using the IPC stream method, storing it into a buffer. When I try to send the data(bytes) through a socket, I loose the data in the client side. ( Which gives me the idea that when i leave the function(create buffer in the server side folder), I loose acces to that data. Can there be an example that explains this.
Also, can you implement a function that convert the record batch into the format that can be sent through the socket directly.
The code are in the attachment, one for the server side code and the other for the client side code.
Thank you
--
This message was sent by Atlassian Jira
(v8.3.4#803005)