You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@arrow.apache.org by "Steven (Jira)" <ji...@apache.org> on 2020/05/06 17:10:00 UTC

[jira] [Created] (ARROW-8719) Stream data easily- function to convert record batch to streamable format

Steven created ARROW-8719:
-----------------------------

             Summary: Stream data easily- function to convert record batch to streamable format
                 Key: ARROW-8719
                 URL: https://issues.apache.org/jira/browse/ARROW-8719
             Project: Apache Arrow
          Issue Type: Wish
          Components: C
         Environment: Linux
            Reporter: Steven
         Attachments: code.zip

I am currently working on a project that  need to send the data in different processes. Instead of storing it in a file, I am using the IPC stream method, storing it into a buffer. When I try to send the data(bytes) through a socket, I loose the data in the client side. ( Which gives me the idea that when i leave the function(create buffer in the server side folder), I loose acces to that data. Can there be an example that explains this. 

Also, can you implement a function that convert the record batch into the format that can be sent through the socket directly.

 

The code are in the attachment, one for the server side code and the other for the client side code.

Thank you



--
This message was sent by Atlassian Jira
(v8.3.4#803005)