You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Wes McKinney (Jira)" <ji...@apache.org> on 2020/05/06 21:00:06 UTC

[jira] [Closed] (ARROW-8719) Stream data easily- function to convert record batch to streamable format

     [ https://issues.apache.org/jira/browse/ARROW-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wes McKinney closed ARROW-8719.
-------------------------------
    Resolution: Information Provided

> Stream data easily- function to convert record batch to streamable format
> -------------------------------------------------------------------------
>
>                 Key: ARROW-8719
>                 URL: https://issues.apache.org/jira/browse/ARROW-8719
>             Project: Apache Arrow
>          Issue Type: Wish
>          Components: C
>         Environment: Linux
>            Reporter: Steven
>            Priority: Minor
>              Labels: buffer, data-transfer, socket
>         Attachments: code.zip
>
>
> I am currently working on a project that  need to send the data in different processes. Instead of storing it in a file, I am using the IPC stream method, storing it into a buffer. When I try to send the data(bytes) through a socket, I loose the data in the client side. ( Which gives me the idea that when i leave the function(create buffer in the server side folder), I loose acces to that data. Can there be an example that explains this. 
> Also, can you implement a function that convert the record batch into the format that can be sent through the socket directly.
>  
> The code are in the attachment, one for the server side code and the other for the client side code.
> Thank you



--
This message was sent by Atlassian Jira
(v8.3.4#803005)