You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/01/29 22:44:00 UTC

[jira] [Created] (ARROW-4421) [Flight][C++] Handle large Flight data messages

Wes McKinney created ARROW-4421:
-----------------------------------

             Summary: [Flight][C++] Handle large Flight data messages
                 Key: ARROW-4421
                 URL: https://issues.apache.org/jira/browse/ARROW-4421
             Project: Apache Arrow
          Issue Type: Bug
          Components: C++
            Reporter: Wes McKinney
             Fix For: 0.13.0


I believe the message payloads are currently limited to 4MB by default, see one developer's discussion here:

https://nanxiao.me/en/message-length-setting-in-grpc/

While it is a good idea to break large messages into smaller ones, we will need to address how to gracefully send larger payloads that may be provided by a user's server implementation. Either we can increase the limit or break up the record batches into smaller chunks in the Flight server base (or both, of course)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)