You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@arrow.apache.org by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2019/08/26 12:54:00 UTC

[jira] [Created] (ARROW-6357) [C++] S3: allow for background writes

Antoine Pitrou created ARROW-6357:
-------------------------------------

             Summary: [C++] S3: allow for background writes
                 Key: ARROW-6357
                 URL: https://issues.apache.org/jira/browse/ARROW-6357
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: Antoine Pitrou


S3 writes can be synchronous: when a part is uploaded, Write() will only return once the server has received the contents and responded "Ok".

We may want to add a S3 option to issue writes in the background (e.g. using the S3 client's asynchronous APIs).

Another possibility is to provide a general OutputStream implementation that backgrounds writes (this should be independent of BufferedOutputStream, though, because S3FileSystem already has its own buffering layer).




--
This message was sent by Atlassian Jira
(v8.3.2#803003)