[jira] [Created] (ARROW-15340) [C++] Try and fetch IPC footer in one read instead of two

["Weston Pace (Jira)" <ji...@apache.org>]

Weston Pace created ARROW-15340:
-----------------------------------

             Summary: [C++] Try and fetch IPC footer in one read instead of two
                 Key: ARROW-15340
                 URL: https://issues.apache.org/jira/browse/ARROW-15340
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: Weston Pace


To concisely read the IPC footer we must do two reads.  First read the footer length and then read the footer contents.

On high latency filesystems we can cut down some of this startup time by assuming the footer is going to be relatively small and reading the last ~1MB of the file.  Then we only need to do two reads if the footer is larger.

This means most of the time we can usually get away with 1 read at the expense of possibly reading more data than needed.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)