[jira] [Commented] (ARROW-8152) [C++] IO: split large coalesced reads into smaller ones

["Wes McKinney (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-8152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17062119#comment-17062119 ] 

Wes McKinney commented on ARROW-8152:
-------------------------------------

What do you think about introducing the read parallelism as an option in 

https://github.com/apache/arrow/blob/master/cpp/src/arrow/io/caching.h

? It might make sense to introduce an options struct so we can't cramming a bunch of parameters into the {{Cache}} method here

> [C++] IO: split large coalesced reads into smaller ones
> -------------------------------------------------------
>
>                 Key: ARROW-8152
>                 URL: https://issues.apache.org/jira/browse/ARROW-8152
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++
>            Reporter: David Li
>            Priority: Major
>
> We have a facility to coalesce small reads, but remote filesystems may also benefit from splitting large reads to take advantage of concurrency.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)