[jira] [Updated] (HADOOP-18854) add options to disable range merging of vectored io

["Steve Loughran (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HADOOP-18854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Steve Loughran updated HADOOP-18854:
------------------------------------
        Parent: HADOOP-18855
    Issue Type: Sub-task  (was: Improvement)

> add options to disable range merging of vectored io
> ---------------------------------------------------
>
>                 Key: HADOOP-18854
>                 URL: https://issues.apache.org/jira/browse/HADOOP-18854
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs, fs/s3
>    Affects Versions: 3.3.5, 3.3.6
>            Reporter: Steve Loughran
>            Priority: Major
>
> I'm seeing test failures in my PARQUET-2171 pr because assertions about the #of bytes read isn't holding -small files are being read and the vector range merging is pulling in the whole file.
> ```
> [ERROR]   TestInputOutputFormat.testReadWriteWithCounter:338 bytestotal != bytesread expected:<5510> but was:<11020>
> ```
> I think for parquet i will add an option to disable vector io, but really the filesystems which support it should allow for merging to be disabled



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org