[jira] [Created] (HADOOP-19098) Vector IO: consistent specified rejection of overlapping ranges

["Steve Loughran (Jira)" <ji...@apache.org>]

Steve Loughran created HADOOP-19098:
---------------------------------------

             Summary: Vector IO: consistent specified rejection of overlapping ranges
                 Key: HADOOP-19098
                 URL: https://issues.apache.org/jira/browse/HADOOP-19098
             Project: Hadoop Common
          Issue Type: Improvement
          Components: fs, fs/s3
    Affects Versions: 3.3.6
            Reporter: Steve Loughran
            Assignee: Steve Loughran


Related to PARQUET-2171 q: "how do you deal with overlapping ranges?"

I believe s3a rejects this, but the other impls may not.

Proposed

FS spec to say 
* "overlap triggers IllegalArgumentException". 
* special case: 0 byte ranges may be short circuited to return empty buffer even without checking file length etc.

Contract tests to validate this

(+ common helper code to do this).

I'll copy the validation stuff into the parquet PR for consistency with older releases



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org