[jira] [Assigned] (HADOOP-18287) Provide a shim library for modern FS APIs

["Steve Loughran (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HADOOP-18287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Steve Loughran reassigned HADOOP-18287:
---------------------------------------

    Assignee: Steve Loughran

> Provide a shim library for modern FS APIs
> -----------------------------------------
>
>                 Key: HADOOP-18287
>                 URL: https://issues.apache.org/jira/browse/HADOOP-18287
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: fs
>    Affects Versions: 3.3.0
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>            Priority: Major
>
> Add a shim library to give libraries and applications built against hadoop 3.2 access to APIs and features in later versions, especially those delivering higher performance in cloud deployments. This will give them the ability to invoke those APIs when available, so gain from the work everyone has done. Key APIs are:
> * openFile
> * ByteBufferPositionedReadable
> * Vectored IO
> The library will either downgrade gracefully to existing code (openFile) or simply thrown UnsupportedException when invoked -but offer probes for every operation before invocation.
> This module will compile against hadoop 3.2.0; it will be tested against that and later releases.
> We can and should release this on a different schedule; though ideally we should issue releases in sync with new hadoop releases adding new supported API calls.
> For that reason I think we could consider having separate git repository for it. Verifying that the shim works against hadoop PRs could actually become one of our regression tests -indeed, it should become one.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org