You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Surendra Singh Lilhore (Jira)" <ji...@apache.org> on 2021/02/16 17:01:01 UTC

[jira] [Resolved] (HADOOP-17038) Support disabling buffered reads in ABFS positional reads

     [ https://issues.apache.org/jira/browse/HADOOP-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Surendra Singh Lilhore resolved HADOOP-17038.
---------------------------------------------
    Fix Version/s: 3.4.0
       Resolution: Fixed

Committed to trunk. Thanks [~anoop.hbase].

> Support disabling buffered reads in ABFS positional reads
> ---------------------------------------------------------
>
>                 Key: HADOOP-17038
>                 URL: https://issues.apache.org/jira/browse/HADOOP-17038
>             Project: Hadoop Common
>          Issue Type: Sub-task
>            Reporter: Anoop Sam John
>            Assignee: Anoop Sam John
>            Priority: Major
>              Labels: HBase, abfsactive, pull-request-available
>             Fix For: 3.4.0
>
>         Attachments: HBase Perf Test Report.xlsx, screenshot-1.png
>
>          Time Spent: 8h 50m
>  Remaining Estimate: 0h
>
> Right now it will do a seek to the position , read and then seek back to the old position.  (As per the impl in the super class)
> In HBase kind of workloads we rely mostly on short preads. (like 64 KB size by default).  So would be ideal to support a pure pos read API which will not even keep the data in a buffer but will only read the required data as what is asked for by the caller. (Not reading ahead more data as per the read size config)
> Allow an optional boolean config to be specified while opening file for read using which buffered pread can be disabled. 
> FutureDataInputStreamBuilder openFile(Path path)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org