You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Surendra Singh Lilhore (Jira)" <ji...@apache.org> on 2021/02/16 17:01:01 UTC
[jira] [Resolved] (HADOOP-17038) Support disabling buffered reads
in ABFS positional reads
[ https://issues.apache.org/jira/browse/HADOOP-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Surendra Singh Lilhore resolved HADOOP-17038.
---------------------------------------------
Fix Version/s: 3.4.0
Resolution: Fixed
Committed to trunk. Thanks [~anoop.hbase].
> Support disabling buffered reads in ABFS positional reads
> ---------------------------------------------------------
>
> Key: HADOOP-17038
> URL: https://issues.apache.org/jira/browse/HADOOP-17038
> Project: Hadoop Common
> Issue Type: Sub-task
> Reporter: Anoop Sam John
> Assignee: Anoop Sam John
> Priority: Major
> Labels: HBase, abfsactive, pull-request-available
> Fix For: 3.4.0
>
> Attachments: HBase Perf Test Report.xlsx, screenshot-1.png
>
> Time Spent: 8h 50m
> Remaining Estimate: 0h
>
> Right now it will do a seek to the position , read and then seek back to the old position. (As per the impl in the super class)
> In HBase kind of workloads we rely mostly on short preads. (like 64 KB size by default). So would be ideal to support a pure pos read API which will not even keep the data in a buffer but will only read the required data as what is asked for by the caller. (Not reading ahead more data as per the read size config)
> Allow an optional boolean config to be specified while opening file for read using which buffered pread can be disabled.
> FutureDataInputStreamBuilder openFile(Path path)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org