You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Surendra Singh Lilhore (Jira)" <ji...@apache.org> on 2021/10/22 06:20:00 UTC
[jira] [Resolved] (HADOOP-17770) WASB : Support disabling buffered
reads in positional reads
[ https://issues.apache.org/jira/browse/HADOOP-17770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Surendra Singh Lilhore resolved HADOOP-17770.
---------------------------------------------
Fix Version/s: 3.3.2
Resolution: Fixed
> WASB : Support disabling buffered reads in positional reads
> -----------------------------------------------------------
>
> Key: HADOOP-17770
> URL: https://issues.apache.org/jira/browse/HADOOP-17770
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Anoop Sam John
> Assignee: Anoop Sam John
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.4.0, 3.3.2
>
> Attachments: AvgLatency_0 cache hit.png, AvgLatency_50% cache hit.png, Throughput_0 cache hit.png, Throughput_50% cache hit.png
>
> Time Spent: 5h 10m
> Remaining Estimate: 0h
>
> This is just like HADOOP-17038
> Right now it will do a seek to the position , read and then seek back to the old position. (As per the impl in the super class)
> In HBase kind of workloads we rely mostly on short preads. (like 64 KB size by default). So would be ideal to support a pure pos read API which will not even keep the data in a buffer but will only read the required data as what is asked for by the caller. (Not reading ahead more data as per the read size config)
> Allow an optional boolean config to be specified while opening file for read using which buffered pread can be disabled.
> FutureDataInputStreamBuilder openFile(Path path)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org