You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2018/02/12 12:36:00 UTC
[jira] [Resolved] (HADOOP-14736) S3AInputStream to implement an
efficient skip() call through seeking
[ https://issues.apache.org/jira/browse/HADOOP-14736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Loughran resolved HADOOP-14736.
-------------------------------------
Resolution: Duplicate
I should fix HADOOP-14606 instead of filing the same bug whenever I look at the code
> S3AInputStream to implement an efficient skip() call through seeking
> --------------------------------------------------------------------
>
> Key: HADOOP-14736
> URL: https://issues.apache.org/jira/browse/HADOOP-14736
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Steve Loughran
> Priority: Major
>
> {{S3AInputStream}} implements skip() naively through the byte class: Reading and discarding all data. Efficient on classic "sequential" reads, provided the forward skip is <1MB. For larger skip values or on random IO, seek() should be used.
> After some range checks/handling past-EOF skips to seek (EOF-1), a seek() should handle the skip file.
> *there are no FS contract tests for skip semantics*
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org