You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2025/09/20 00:21:00 UTC

[jira] [Commented] (HADOOP-19105) S3A: Recover from Vector IO read failures

    [ https://issues.apache.org/jira/browse/HADOOP-19105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18021523#comment-18021523 ] 

ASF GitHub Bot commented on HADOOP-19105:
-----------------------------------------

github-actions[bot] commented on PR #7105:
URL: https://github.com/apache/hadoop/pull/7105#issuecomment-3314278421

   We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.
   If you feel like this was a mistake, or you would like to continue working on it, please feel free to re-open it and ask for a committer to remove the stale tag and review again.
   Thanks all for your contribution.




> S3A: Recover from Vector IO read failures
> -----------------------------------------
>
>                 Key: HADOOP-19105
>                 URL: https://issues.apache.org/jira/browse/HADOOP-19105
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 3.4.0, 3.3.6
>         Environment: This keeps the public API stable
>            Reporter: Steve Loughran
>            Priority: Major
>              Labels: pull-request-available
>
> s3a vector IO doesn't try to recover from read failures the way read() does.
> Need to
> * abort HTTP stream if considered needed
> * retry active read which failed
> * but not those which had succeeded
> On a full failure we need to do something about any allocated buffer, which means we really need the buffer pool {{ByteBufferPool}} to return or also provide a "release" (Bytebuffer -> void) call which does the return.  we would need to
> * add this as a new api with the implementations in s3a, local, rawlocal
> * classic single allocator method remaps to the new one with (() -> null) as the response



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org