You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/02/01 09:41:00 UTC

[jira] [Work logged] (HADOOP-16906) Add some Abortable.abort() interface for streams etc which can be terminated

     [ https://issues.apache.org/jira/browse/HADOOP-16906?focusedWorklogId=545210&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-545210 ]

ASF GitHub Bot logged work on HADOOP-16906:
-------------------------------------------

                Author: ASF GitHub Bot
            Created on: 01/Feb/21 09:40
            Start Date: 01/Feb/21 09:40
    Worklog Time Spent: 10m 
      Work Description: HeartSaVioR opened a new pull request #2667:
URL: https://github.com/apache/hadoop/pull/2667


   NOTE: WIP. DO-NOT-MERGE.
   
   No meaningful tests have been added, as I have no idea where I can add it, and how s3a has been tested
   with integration test manner. (Tests in TestS3ABlockOutputStream only check simple things with mocking
   everything, so can't do some write/upload test with it.)
   
   I got some review comments from @steveloughran in my commit, and will reflect these review comments.
   
   Once it's done I'll remove WIP.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

            Worklog Id:     (was: 545210)
    Remaining Estimate: 0h
            Time Spent: 10m

> Add some Abortable.abort() interface for streams etc which can be terminated
> ----------------------------------------------------------------------------
>
>                 Key: HADOOP-16906
>                 URL: https://issues.apache.org/jira/browse/HADOOP-16906
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs, fs/azure, fs/s3
>    Affects Versions: 3.3.0
>            Reporter: Steve Loughran
>            Priority: Minor
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Some IO we want to be able to abort rather than close cleanly, especially if the inner stream is an HTTP connection which itself supports some abort() method. For example: uploads to an object where we want to cancel the upload without close() making an incomplete write visible.
> Proposed: Add a generic interface which things like streams can implement
> {code}
> AbortableIO {
>   public void abortIO() throws IOE;
> }
> {code}
> +do for s3a output stream. I wouldn't do this a passthrough on FSDataOutputStream because we need to consider what expectations callers have of an operation being "aborted"



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org