You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Allen Wittenauer (JIRA)" <ji...@apache.org> on 2014/07/22 21:34:40 UTC

[jira] [Updated] (HADOOP-5814) NativeS3FileSystem doesn't report progress when writing

     [ https://issues.apache.org/jira/browse/HADOOP-5814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Allen Wittenauer updated HADOOP-5814:
-------------------------------------

    Resolution: Incomplete
        Status: Resolved  (was: Patch Available)

I suspect this is stale.  If not, please open a new jira. Thanks!

> NativeS3FileSystem doesn't report progress when writing
> -------------------------------------------------------
>
>                 Key: HADOOP-5814
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5814
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/s3
>            Reporter: Tom White
>              Labels: S3Native
>         Attachments: HADOOP-5814(1).patch, HADOOP-5814.patch
>
>
> This results in timeouts since the whole file is uploaded in the close method. See http://www.mail-archive.com/core-user@hadoop.apache.org/msg09881.html.
> One solution is to keep a reference to the Progressable passed in to the NativeS3FsOutputStream's constructor, and progress it during writes, and while copying the backup file to S3 in the close method.



--
This message was sent by Atlassian JIRA
(v6.2#6252)