You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Tom White (JIRA)" <ji...@apache.org> on 2009/05/12 18:33:45 UTC

[jira] Created: (HADOOP-5814) NativeS3FileSystem doesn't report progress when writing

NativeS3FileSystem doesn't report progress when writing
-------------------------------------------------------

                 Key: HADOOP-5814
                 URL: https://issues.apache.org/jira/browse/HADOOP-5814
             Project: Hadoop Core
          Issue Type: Improvement
          Components: fs/s3
            Reporter: Tom White


This results in timeouts since the whole file is uploaded in the close method. See http://www.mail-archive.com/core-user@hadoop.apache.org/msg09881.html.

One solution is to keep a reference to the Progressable passed in to the NativeS3FsOutputStream's constructor, and progress it during writes, and while copying the backup file to S3 in the close method.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.