You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@cloudstack.apache.org by "Tanner Danzey (JIRA)" <ji...@apache.org> on 2014/04/20 20:33:15 UTC

[jira] [Comment Edited] (CLOUDSTACK-4171) Xen/XCP snapshot uploading to S3 server should use multipart upload API.

    [ https://issues.apache.org/jira/browse/CLOUDSTACK-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13975214#comment-13975214 ] 

Tanner Danzey edited comment on CLOUDSTACK-4171 at 4/20/14 6:32 PM:
--------------------------------------------------------------------

This seems to be at least tangentially related to my recent issue @ https://issues.apache.org/jira/browse/CLOUDSTACK-6397

Without uploads > 5GB, using S3 is basically useless.


was (Author: arkaniad):
This seems to be at least tangentially related to my recent issue @ https://issues.apache.org/jira/browse/CLOUDSTACK-6397

Without uploads > 5GB, using S3 is all but useless..

> Xen/XCP snapshot uploading to S3 server should use multipart upload API.
> ------------------------------------------------------------------------
>
>                 Key: CLOUDSTACK-4171
>                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4171
>             Project: CloudStack
>          Issue Type: Improvement
>      Security Level: Public(Anyone can view this level - this is the default.) 
>    Affects Versions: 4.2.0
>            Reporter: Thomas O'Dowd
>
> Currently when a snapshot is being uploaded to S3, it uses a single S3 PUT request. Snapshots can be large and Amazon recommends using the multipart upload API once the payload reaches 100MB [1] although it's possible to use the single object PUT api up until 5GB.
> From the SMlog we can see the single PUT being used:
> [16279] 2013-08-02 08:48:54.730958 #### VMOPS Sent PUT request to s3.cloudian.com:18080/images/snapshots/5a28d935-47da-4813-a692-db92761ce7de with headers {'Content-Length': '50430464', 'Content-MD5': 'oafg2xPUPPAnyE1sxmf+qA==', 'Expect': '100-continue', 'Date': 'Fri, 02 Aug 2013 08:48:52 +0000', 'Content-Type': 'application/octet-stream', 'Authorization': 'AWS 00ba9a7f9a8142b070c3:fy03ARq2UQWKW2UndUSYJ/E+QfI='}. Received response status 200: OK ####
> [1] http://docs.aws.amazon.com/AmazonS3/latest/dev/UploadingObjects.html



--
This message was sent by Atlassian JIRA
(v6.2#6252)