You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nifi.apache.org by "Mark Payne (JIRA)" <ji...@apache.org> on 2015/12/31 22:19:39 UTC
[jira] [Commented] (NIFI-937) PutS3 Processor cannot upload files
larger than 5 GB
[ https://issues.apache.org/jira/browse/NIFI-937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15076138#comment-15076138 ]
Mark Payne commented on NIFI-937:
---------------------------------
[~jskora] - is there anything to be done for this ticket, or is the solution just to implement that processor discussed in NIFI-1107? I'm wondering if we can just close this ticket as a duplicate of 1107?
> PutS3 Processor cannot upload files larger than 5 GB
> ----------------------------------------------------
>
> Key: NIFI-937
> URL: https://issues.apache.org/jira/browse/NIFI-937
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
> Affects Versions: 0.3.0
> Reporter: John Titus
> Assignee: Joe Skora
> Priority: Minor
> Labels: beginner
> Fix For: 0.5.0
>
>
> Tried to use the PutS3 processor to upload a large file. Got the error shown below.
> S3 doesn't allow you to upload > 5GB unless you use multi-part upload. It'd be nice if the processor handled this transparently, as the aws cli does.
> 2015-09-08 14:20:38,991 ERROR [Timer-Driven Process Thread-6] o.a.nifi.processors.aws.s3.PutS3Object
> PutS3Object[id=14280a26-a34a-47f6-aa7e-df404c960634] Failed to put StandardFlowFileRecord[uuid=ba7e
> 8332-4140-44f4-a71d-e5529f0ab6ad,claim=1441721637937-1157587,offset=0,name=redacted,size
> =5672981796] to Amazon S3 due to com.amazonaws.services.s3.model.AmazonS3Exception: Your proposed up
> load exceeds the maximum allowed size (Service: Amazon S3; Status Code: 400; Error Code: EntityTooLa
> rge; Request ID: 56B1AE1E6D8068C0), S3 Extended Request ID: lQImEwX+c7TUC3+Qr97kFult/95qinlRTFM/CF6v
> Z4b9DQwbwCn6auAc8epWlfHmHaU3AZCEvDc=: com.amazonaws.services.s3.model.AmazonS3Exception: Your propos
> ed upload exceeds the maximum allowed size (Service: Amazon S3; Status Code: 400; Error Code: Entity
> TooLarge; Request ID: 56B1AE1E6D8068C0), S3 Extended Request ID: lQImEwX+c7TUC3+Qr97kFult/95qinlRTFM
> /CF6vZ4b9DQwbwCn6auAc8epWlfHmHaU3AZCEvDc=
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)