You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nifi.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2015/11/12 19:45:11 UTC

[jira] [Commented] (NIFI-1107) Create new PutS3ObjectMultipart processor

    [ https://issues.apache.org/jira/browse/NIFI-1107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002609#comment-15002609 ] 

ASF GitHub Bot commented on NIFI-1107:
--------------------------------------

GitHub user jskora opened a pull request:

    https://github.com/apache/nifi/pull/121

    NIFI-1107 - Create new PutS3ObjectMultipart processor

    Changes to create new PutS3ObjectMultipart processor.  This includes extending other S3 processor classes to support SSL connection service, enable new ENDPOINT_OVERRIDE property, and update processor reference annotations.
        * Add nifi-ssl-context-service-api dependency to nifi-aws-processors.
        * Add nifi-ssl-context-service-nar to nifi-aws-nar.
        * Add PutS3ObjectMultipart to META-INF/services/org.apache.nifi.processor.Processors.
        * New class PutS3ObjectMultipart.java and test TestPutS3ObjectMultipart.java.
        * Add ENDPOINT_OVERRIDE to allow use of S3 processors with S3 compatible services in addition to Amazon.


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/jskora/nifi NIFI-1107

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/nifi/pull/121.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #121
    
----
commit b4a054c10be315b82794523afe27d9a1d2b65dfb
Author: Joe Skora <js...@gmail.com>
Date:   2015-10-30T02:48:17Z

    Merge pull request #1 from apache/master
    
    merge apache/nifi changes

commit 2f7c0fcc102f83957141cffea5fa095ebbf6a601
Author: Joe Skora <js...@gmail.com>
Date:   2015-11-04T04:48:34Z

    Merge branch 'master' of https://github.com/apache/nifi

commit 4c1cee19f749bcba1511dc908b72544f196b66bf
Author: Joe Skora <js...@gmail.com>
Date:   2015-11-12T17:40:33Z

    Merge branch 'master' of https://github.com/jskora/nifi

commit 64912a6ab9766fb9cb8d6394edb431929330f79b
Author: Joe Skora <js...@gmail.com>
Date:   2015-11-12T17:33:31Z

    Changes to support new PutS3ObjectMultipart processor.  This includes extending other S3 processor classes to support SSL connection service, enable new ENDPOINT_OVERRIDE property, correct typo in CREDENTIALS_FILES property descriptor spelling, and update processor reference annotations.
    * Add nifi-ssl-context-service-api dependency to nifi-aws-processors.
    * Add nifi-ssl-context-service-nar to nifi-aws-nar.
    * Add PutS3ObjectMultipart to META-INF/services/org.apache.nifi.processor.Processors.
    * New class PutS3ObjectMultipart.java and test TestPutS3ObjectMultipart.java.

----


> Create new PutS3ObjectMultipart processor
> -----------------------------------------
>
>                 Key: NIFI-1107
>                 URL: https://issues.apache.org/jira/browse/NIFI-1107
>             Project: Apache NiFi
>          Issue Type: New Feature
>          Components: Core Framework
>            Reporter: Joe Skora
>            Assignee: Joe Skora
>
> A new `PutS3ObjectMultipart` processor using the AWS S3 API to upload files larger than those supported by `PutS3Object` which has a [5GB limit|http://docs.aws.amazon.com/AmazonS3/latest/dev/UploadingObjects.html] limit.
> To support S3 compatible endpoints this will also add an `Endpoint Override URL` property to `AbstractAWSProcessor` to set the service [endpoint|http://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/AmazonWebServiceClient.html#setEndpoint(java.lang.String)] to override the endpoint URL normally selected based on the the Amazon region.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)