[jira] [Commented] (NIFI-2892) Implement AWS Kinesis Stream Get Processor

["Chris Sampson (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NIFI-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310962#comment-17310962 ] 

Chris Sampson commented on NIFI-2892:
-------------------------------------

Updated based on PR comments:
* added (optional) Record Reader/Writer
* better Thread/Session handling for the use of Kinesis Client Library
* Reverted to KCL verison 1.13.3 due to [amazon-kinesis-client#796|https://github.com/awslabs/amazon-kinesis-client/issues/796]
* removed double-validation of dynamic properties (introduced by NIFI-8266)

Updated template/flow definition attachments.

> Implement AWS Kinesis Stream Get Processor
> ------------------------------------------
>
>                 Key: NIFI-2892
>                 URL: https://issues.apache.org/jira/browse/NIFI-2892
>             Project: Apache NiFi
>          Issue Type: New Feature
>    Affects Versions: 1.0.0
>            Reporter: Stephane Maarek
>            Assignee: Chris Sampson
>            Priority: Major
>         Attachments: NIFI-2892.json, NIFI-2892.xml, NIFI-2892.xml, NiFi-2892.json
>
>          Time Spent: 10h
>  Remaining Estimate: 0h
>
> As the Kinesis Put Processor was just implemented in #1540, it would be great to have a Kinesis Get Processor.
> The main challenges are making sure the SDKs we use for this have a license that authorise NiFi to bundle them with the main binaries. 
> I also know there are two models to read from a Kinesis Stream (push vs pull), and we may want to implement either or both, as part of one or multiple processors, for performance purposes. Open for discussions



--
This message was sent by Atlassian Jira
(v8.3.4#803005)