[jira] [Commented] (NIFI-8531) Upgrade Kinesis Client Library to 2.x

["Chris Sampson (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NIFI-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17465874#comment-17465874 ] 

Chris Sampson commented on NIFI-8531:
-------------------------------------

Must use at least version 2.3.6 in order to ensure the worker shutdown issues discovered as part of NIFI-2892 are addressed - https://github.com/awslabs/amazon-kinesis-client/pull/817

> Upgrade Kinesis Client Library to 2.x
> -------------------------------------
>
>                 Key: NIFI-8531
>                 URL: https://issues.apache.org/jira/browse/NIFI-8531
>             Project: Apache NiFi
>          Issue Type: Improvement
>            Reporter: Chris Sampson
>            Priority: Major
>
> The Kinesis Client Library [KCL] version 1.x is used by the {{ConsumeKinesisStream}} processor (NIFI-2892).
> It would be better to upgrade to KCL 2.x as it is more up-to-date and provides more advanced features.
> For example, the {{WorkerStateChangeListener}} in 2.x has an {{onAllInitializationAttemptsFailed}} method that could be used to better track {{Worker}} startup issues (instead of relying on checking for unexpected {{WorkerState}} values in our processor's {{onTrigger}} method).
> There are also more configuration options available that would be worth considering as processor properties/noting in the processor documentation.
> N.B. upgrading to KCL 2.x relies upon upgrading to AWS Java SDK 2.x first (NIFI-8287).



--
This message was sent by Atlassian Jira
(v8.20.1#820001)