You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Eric Wong (Jira)" <ji...@apache.org> on 2022/10/12 17:20:00 UTC

[jira] [Created] (NIFI-10634) ConsumeKinesisStream.java exception while connect/consume from AWS kinesis

Eric Wong created NIFI-10634:
--------------------------------

             Summary: ConsumeKinesisStream.java exception while connect/consume from AWS kinesis
                 Key: NIFI-10634
                 URL: https://issues.apache.org/jira/browse/NIFI-10634
             Project: Apache NiFi
          Issue Type: Bug
          Components: Extensions
         Environment: https://hub.docker.com/layers/apache/nifi/1.17.0/images
            Reporter: Eric Wong


Dear Nifi community,

This is request for help and solution from apache nifi AWS Kinesis consumer.  

Following are info of official nifi version 1.17 from 2 month ago packaged in container

docker pull apache/nifi:1.17.0

[https://hub.docker.com/layers/apache/nifi/1.17.0/images]

Although similar Kinesis producer can always push message to AWS kinesis in same setup with correct configuration, when Kinesis consumer connect and pull from Kinesis, it always hit exception in nifi at 
{noformat}
ConsumeKinesisStream.java{noformat}
 unable to identify the cause of this exception with following in the log:
{code:java}
2022-09-23 22:07:50,498 ERROR [Timer-Driven Process Thread-7] o.a.n.p.a.k.stream.ConsumeKinesisStream ConsumeKinesisStream[id=5ca4f272-0183-1000-0000-000065d7aa17] Processing failed
2org.apache.nifi.processor.exception.ProcessException: Worker has shutdown unexpectedly, possibly due to a configuration issue; check logs for details
3	at org.apache.nifi.processors.aws.kinesis.stream.ConsumeKinesisStream.onTrigger(ConsumeKinesisStream.java:502)
4	at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1356)
5	at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:246)
6	at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:102)
7	at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
8	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
9	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
10	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
11	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
12	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
13	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
14	at java.lang.Thread.run(Thread.java:750) {code}
And there is no other additional info from nifi logs inside container.

Could you please help?  Or best to work with support directly so I can reproduce all.

thanks a lot!

Eric



--
This message was sent by Atlassian Jira
(v8.20.10#820010)