You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Eric Wong (Jira)" <ji...@apache.org> on 2022/10/12 17:20:00 UTC
[jira] [Created] (NIFI-10634) ConsumeKinesisStream.java exception while connect/consume from AWS kinesis
Eric Wong created NIFI-10634:
--------------------------------
Summary: ConsumeKinesisStream.java exception while connect/consume from AWS kinesis
Key: NIFI-10634
URL: https://issues.apache.org/jira/browse/NIFI-10634
Project: Apache NiFi
Issue Type: Bug
Components: Extensions
Environment: https://hub.docker.com/layers/apache/nifi/1.17.0/images
Reporter: Eric Wong
Dear Nifi community,
This is request for help and solution from apache nifi AWS Kinesis consumer.
Following are info of official nifi version 1.17 from 2 month ago packaged in container
docker pull apache/nifi:1.17.0
[https://hub.docker.com/layers/apache/nifi/1.17.0/images]
Although similar Kinesis producer can always push message to AWS kinesis in same setup with correct configuration, when Kinesis consumer connect and pull from Kinesis, it always hit exception in nifi at
{noformat}
ConsumeKinesisStream.java{noformat}
unable to identify the cause of this exception with following in the log:
{code:java}
2022-09-23 22:07:50,498 ERROR [Timer-Driven Process Thread-7] o.a.n.p.a.k.stream.ConsumeKinesisStream ConsumeKinesisStream[id=5ca4f272-0183-1000-0000-000065d7aa17] Processing failed
2org.apache.nifi.processor.exception.ProcessException: Worker has shutdown unexpectedly, possibly due to a configuration issue; check logs for details
3 at org.apache.nifi.processors.aws.kinesis.stream.ConsumeKinesisStream.onTrigger(ConsumeKinesisStream.java:502)
4 at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1356)
5 at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:246)
6 at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:102)
7 at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
8 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
9 at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
10 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
11 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
12 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
13 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
14 at java.lang.Thread.run(Thread.java:750) {code}
And there is no other additional info from nifi logs inside container.
Could you please help? Or best to work with support directly so I can reproduce all.
thanks a lot!
Eric
--
This message was sent by Atlassian Jira
(v8.20.10#820010)