You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Lehel Boér (Jira)" <ji...@apache.org> on 2024/02/23 14:35:00 UTC

[jira] [Updated] (NIFI-12836) Connection pool shut down and SocketException for many AWS processors

     [ https://issues.apache.org/jira/browse/NIFI-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Lehel Boér updated NIFI-12836:
------------------------------
    Priority: Major  (was: Critical)

> Connection pool shut down and SocketException for many AWS processors
> ---------------------------------------------------------------------
>
>                 Key: NIFI-12836
>                 URL: https://issues.apache.org/jira/browse/NIFI-12836
>             Project: Apache NiFi
>          Issue Type: Bug
>            Reporter: Lehel Boér
>            Priority: Major
>
> Reported encountering "Connection pool shut down" errors for the PutDynamoDBRecord, DeleteDynamoDB, and PutSQS processors while running in a NiFi cluster on version 2.0.0-M1.
>  
> Steps to Reproduce:
> Set up NiFi 2.0.0-M1.
> Use PutDynamoDBRecord, DeleteDynamoDB, and PutSQS processors.
> Observe "Connection pool shut down" or "Connection reset" errors during runtime.
> Related Stack Trace:
>  * [Stack Trace 1|https://codefile.io/f/XF51uNKg3g] I encountered a slightly different stack trace, but the root cause and symptoms align with those reported
>  * [Stack Trace 2|https://codefile.io/f/ZMXYzHt89X]
>  
> After attempting to reproduce the issue with a local DynamoDB setup and debugging, I found that the AbstractAWSProcessor::onStopped method runs concurrently with the RecordHandlerResult::handle method, initiated by the PutDynamoDBRecord::onTrigger. The problematic line 
> {code:java}
> clientCache.asMap().values().forEach(SdkClient::close){code}
>  in AbstractAWSProcessor::onStopped leads to premature shutdown of connections, triggering the observed errors. Although removing this line resolves the issue, the root cause lies in the early execution of AbstractAWSProcessor::onStopped.
>  
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)