You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2023/02/26 17:36:00 UTC
[jira] [Commented] (NIFI-11219) GetAzureEventHub Exceeded Allowed Receivers
[ https://issues.apache.org/jira/browse/NIFI-11219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693682#comment-17693682 ]
ASF subversion and git services commented on NIFI-11219:
--------------------------------------------------------
Commit 84047c135b43fdb81f030fe855e096ee8f5449cb in nifi's branch refs/heads/main from David Handermann
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=84047c135b ]
NIFI-11219 Set Qpid Proton J 0.34.0 for Azure EventHubs
- Overrides Qpid Proton J 0.33.8 from azure-core-amqp 2.8.1 to resolve PROTON-2347
This closes #6988.
Signed-off-by: Peter Turcsanyi <tu...@apache.org>
> GetAzureEventHub Exceeded Allowed Receivers
> -------------------------------------------
>
> Key: NIFI-11219
> URL: https://issues.apache.org/jira/browse/NIFI-11219
> Project: Apache NiFi
> Issue Type: Bug
> Affects Versions: 1.18.0, 1.19.0, 1.20.0
> Reporter: David Handermann
> Assignee: David Handermann
> Priority: Minor
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Migrating the Azure EventHubs Processors to version 5 of the Azure Java SDK introduced the potential for concurrent processing issues in {{GetAzureEventHub}} under certain conditions.
> Azure EventHubs assigned [quotas and limits|https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-quotas] on the service, including a limit of 5 {{non-epoch consumers}} per receiver.
> When {{GetAzureEventHub}} is configured with more than one Concurrent Task, or with a {{Partition Receiver Timeout}} or less than 1000 milliseconds, the Processor is more prone to encountering the limit of 5 consumers per receiver, resulting in the following error:
> {noformat}
> com.azure.core.amqp.exception.AmqpException: Exceeded the maximum number of allowed receivers per partition in a consumer group which is 5
> {noformat}
> Exceeding the limit can result in socket communication failures. The Apache [Qpid Proton J|https://github.com/apache/qpid-proton-j] provides low-level support for Azure EventHub communication, and the current version of the Azure EventHubs SDK includes version 0.33.8. Version 0.34.0 of Qpid Proton J including a resolution for PROTON-2347, ensuring that the library closes sockets correctly in the event of communication failures.
> Misconfiguration of {{GetAzureEventHub}} can result in exceeding the maximum number of allowed connections, but the supporting Qpid Proton J library should be upgraded to 0.34.0 in order to provide more robust error handling.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)