You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Firenz (Jira)" <ji...@apache.org> on 2020/06/11 07:47:00 UTC

[jira] [Updated] (NIFI-7522) Processor Kafka 2.5 / Static Membership

     [ https://issues.apache.org/jira/browse/NIFI-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Firenz updated NIFI-7522:
-------------------------
    Description: 
Kafka 2.4 introduced the static membership [[KIP-345|https://cwiki.apache.org/confluence/display/KAFKA/KIP-345%3A+Introduce+static+membership+protocol+to+reduce+consumer+rebalances]|[https://cwiki.apache.org/confluence/display/KAFKA/KIP-345%3A+Introduce+static+membership+protocol+to+reduce+consumer+rebalances]]

 

So i propose to add a Publish/Consume 2_5 with the last Kafka Client 2.5. 

 

I don't know the versionning strategy for Kafka Processors. We have 2 choices : 
 * Thanks to dynamic properties, upgrading the 2.0 processors set with 2.5 kafka libs (confusing but lazy update)
 * Create a new 2.5 processors set

 

So i created a new set of 2.5 processors from 1.11.5-SNAPSHOT. It builds, test ok. But i need to learn the full process to create the branch/pull/merge request etc. For people in the urge or just curious, my last build is attached.

 

  was:
Kafka 2.4 introduced the static membership [[KIP-345|https://cwiki.apache.org/confluence/display/KAFKA/KIP-345%3A+Introduce+static+membership+protocol+to+reduce+consumer+rebalances]|[https://cwiki.apache.org/confluence/display/KAFKA/KIP-345%3A+Introduce+static+membership+protocol+to+reduce+consumer+rebalances]]

 

So i propose to add a Publish/Consume 2_5 with the last Kafka Client 2.5. 

 

I don't know the versionning strategy for Kafka Processors. We have 2 choices : 
 * Thanks to dynamic properties, upgrading the 2.0 processor with 2.5 libs (confusing but lazy update)
 * Create a new 2.5 process set

 

So i created a new set of 2.5 processors from 1.11.5-SNAPSHOT. It builds, test ok. But i need to learn the full process to create the branch/pull/merge request etc. For people in the urge or just curious, my last build is attached.

 


> Processor Kafka 2.5 / Static Membership
> ---------------------------------------
>
>                 Key: NIFI-7522
>                 URL: https://issues.apache.org/jira/browse/NIFI-7522
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Extensions
>            Reporter: Firenz
>            Priority: Minor
>         Attachments: nifi-kafka-2-5-nar-1.11.5-SNAPSHOT.nar
>
>
> Kafka 2.4 introduced the static membership [[KIP-345|https://cwiki.apache.org/confluence/display/KAFKA/KIP-345%3A+Introduce+static+membership+protocol+to+reduce+consumer+rebalances]|[https://cwiki.apache.org/confluence/display/KAFKA/KIP-345%3A+Introduce+static+membership+protocol+to+reduce+consumer+rebalances]]
>  
> So i propose to add a Publish/Consume 2_5 with the last Kafka Client 2.5. 
>  
> I don't know the versionning strategy for Kafka Processors. We have 2 choices : 
>  * Thanks to dynamic properties, upgrading the 2.0 processors set with 2.5 kafka libs (confusing but lazy update)
>  * Create a new 2.5 processors set
>  
> So i created a new set of 2.5 processors from 1.11.5-SNAPSHOT. It builds, test ok. But i need to learn the full process to create the branch/pull/merge request etc. For people in the urge or just curious, my last build is attached.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)