You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@ignite.apache.org by "Maksim Davydov (Jira)" <ji...@apache.org> on 2024/07/08 13:33:00 UTC

[jira] [Updated] (IGNITE-22403) CDC: Improve Kafka partition ranges assignment for appliers

     [ https://issues.apache.org/jira/browse/IGNITE-22403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Maksim Davydov updated IGNITE-22403:
------------------------------------
    Summary: CDC: Improve Kafka partition ranges assignment for appliers  (was: Algorithm improvement for kafka topic partition distribution)

> CDC: Improve Kafka partition ranges assignment for appliers
> -----------------------------------------------------------
>
>                 Key: IGNITE-22403
>                 URL: https://issues.apache.org/jira/browse/IGNITE-22403
>             Project: Ignite
>          Issue Type: Improvement
>          Components: extensions
>            Reporter: Maksim Davydov
>            Assignee: Maksim Davydov
>            Priority: Major
>              Labels: IEP-59, ise
>
> Distribution for partitions from kafka topic over requested threads in AbstractKafkaToIgniteCdcStreamer (CDC Kafka to Ignite) is not uniform. 
> There might be cases with unequal load on threads, that reads data from kafka, which might result in overhead/bottleneck and slow workflow in general for the whole CDC with Kafka process.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)