You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "W. D." <we...@gmail.com> on 2019/08/19 20:00:02 UTC

[DISCUSS] KIP-509: Rebalance and restart Producers

At the moment producers do not get any support when restarting:
where should it start producing data from?
what data had been committed successfully in the past?

and also for load distribution there is no support in the Kafka client
itself.
how many producers for a single source are currently active?
which producer reads which tables or database table partitions?

Doing something similar as the consumer provides, this can be solved and be
made more convenient for the producer developer.

Re: [DISCUSS] KIP-509: Rebalance and restart Producers

Posted by "W. D." <we...@gmail.com>.

The KIP can be found here:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-509%3A+Rebalance+and+restart+Producers


On Mon, Aug 19, 2019 at 10:00 PM W. D. <we...@gmail.com> wrote:

> At the moment producers do not get any support when restarting:
> where should it start producing data from?
> what data had been committed successfully in the past?
>
> and also for load distribution there is no support in the Kafka client
> itself.
> how many producers for a single source are currently active?
> which producer reads which tables or database table partitions?
>
> Doing something similar as the consumer provides, this can be solved and
> be made more convenient for the producer developer.
>
>
>