offset commitment from another client

[Vova Shelgunov <vv...@gmail.com>]

Hi,

I have an application which consumes messages from Kafka, then it creates a
Docker container via Mesos which processes incoming message (image), but I
need to commit an offset only once message is processed inside a Docker
container. So basically I need to commit offset from another broker (that
is running in a container).

Will it work?

Thanks

Re: offset commitment from another client

[Ewen Cheslack-Postava <ew...@confluent.io>]

Consumers are responsible for committing offsets, not brokers. See
http://kafka.apache.org/documentation.html#design_consumerposition for more
of an explanation of how this is tracked. The brokers help coordinate
this/store the offsets, but it is the consumers that decide when to commit
offsets (indicating they have processed the data).

-Ewen

On Mon, Mar 27, 2017 at 2:56 AM, Vova Shelgunov <vv...@gmail.com> wrote:

> Hi,
>
> I have an application which consumes messages from Kafka, then it creates a
> Docker container via Mesos which processes incoming message (image), but I
> need to commit an offset only once message is processed inside a Docker
> container. So basically I need to commit offset from another broker (that
> is running in a container).
>
> Will it work?
>
> Thanks
>