You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by "Burtsev, Kirill" <Ki...@cmegroup.com> on 2015/10/28 15:26:48 UTC

Offset storage

Which one is considered preferred offset storage: zookeeper or kafka? I see that default for 0.8.2.2 high level consumer is zookeeper, but I saw a few references about migrating offset storage to kafka.

Thanks

Re: Offset storage

Posted by pushkar priyadarshi <pr...@gmail.com>.

Storing offsets in Kafka frees up zookeeper writes for offset sync.so I
think it's preferred one to use whenever possible

On Thursday, October 29, 2015, Mayuresh Gharat <gh...@gmail.com>
wrote:

> You can use either of them.
> The new kafka consumer (still under development) does not store offsets in
> zookeeper. It stores in kafka.
>
> Thanks,
>
> Mayuresh
>
> On Wed, Oct 28, 2015 at 7:26 AM, Burtsev, Kirill <
> Kirill.Burtsev@cmegroup.com <javascript:;>> wrote:
>
> > Which one is considered preferred offset storage: zookeeper or kafka? I
> > see that default for 0.8.2.2 high level consumer is zookeeper, but I saw
> a
> > few references about migrating offset storage to kafka.
> >
> > Thanks
> >
>
>
>
> --
> -Regards,
> Mayuresh R. Gharat
> (862) 250-7125
>


-- 
Sent from my iPhone

Re: Offset storage

Posted by Mayuresh Gharat <gh...@gmail.com>.

You can use either of them.
The new kafka consumer (still under development) does not store offsets in
zookeeper. It stores in kafka.

Thanks,

Mayuresh

On Wed, Oct 28, 2015 at 7:26 AM, Burtsev, Kirill <
Kirill.Burtsev@cmegroup.com> wrote:

> Which one is considered preferred offset storage: zookeeper or kafka? I
> see that default for 0.8.2.2 high level consumer is zookeeper, but I saw a
> few references about migrating offset storage to kafka.
>
> Thanks
>



-- 
-Regards,
Mayuresh R. Gharat
(862) 250-7125