You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Jalpesh Patadia <ja...@clickbank.com> on 2015/08/03 17:41:01 UTC

new consumer api?

Hello guys,

A while ago i read that the new consumer api was going to be released
sometime in July as part of the 0.8.3/0.9 release.
https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan


Do we have an update when we think that can happen?


Thanks,

Jalpesh


-- PRIVILEGED AND CONFIDENTIAL This transmission may contain privileged, proprietary or confidential information. If you are not the intended recipient, you are instructed not to review this transmission. If you are not the intended recipient, please notify the sender that you received this message and delete this transmission from your system.

Re: new consumer api?

Posted by Jason Gustafson <ja...@confluent.io>.
Hey Simon,

The new consumer has the ability to forego group management and assign
partitions directly. Once assigned, you can seek to any offset you want.

-Jason

On Tue, Aug 4, 2015 at 5:08 AM, Simon Cooper <
simon.cooper@featurespace.co.uk> wrote:

> Reading on the consumer docs, there's no mention of a relatively simple
> consumer that doesn't need groups, coordinators, commits, anything like
> that - just read and poll from specified offsets of specific topic
> partitions - but automatically deals with leadership changes and connection
> losses (so one level up from SimpleConsumer).
>
> Will the new API be able to be used in this relatively simple way?
> SimonC
>
> -----Original Message-----
> From: Jun Rao [mailto:jun@confluent.io]
> Sent: 03 August 2015 18:19
> To: users@kafka.apache.org
> Subject: Re: new consumer api?
>
> Jalpesh,
>
> We are still iterating on the new consumer a bit and are waiting for some
> of the security jiras to be committed. So now, we are shooting for
> releasing 0.8.3 in Oct (just updated
> https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan).
>
> Thanks,
>
> Jun
>
> On Mon, Aug 3, 2015 at 8:41 AM, Jalpesh Patadia <
> jalpesh.patadia@clickbank.com> wrote:
>
> > Hello guys,
> >
> > A while ago i read that the new consumer api was going to be released
> > sometime in July as part of the 0.8.3/0.9 release.
> > https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan
> >
> >
> > Do we have an update when we think that can happen?
> >
> >
> > Thanks,
> >
> > Jalpesh
> >
> >
> > -- PRIVILEGED AND CONFIDENTIAL This transmission may contain
> > privileged, proprietary or confidential information. If you are not
> > the intended recipient, you are instructed not to review this
> > transmission. If you are not the intended recipient, please notify the
> > sender that you received this message and delete this transmission from
> your system.
> >
>

RE: new consumer api?

Posted by Simon Cooper <si...@featurespace.co.uk>.
Reading on the consumer docs, there's no mention of a relatively simple consumer that doesn't need groups, coordinators, commits, anything like that - just read and poll from specified offsets of specific topic partitions - but automatically deals with leadership changes and connection losses (so one level up from SimpleConsumer).

Will the new API be able to be used in this relatively simple way?
SimonC

-----Original Message-----
From: Jun Rao [mailto:jun@confluent.io] 
Sent: 03 August 2015 18:19
To: users@kafka.apache.org
Subject: Re: new consumer api?

Jalpesh,

We are still iterating on the new consumer a bit and are waiting for some of the security jiras to be committed. So now, we are shooting for releasing 0.8.3 in Oct (just updated https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan).

Thanks,

Jun

On Mon, Aug 3, 2015 at 8:41 AM, Jalpesh Patadia < jalpesh.patadia@clickbank.com> wrote:

> Hello guys,
>
> A while ago i read that the new consumer api was going to be released 
> sometime in July as part of the 0.8.3/0.9 release.
> https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan
>
>
> Do we have an update when we think that can happen?
>
>
> Thanks,
>
> Jalpesh
>
>
> -- PRIVILEGED AND CONFIDENTIAL This transmission may contain 
> privileged, proprietary or confidential information. If you are not 
> the intended recipient, you are instructed not to review this 
> transmission. If you are not the intended recipient, please notify the 
> sender that you received this message and delete this transmission from your system.
>

Re: new consumer api?

Posted by Jun Rao <ju...@confluent.io>.
Jalpesh,

We are still iterating on the new consumer a bit and are waiting for some
of the security jiras to be committed. So now, we are shooting for
releasing 0.8.3 in Oct (just updated
https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan).

Thanks,

Jun

On Mon, Aug 3, 2015 at 8:41 AM, Jalpesh Patadia <
jalpesh.patadia@clickbank.com> wrote:

> Hello guys,
>
> A while ago i read that the new consumer api was going to be released
> sometime in July as part of the 0.8.3/0.9 release.
> https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan
>
>
> Do we have an update when we think that can happen?
>
>
> Thanks,
>
> Jalpesh
>
>
> -- PRIVILEGED AND CONFIDENTIAL This transmission may contain privileged,
> proprietary or confidential information. If you are not the intended
> recipient, you are instructed not to review this transmission. If you are
> not the intended recipient, please notify the sender that you received this
> message and delete this transmission from your system.
>