You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by Guozhang Wang <wa...@gmail.com> on 2019/06/07 23:59:29 UTC
Re: [DISCUSS] KIP-467: Augment ProduceResponse error messaging
Bump up this thread again for whoever's interested.
On Sat, May 11, 2019 at 12:34 PM Guozhang Wang <wa...@gmail.com> wrote:
> Hello everyone,
>
> I'd like to start a discussion thread on this newly created KIP to improve
> error communication and handling for producer response:
>
>
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-467%3A+Augment+ProduceResponse+error+messaging+for+specific+culprit+records
>
> Thanks,
> --
> -- Guozhang
>
--
-- Guozhang
Re: [DISCUSS] KIP-467: Augment ProduceResponse error messaging
Posted by Guozhang Wang <wa...@gmail.com>.
Hi Kamal,
I intend to scope KIP-467 for producer <--> brokers interaction only, so
that we can have a small enough one to discuss and tackle.
I've just read about KIP-334 as well and I feel it's still better to be
addressed independently by itself. LMK what you think.
Guozhang
On Mon, Jun 10, 2019 at 6:33 AM Kamal Chandraprakash <
kamal.chandraprakash@gmail.com> wrote:
> This KIP is inline with KIP-334
> <https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=87297793
> >
> in which it's proposed that the consumer will throw FaultyRecordException
> with corrupt/in-operative record offset and topic-partition on encountering
> the invalid record.
>
> In this KIP proposed changes, you've mentioned to skip the corrupted record
> while producing the RecordBatch,
> Will you also handle the same case while consuming the records by providing
> a callback to the consumer to
> either skip or halt the processing? (This is a follow-up idea of KIP-334
> which seems relevant to this one)
>
> On Sat, Jun 8, 2019 at 5:29 AM Guozhang Wang <wa...@gmail.com> wrote:
>
> > Bump up this thread again for whoever's interested.
> >
> > On Sat, May 11, 2019 at 12:34 PM Guozhang Wang <wa...@gmail.com>
> wrote:
> >
> > > Hello everyone,
> > >
> > > I'd like to start a discussion thread on this newly created KIP to
> > improve
> > > error communication and handling for producer response:
> > >
> > >
> > >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-467%3A+Augment+ProduceResponse+error+messaging+for+specific+culprit+records
> > >
> > > Thanks,
> > > --
> > > -- Guozhang
> > >
> >
> >
> > --
> > -- Guozhang
> >
>
--
-- Guozhang
Re: [DISCUSS] KIP-467: Augment ProduceResponse error messaging
Posted by Kamal Chandraprakash <ka...@gmail.com>.
This KIP is inline with KIP-334
<https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=87297793>
in which it's proposed that the consumer will throw FaultyRecordException
with corrupt/in-operative record offset and topic-partition on encountering
the invalid record.
In this KIP proposed changes, you've mentioned to skip the corrupted record
while producing the RecordBatch,
Will you also handle the same case while consuming the records by providing
a callback to the consumer to
either skip or halt the processing? (This is a follow-up idea of KIP-334
which seems relevant to this one)
On Sat, Jun 8, 2019 at 5:29 AM Guozhang Wang <wa...@gmail.com> wrote:
> Bump up this thread again for whoever's interested.
>
> On Sat, May 11, 2019 at 12:34 PM Guozhang Wang <wa...@gmail.com> wrote:
>
> > Hello everyone,
> >
> > I'd like to start a discussion thread on this newly created KIP to
> improve
> > error communication and handling for producer response:
> >
> >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-467%3A+Augment+ProduceResponse+error+messaging+for+specific+culprit+records
> >
> > Thanks,
> > --
> > -- Guozhang
> >
>
>
> --
> -- Guozhang
>