You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pulsar.apache.org by Neng Lu <nl...@apache.org> on 2021/07/23 01:23:55 UTC

Fix Debezium Connectors to pass integration test

Hi All,

I spent some time digging into the debezium connector integration test
issue. And found that currently the connector's `ack()` method is a
blocking call. This results in the blocking of two threads
(public/default/debezium-mongodb-source-0 and pulsar-io-X) and thus the
offset is never committed successfully.

I have prepared a fix here: https://github.com/apache/pulsar/pull/11435


Best Regards,
Neng Lu

Re: Fix Debezium Connectors to pass integration test

Posted by "rxl@apache.org" <ra...@gmail.com>.
Great Job, cool Neng!!!

--
Thanks
Xiaolong Ran

Sijie Guo <gu...@gmail.com> 于2021年7月24日周六 上午4:14写道:

> Great finding!
>
> Thanks Neng for fixing the issue!
>
> - Sijie
>
> On Thu, Jul 22, 2021 at 6:24 PM Neng Lu <nl...@apache.org> wrote:
> >
> > Hi All,
> >
> > I spent some time digging into the debezium connector integration test
> > issue. And found that currently the connector's `ack()` method is a
> > blocking call. This results in the blocking of two threads
> > (public/default/debezium-mongodb-source-0 and pulsar-io-X) and thus the
> > offset is never committed successfully.
> >
> > I have prepared a fix here: https://github.com/apache/pulsar/pull/11435
> >
> >
> > Best Regards,
> > Neng Lu
>

Re: Fix Debezium Connectors to pass integration test

Posted by Sijie Guo <gu...@gmail.com>.
Great finding!

Thanks Neng for fixing the issue!

- Sijie

On Thu, Jul 22, 2021 at 6:24 PM Neng Lu <nl...@apache.org> wrote:
>
> Hi All,
>
> I spent some time digging into the debezium connector integration test
> issue. And found that currently the connector's `ack()` method is a
> blocking call. This results in the blocking of two threads
> (public/default/debezium-mongodb-source-0 and pulsar-io-X) and thus the
> offset is never committed successfully.
>
> I have prepared a fix here: https://github.com/apache/pulsar/pull/11435
>
>
> Best Regards,
> Neng Lu