You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by kamrul hasan moin <mo...@gmail.com> on 2021/10/09 18:08:09 UTC

Can kafka consume uncommitted data from oracle

Hello,
I have a question. I know log based capture, and uncommitted changes are
definitely contained in the redo logs in oracle.the question is whether
Kafka will consume them as they occur.

Regards,
Kamrul hasan moin
Dhaka, bangladesh

Re: Can kafka consume uncommitted data from oracle

Posted by jacob bogers <jk...@gmail.com>.
"and uncommitted changes are definitely contained in the redo logs"
If it is possible it can only be done via the logminer package
https://docs.oracle.com/cd/B19306_01/server.102/b14215/logminer.htm

Getting uncommitted changes is dangerous as it is not guaranteed to be
correct (rollback can happen)

So you have to write your own connector/producer using the logminer package.

Not to hard if you know Java, it is a clean interface.

Jacob



On Sun, Oct 10, 2021 at 12:16 AM kamrul hasan moin <mo...@gmail.com>
wrote:

> Hello,
> I have a question. I know log based capture, and uncommitted changes are
> definitely contained in the redo logs in oracle.the question is whether
> Kafka will consume them as they occur.
>
> Regards,
> Kamrul hasan moin
> Dhaka, bangladesh
>

Re: Can kafka consume uncommitted data from oracle

Posted by Israel Ekpo <is...@gmail.com>.
This is the connector I was referring to in my last response

https://docs.confluent.io/kafka-connect-oracle-cdc/current/overview.html


On Sat, Oct 9, 2021 at 9:00 PM Israel Ekpo <is...@gmail.com> wrote:

> If you are referring to the Oracle CDC Kafka Connector, then the connector
> only produces commited changes to Kafka brokers
>
> Take a closer look at the connector documentation for additional
> information
>
> I hope this helps
>
> On Sat, Oct 9, 2021 at 6:22 PM kamrul hasan moin <mo...@gmail.com>
> wrote:
>
>> Hello,
>> I have a question. I know log based capture, and uncommitted changes are
>> definitely contained in the redo logs in oracle.the question is whether
>> Kafka will consume them as they occur.
>>
>> Regards,
>> Kamrul hasan moin
>> Dhaka, bangladesh
>>
>

Re: Can kafka consume uncommitted data from oracle

Posted by Israel Ekpo <is...@gmail.com>.
If you are referring to the Oracle CDC Kafka Connector, then the connector
only produces commited changes to Kafka brokers

Take a closer look at the connector documentation for additional
information

I hope this helps

On Sat, Oct 9, 2021 at 6:22 PM kamrul hasan moin <mo...@gmail.com>
wrote:

> Hello,
> I have a question. I know log based capture, and uncommitted changes are
> definitely contained in the redo logs in oracle.the question is whether
> Kafka will consume them as they occur.
>
> Regards,
> Kamrul hasan moin
> Dhaka, bangladesh
>