You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by kamrul hasan moin <mo...@gmail.com> on 2021/10/09 18:08:09 UTC
Can kafka consume uncommitted data from oracle
Hello,
I have a question. I know log based capture, and uncommitted changes are
definitely contained in the redo logs in oracle.the question is whether
Kafka will consume them as they occur.
Regards,
Kamrul hasan moin
Dhaka, bangladesh
Re: Can kafka consume uncommitted data from oracle
Posted by jacob bogers <jk...@gmail.com>.
"and uncommitted changes are definitely contained in the redo logs"
If it is possible it can only be done via the logminer package
https://docs.oracle.com/cd/B19306_01/server.102/b14215/logminer.htm
Getting uncommitted changes is dangerous as it is not guaranteed to be
correct (rollback can happen)
So you have to write your own connector/producer using the logminer package.
Not to hard if you know Java, it is a clean interface.
Jacob
On Sun, Oct 10, 2021 at 12:16 AM kamrul hasan moin <mo...@gmail.com>
wrote:
> Hello,
> I have a question. I know log based capture, and uncommitted changes are
> definitely contained in the redo logs in oracle.the question is whether
> Kafka will consume them as they occur.
>
> Regards,
> Kamrul hasan moin
> Dhaka, bangladesh
>
Re: Can kafka consume uncommitted data from oracle
Posted by Israel Ekpo <is...@gmail.com>.
This is the connector I was referring to in my last response
https://docs.confluent.io/kafka-connect-oracle-cdc/current/overview.html
On Sat, Oct 9, 2021 at 9:00 PM Israel Ekpo <is...@gmail.com> wrote:
> If you are referring to the Oracle CDC Kafka Connector, then the connector
> only produces commited changes to Kafka brokers
>
> Take a closer look at the connector documentation for additional
> information
>
> I hope this helps
>
> On Sat, Oct 9, 2021 at 6:22 PM kamrul hasan moin <mo...@gmail.com>
> wrote:
>
>> Hello,
>> I have a question. I know log based capture, and uncommitted changes are
>> definitely contained in the redo logs in oracle.the question is whether
>> Kafka will consume them as they occur.
>>
>> Regards,
>> Kamrul hasan moin
>> Dhaka, bangladesh
>>
>
Re: Can kafka consume uncommitted data from oracle
Posted by Israel Ekpo <is...@gmail.com>.
If you are referring to the Oracle CDC Kafka Connector, then the connector
only produces commited changes to Kafka brokers
Take a closer look at the connector documentation for additional
information
I hope this helps
On Sat, Oct 9, 2021 at 6:22 PM kamrul hasan moin <mo...@gmail.com>
wrote:
> Hello,
> I have a question. I know log based capture, and uncommitted changes are
> definitely contained in the redo logs in oracle.the question is whether
> Kafka will consume them as they occur.
>
> Regards,
> Kamrul hasan moin
> Dhaka, bangladesh
>