You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@sqoop.apache.org by "Venkat, Ankam" <An...@centurylink.com> on 2014/12/14 15:34:19 UTC
Oracle to Hadoop data ingestion in Real-time
I have a requirement to ingest the data from oracle database to hadoop in real-time.
I know Sqoop is not the answer. Anybody tried Tungsten replicator to ingest data from Oracle to Hadoop in real-time?
Are there any other tools available?
Any help is highly appreciated.
Regards,
Venkat Ankam
This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
Re: Oracle to Hadoop data ingestion in Real-time
Posted by Gwen Shapira <gs...@cloudera.com>.
AFAIK Tungsten is open source and is the only open source CDC solution
that I know of.
On Sun, Dec 14, 2014 at 4:20 PM, Venkat, Ankam
<An...@centurylink.com> wrote:
> Thanks Gwen.
>
> I am looking for open source solutions only.
>
> Is Tungsten open source tool? Any other open source tools?
>
> Regards,
> Venkat Ankam
>
> -----Original Message-----
> From: Gwen Shapira [mailto:gshapira@cloudera.com]
> Sent: Sunday, December 14, 2014 11:38 AM
> To: user@sqoop.apache.org
> Subject: Re: Oracle to Hadoop data ingestion in Real-time
>
> GoldenGate can be used with flume to ingest data from Oracle to Hadoop in real time. Oracle's MetaLink (i.e. MyOracleSupport) will have code examples on how to do that.
>
> I heard from booking.com that Tungsten works great for MySQL to Hadoop in real time. So its worth trying for Oracle.
>
> Another tool to try is DBVisit Replication, since works on Oracle SE.
> Their website may not mention Hadoop, but I believe they have the capability, so worth contacting them.
>
> Gwen
>
> On Sun, Dec 14, 2014 at 6:34 AM, Venkat, Ankam <An...@centurylink.com> wrote:
>> I have a requirement to ingest the data from oracle database to hadoop
>> in real-time.
>>
>> I know Sqoop is not the answer. Anybody tried Tungsten replicator to
>> ingest data from Oracle to Hadoop in real-time?
>>
>> Are there any other tools available?
>>
>> Any help is highly appreciated.
>>
>> Regards,
>>
>> Venkat Ankam
>>
>>
>>
>> This communication is the property of CenturyLink and may contain
>> confidential or privileged information. Unauthorized use of this
>> communication is strictly prohibited and may be unlawful. If you have
>> received this communication in error, please immediately notify the
>> sender by reply e-mail and destroy all copies of the communication and
>> any attachments.
> This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
RE: Oracle to Hadoop data ingestion in Real-time
Posted by "Venkat, Ankam" <An...@centurylink.com>.
Thanks Gwen.
I am looking for open source solutions only.
Is Tungsten open source tool? Any other open source tools?
Regards,
Venkat Ankam
-----Original Message-----
From: Gwen Shapira [mailto:gshapira@cloudera.com]
Sent: Sunday, December 14, 2014 11:38 AM
To: user@sqoop.apache.org
Subject: Re: Oracle to Hadoop data ingestion in Real-time
GoldenGate can be used with flume to ingest data from Oracle to Hadoop in real time. Oracle's MetaLink (i.e. MyOracleSupport) will have code examples on how to do that.
I heard from booking.com that Tungsten works great for MySQL to Hadoop in real time. So its worth trying for Oracle.
Another tool to try is DBVisit Replication, since works on Oracle SE.
Their website may not mention Hadoop, but I believe they have the capability, so worth contacting them.
Gwen
On Sun, Dec 14, 2014 at 6:34 AM, Venkat, Ankam <An...@centurylink.com> wrote:
> I have a requirement to ingest the data from oracle database to hadoop
> in real-time.
>
> I know Sqoop is not the answer. Anybody tried Tungsten replicator to
> ingest data from Oracle to Hadoop in real-time?
>
> Are there any other tools available?
>
> Any help is highly appreciated.
>
> Regards,
>
> Venkat Ankam
>
>
>
> This communication is the property of CenturyLink and may contain
> confidential or privileged information. Unauthorized use of this
> communication is strictly prohibited and may be unlawful. If you have
> received this communication in error, please immediately notify the
> sender by reply e-mail and destroy all copies of the communication and
> any attachments.
This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
Re: Oracle to Hadoop data ingestion in Real-time
Posted by Gwen Shapira <gs...@cloudera.com>.
GoldenGate can be used with flume to ingest data from Oracle to Hadoop
in real time. Oracle's MetaLink (i.e. MyOracleSupport) will have code
examples on how to do that.
I heard from booking.com that Tungsten works great for MySQL to Hadoop
in real time. So its worth trying for Oracle.
Another tool to try is DBVisit Replication, since works on Oracle SE.
Their website may not mention Hadoop, but I believe they have the
capability, so worth contacting them.
Gwen
On Sun, Dec 14, 2014 at 6:34 AM, Venkat, Ankam
<An...@centurylink.com> wrote:
> I have a requirement to ingest the data from oracle database to hadoop in
> real-time.
>
> I know Sqoop is not the answer. Anybody tried Tungsten replicator to ingest
> data from Oracle to Hadoop in real-time?
>
> Are there any other tools available?
>
> Any help is highly appreciated.
>
> Regards,
>
> Venkat Ankam
>
>
>
> This communication is the property of CenturyLink and may contain
> confidential or privileged information. Unauthorized use of this
> communication is strictly prohibited and may be unlawful. If you have
> received this communication in error, please immediately notify the sender
> by reply e-mail and destroy all copies of the communication and any
> attachments.