You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Palikala, Rajendra (CCL)" <RP...@carnival.com> on 2009/11/12 18:55:10 UTC
ETL using Hadoop ???
Hi All,
I am an experienced Informatica and Java Developer. I am very new to Hadoop. I have one basic question for the group. Please advise.
Can we do ETL (Example: load data from an oracle table to another oracle table) using Hadoop? If so, how can we implement that.
>From my understanding, I see that Hive is for reporting purposes and not for ETL. Let me know if this is right.
Regards,
Rajendra
Re: ETL using Hadoop ???
Posted by Steve Morin <st...@gmail.com>.
Thanks
Jeff
On Thu, Nov 12, 2009 at 1:36 PM, Jeff Hammerbacher <ha...@cloudera.com> wrote:
> Hey Steve,
>
> See https://issues.apache.org/jira/browse/MAPREDUCE-1168.
>
> Regards,
> Jeff
>
> On Thu, Nov 12, 2009 at 1:35 PM, Steve Morin <st...@gmail.com> wrote:
>
>> Does sqoop also allow you to export data from hadoop to a db? I
>> didn't see that in the documentation
>>
>> -Steve
>>
>> On Thu, Nov 12, 2009 at 1:16 PM, Jeff Hammerbacher <ha...@cloudera.com>
>> wrote:
>> > Hey Rajendra,
>> >
>> > For the "E" part of your task, you may want to check out Sqoop:
>> > http://www.cloudera.com/hadoop-sqoop.
>> >
>> > Regards,
>> > Jeff
>> >
>> > On Thu, Nov 12, 2009 at 10:02 AM, Dhruba Borthakur <dh...@gmail.com>
>> wrote:
>> >
>> >> Hi Rajendra,
>> >>
>> >> We use Hive for a large data warehouse, details here:
>> >> http://wiki.apache.org/hadoop/Hive
>> >>
>> >> thanks,
>> >> dhruba
>> >>
>> >>
>> >> On Thu, Nov 12, 2009 at 9:55 AM, Palikala, Rajendra (CCL) <
>> >> RPalikala@carnival.com> wrote:
>> >>
>> >> > Hi All,
>> >> >
>> >> > I am an experienced Informatica and Java Developer. I am very new to
>> >> > Hadoop. I have one basic question for the group. Please advise.
>> >> >
>> >> > Can we do ETL (Example: load data from an oracle table to another
>> oracle
>> >> > table) using Hadoop? If so, how can we implement that.
>> >> >
>> >> > From my understanding, I see that Hive is for reporting purposes and
>> not
>> >> > for ETL. Let me know if this is right.
>> >> >
>> >> > Regards,
>> >> > Rajendra
>> >> >
>> >> >
>> >>
>> >>
>> >> --
>> >> Connect to me at http://www.facebook.com/dhruba
>> >>
>> >
>>
>
Re: ETL using Hadoop ???
Posted by Jeff Hammerbacher <ha...@cloudera.com>.
Hey Steve,
See https://issues.apache.org/jira/browse/MAPREDUCE-1168.
Regards,
Jeff
On Thu, Nov 12, 2009 at 1:35 PM, Steve Morin <st...@gmail.com> wrote:
> Does sqoop also allow you to export data from hadoop to a db? I
> didn't see that in the documentation
>
> -Steve
>
> On Thu, Nov 12, 2009 at 1:16 PM, Jeff Hammerbacher <ha...@cloudera.com>
> wrote:
> > Hey Rajendra,
> >
> > For the "E" part of your task, you may want to check out Sqoop:
> > http://www.cloudera.com/hadoop-sqoop.
> >
> > Regards,
> > Jeff
> >
> > On Thu, Nov 12, 2009 at 10:02 AM, Dhruba Borthakur <dh...@gmail.com>
> wrote:
> >
> >> Hi Rajendra,
> >>
> >> We use Hive for a large data warehouse, details here:
> >> http://wiki.apache.org/hadoop/Hive
> >>
> >> thanks,
> >> dhruba
> >>
> >>
> >> On Thu, Nov 12, 2009 at 9:55 AM, Palikala, Rajendra (CCL) <
> >> RPalikala@carnival.com> wrote:
> >>
> >> > Hi All,
> >> >
> >> > I am an experienced Informatica and Java Developer. I am very new to
> >> > Hadoop. I have one basic question for the group. Please advise.
> >> >
> >> > Can we do ETL (Example: load data from an oracle table to another
> oracle
> >> > table) using Hadoop? If so, how can we implement that.
> >> >
> >> > From my understanding, I see that Hive is for reporting purposes and
> not
> >> > for ETL. Let me know if this is right.
> >> >
> >> > Regards,
> >> > Rajendra
> >> >
> >> >
> >>
> >>
> >> --
> >> Connect to me at http://www.facebook.com/dhruba
> >>
> >
>
Re: ETL using Hadoop ???
Posted by Steve Morin <st...@gmail.com>.
Does sqoop also allow you to export data from hadoop to a db? I
didn't see that in the documentation
-Steve
On Thu, Nov 12, 2009 at 1:16 PM, Jeff Hammerbacher <ha...@cloudera.com> wrote:
> Hey Rajendra,
>
> For the "E" part of your task, you may want to check out Sqoop:
> http://www.cloudera.com/hadoop-sqoop.
>
> Regards,
> Jeff
>
> On Thu, Nov 12, 2009 at 10:02 AM, Dhruba Borthakur <dh...@gmail.com> wrote:
>
>> Hi Rajendra,
>>
>> We use Hive for a large data warehouse, details here:
>> http://wiki.apache.org/hadoop/Hive
>>
>> thanks,
>> dhruba
>>
>>
>> On Thu, Nov 12, 2009 at 9:55 AM, Palikala, Rajendra (CCL) <
>> RPalikala@carnival.com> wrote:
>>
>> > Hi All,
>> >
>> > I am an experienced Informatica and Java Developer. I am very new to
>> > Hadoop. I have one basic question for the group. Please advise.
>> >
>> > Can we do ETL (Example: load data from an oracle table to another oracle
>> > table) using Hadoop? If so, how can we implement that.
>> >
>> > From my understanding, I see that Hive is for reporting purposes and not
>> > for ETL. Let me know if this is right.
>> >
>> > Regards,
>> > Rajendra
>> >
>> >
>>
>>
>> --
>> Connect to me at http://www.facebook.com/dhruba
>>
>
RE: ETL using Hadoop ???
Posted by "Palikala, Rajendra (CCL)" <RP...@carnival.com>.
Jeff, This is great info. Thanks
-----Original Message-----
From: Jeff Hammerbacher [mailto:hammer@cloudera.com]
Sent: Thursday, November 12, 2009 4:16 PM
To: common-dev@hadoop.apache.org
Subject: Re: ETL using Hadoop ???
Hey Rajendra,
For the "E" part of your task, you may want to check out Sqoop:
http://www.cloudera.com/hadoop-sqoop.
Regards,
Jeff
On Thu, Nov 12, 2009 at 10:02 AM, Dhruba Borthakur <dh...@gmail.com> wrote:
> Hi Rajendra,
>
> We use Hive for a large data warehouse, details here:
> http://wiki.apache.org/hadoop/Hive
>
> thanks,
> dhruba
>
>
> On Thu, Nov 12, 2009 at 9:55 AM, Palikala, Rajendra (CCL) <
> RPalikala@carnival.com> wrote:
>
> > Hi All,
> >
> > I am an experienced Informatica and Java Developer. I am very new to
> > Hadoop. I have one basic question for the group. Please advise.
> >
> > Can we do ETL (Example: load data from an oracle table to another oracle
> > table) using Hadoop? If so, how can we implement that.
> >
> > From my understanding, I see that Hive is for reporting purposes and not
> > for ETL. Let me know if this is right.
> >
> > Regards,
> > Rajendra
> >
> >
>
>
> --
> Connect to me at http://www.facebook.com/dhruba
>
Re: ETL using Hadoop ???
Posted by Jeff Hammerbacher <ha...@cloudera.com>.
Hey Rajendra,
For the "E" part of your task, you may want to check out Sqoop:
http://www.cloudera.com/hadoop-sqoop.
Regards,
Jeff
On Thu, Nov 12, 2009 at 10:02 AM, Dhruba Borthakur <dh...@gmail.com> wrote:
> Hi Rajendra,
>
> We use Hive for a large data warehouse, details here:
> http://wiki.apache.org/hadoop/Hive
>
> thanks,
> dhruba
>
>
> On Thu, Nov 12, 2009 at 9:55 AM, Palikala, Rajendra (CCL) <
> RPalikala@carnival.com> wrote:
>
> > Hi All,
> >
> > I am an experienced Informatica and Java Developer. I am very new to
> > Hadoop. I have one basic question for the group. Please advise.
> >
> > Can we do ETL (Example: load data from an oracle table to another oracle
> > table) using Hadoop? If so, how can we implement that.
> >
> > From my understanding, I see that Hive is for reporting purposes and not
> > for ETL. Let me know if this is right.
> >
> > Regards,
> > Rajendra
> >
> >
>
>
> --
> Connect to me at http://www.facebook.com/dhruba
>
Re: ETL using Hadoop ???
Posted by Dhruba Borthakur <dh...@gmail.com>.
Hi Rajendra,
We use Hive for a large data warehouse, details here:
http://wiki.apache.org/hadoop/Hive
thanks,
dhruba
On Thu, Nov 12, 2009 at 9:55 AM, Palikala, Rajendra (CCL) <
RPalikala@carnival.com> wrote:
> Hi All,
>
> I am an experienced Informatica and Java Developer. I am very new to
> Hadoop. I have one basic question for the group. Please advise.
>
> Can we do ETL (Example: load data from an oracle table to another oracle
> table) using Hadoop? If so, how can we implement that.
>
> From my understanding, I see that Hive is for reporting purposes and not
> for ETL. Let me know if this is right.
>
> Regards,
> Rajendra
>
>
--
Connect to me at http://www.facebook.com/dhruba