You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by snv <sm...@foxmail.com> on 2014/10/08 09:20:14 UTC
回复： Fwd: ETL using Hadoop
using mr job to "ETL" the temporary data store in hdfs
------------------
---------------------------------------------
BestWishes！
Blog:http://snv.iteye.com/
------------------ 原始邮件 ------------------
发件人: "Dattatrya Moin";<da...@gmail.com>;
发送时间: 2014年10月8日(星期三) 下午3:44
收件人: "user"<us...@hadoop.apache.org>;
主题: Re: Fwd: ETL using Hadoop
Hi ,
We are extracting data from Oracle database, we are processing that data (Transformation) i.e. Substring ,Replace and loading modified data back to Oracle database.
On Wed, Oct 8, 2014 at 12:13 PM, snv <sm...@foxmail.com> wrote:
where to "E" where to "L"? what do you do in "E" and "T"?
------------------
---------------------------------------------
BestWishes！
Blog:http://snv.iteye.com/
------------------ 原始邮件 ------------------
发件人: "Dattatrya Moin";<da...@gmail.com>;
发送时间: 2014年10月8日(星期三) 下午3:01
收件人: "user"<us...@hadoop.apache.org>;
主题: Fwd: ETL using Hadoop
Hi ,
We have our own ETL , but we are planning to use Hadoop for data processing as it gives better scalability and performance. As i am new to hadoop kindly guide to start with Hadoop. Can we replace ETL using Hadoop . And we have any API to connect to Hadoop using .NET.
Thanks,
Dattatrya Moin
回复： Fwd: ETL using Hadoop
Posted by snv <sm...@foxmail.com>.
if complex use script such as BRMS to deal the biz
------------------
---------------------------------------------
BestWishes！
Blog:http://snv.iteye.com/
------------------ 原始邮件 ------------------
发件人: "Blade Liu";<ha...@gmail.com>;
发送时间: 2014年10月8日(星期三) 下午4:54
收件人: "user"<us...@hadoop.apache.org>;
主题: Re: Fwd: ETL using Hadoop
Why not process data on-the-fly? I guess reading and writing data in HDFS would incur high latency.
2014-10-08 15:20 GMT+08:00 snv <sm...@foxmail.com>:
using mr job to "ETL" the temporary data store in hdfs
------------------
---------------------------------------------
BestWishes！
Blog:http://snv.iteye.com/
------------------ 原始邮件 ------------------
发件人: "Dattatrya Moin";<da...@gmail.com>;
发送时间: 2014年10月8日(星期三) 下午3:44
收件人: "user"<us...@hadoop.apache.org>;
主题: Re: Fwd: ETL using Hadoop
Hi ,
We are extracting data from Oracle database, we are processing that data (Transformation) i.e. Substring ,Replace and loading modified data back to Oracle database.
On Wed, Oct 8, 2014 at 12:13 PM, snv <sm...@foxmail.com> wrote:
where to "E" where to "L"? what do you do in "E" and "T"?
------------------
---------------------------------------------
BestWishes！
Blog:http://snv.iteye.com/
------------------ 原始邮件 ------------------
发件人: "Dattatrya Moin";<da...@gmail.com>;
发送时间: 2014年10月8日(星期三) 下午3:01
收件人: "user"<us...@hadoop.apache.org>;
主题: Fwd: ETL using Hadoop
Hi ,
We have our own ETL , but we are planning to use Hadoop for data processing as it gives better scalability and performance. As i am new to hadoop kindly guide to start with Hadoop. Can we replace ETL using Hadoop . And we have any API to connect to Hadoop using .NET.
Thanks,
Dattatrya Moin
回复： Fwd: ETL using Hadoop
Posted by snv <sm...@foxmail.com>.
if complex use script such as BRMS to deal the biz
------------------
---------------------------------------------
BestWishes！
Blog:http://snv.iteye.com/
------------------ 原始邮件 ------------------
发件人: "Blade Liu";<ha...@gmail.com>;
发送时间: 2014年10月8日(星期三) 下午4:54
收件人: "user"<us...@hadoop.apache.org>;
主题: Re: Fwd: ETL using Hadoop
Why not process data on-the-fly? I guess reading and writing data in HDFS would incur high latency.
2014-10-08 15:20 GMT+08:00 snv <sm...@foxmail.com>:
using mr job to "ETL" the temporary data store in hdfs
------------------
---------------------------------------------
BestWishes！
Blog:http://snv.iteye.com/
------------------ 原始邮件 ------------------
发件人: "Dattatrya Moin";<da...@gmail.com>;
发送时间: 2014年10月8日(星期三) 下午3:44
收件人: "user"<us...@hadoop.apache.org>;
主题: Re: Fwd: ETL using Hadoop
Hi ,
We are extracting data from Oracle database, we are processing that data (Transformation) i.e. Substring ,Replace and loading modified data back to Oracle database.
On Wed, Oct 8, 2014 at 12:13 PM, snv <sm...@foxmail.com> wrote:
where to "E" where to "L"? what do you do in "E" and "T"?
------------------
---------------------------------------------
BestWishes！
Blog:http://snv.iteye.com/
------------------ 原始邮件 ------------------
发件人: "Dattatrya Moin";<da...@gmail.com>;
发送时间: 2014年10月8日(星期三) 下午3:01
收件人: "user"<us...@hadoop.apache.org>;
主题: Fwd: ETL using Hadoop
Hi ,
We have our own ETL , but we are planning to use Hadoop for data processing as it gives better scalability and performance. As i am new to hadoop kindly guide to start with Hadoop. Can we replace ETL using Hadoop . And we have any API to connect to Hadoop using .NET.
Thanks,
Dattatrya Moin
回复： Fwd: ETL using Hadoop
Posted by snv <sm...@foxmail.com>.
if complex use script such as BRMS to deal the biz
------------------
---------------------------------------------
BestWishes！
Blog:http://snv.iteye.com/
------------------ 原始邮件 ------------------
发件人: "Blade Liu";<ha...@gmail.com>;
发送时间: 2014年10月8日(星期三) 下午4:54
收件人: "user"<us...@hadoop.apache.org>;
主题: Re: Fwd: ETL using Hadoop
Why not process data on-the-fly? I guess reading and writing data in HDFS would incur high latency.
2014-10-08 15:20 GMT+08:00 snv <sm...@foxmail.com>:
using mr job to "ETL" the temporary data store in hdfs
------------------
---------------------------------------------
BestWishes！
Blog:http://snv.iteye.com/
------------------ 原始邮件 ------------------
发件人: "Dattatrya Moin";<da...@gmail.com>;
发送时间: 2014年10月8日(星期三) 下午3:44
收件人: "user"<us...@hadoop.apache.org>;
主题: Re: Fwd: ETL using Hadoop
Hi ,
We are extracting data from Oracle database, we are processing that data (Transformation) i.e. Substring ,Replace and loading modified data back to Oracle database.
On Wed, Oct 8, 2014 at 12:13 PM, snv <sm...@foxmail.com> wrote:
where to "E" where to "L"? what do you do in "E" and "T"?
------------------
---------------------------------------------
BestWishes！
Blog:http://snv.iteye.com/
------------------ 原始邮件 ------------------
发件人: "Dattatrya Moin";<da...@gmail.com>;
发送时间: 2014年10月8日(星期三) 下午3:01
收件人: "user"<us...@hadoop.apache.org>;
主题: Fwd: ETL using Hadoop
Hi ,
We have our own ETL , but we are planning to use Hadoop for data processing as it gives better scalability and performance. As i am new to hadoop kindly guide to start with Hadoop. Can we replace ETL using Hadoop . And we have any API to connect to Hadoop using .NET.
Thanks,
Dattatrya Moin
回复： Fwd: ETL using Hadoop
Posted by snv <sm...@foxmail.com>.
if complex use script such as BRMS to deal the biz
------------------
---------------------------------------------
BestWishes！
Blog:http://snv.iteye.com/
------------------ 原始邮件 ------------------
发件人: "Blade Liu";<ha...@gmail.com>;
发送时间: 2014年10月8日(星期三) 下午4:54
收件人: "user"<us...@hadoop.apache.org>;
主题: Re: Fwd: ETL using Hadoop
Why not process data on-the-fly? I guess reading and writing data in HDFS would incur high latency.
2014-10-08 15:20 GMT+08:00 snv <sm...@foxmail.com>:
using mr job to "ETL" the temporary data store in hdfs
------------------
---------------------------------------------
BestWishes！
Blog:http://snv.iteye.com/
------------------ 原始邮件 ------------------
发件人: "Dattatrya Moin";<da...@gmail.com>;
发送时间: 2014年10月8日(星期三) 下午3:44
收件人: "user"<us...@hadoop.apache.org>;
主题: Re: Fwd: ETL using Hadoop
Hi ,
We are extracting data from Oracle database, we are processing that data (Transformation) i.e. Substring ,Replace and loading modified data back to Oracle database.
On Wed, Oct 8, 2014 at 12:13 PM, snv <sm...@foxmail.com> wrote:
where to "E" where to "L"? what do you do in "E" and "T"?
------------------
---------------------------------------------
BestWishes！
Blog:http://snv.iteye.com/
------------------ 原始邮件 ------------------
发件人: "Dattatrya Moin";<da...@gmail.com>;
发送时间: 2014年10月8日(星期三) 下午3:01
收件人: "user"<us...@hadoop.apache.org>;
主题: Fwd: ETL using Hadoop
Hi ,
We have our own ETL , but we are planning to use Hadoop for data processing as it gives better scalability and performance. As i am new to hadoop kindly guide to start with Hadoop. Can we replace ETL using Hadoop . And we have any API to connect to Hadoop using .NET.
Thanks,
Dattatrya Moin
Re: Fwd: ETL using Hadoop
Posted by Blade Liu <ha...@gmail.com>.
Why not process data on-the-fly? I guess reading and writing data in HDFS
would incur high latency.
2014-10-08 15:20 GMT+08:00 snv <sm...@foxmail.com>:
> using mr job to "ETL" the temporary data store in hdfs
>
> ------------------
> ---------------------------------------------
> BestWishes！
> Blog:http://snv.iteye.com/
>
>
>
>
> ------------------ 原始邮件 ------------------
> *发件人:* "Dattatrya Moin";<da...@gmail.com>;
> *发送时间:* 2014年10月8日(星期三) 下午3:44
> *收件人:* "user"<us...@hadoop.apache.org>;
> *主题:* Re: Fwd: ETL using Hadoop
>
> Hi ,
>
> We are extracting data from Oracle database, we are processing that data
> (Transformation) i.e. Substring ,Replace and loading modified data back to
> Oracle database.
>
> On Wed, Oct 8, 2014 at 12:13 PM, snv <sm...@foxmail.com> wrote:
>
>> where to "E" where to "L"? what do you do in "E" and "T"?
>>
>> ------------------
>> ---------------------------------------------
>> BestWishes！
>> Blog:http://snv.iteye.com/
>>
>>
>>
>>
>> ------------------ 原始邮件 ------------------
>> *发件人:* "Dattatrya Moin";<da...@gmail.com>;
>> *发送时间:* 2014年10月8日(星期三) 下午3:01
>> *收件人:* "user"<us...@hadoop.apache.org>;
>> *主题:* Fwd: ETL using Hadoop
>>
>>
>> Hi ,
>>
>> We have our own ETL , but we are planning to use Hadoop for data
>> processing as it gives better scalability and performance. As i am new to
>> hadoop kindly guide to start with Hadoop. Can we replace ETL using Hadoop .
>> And we have any API to connect to Hadoop using .NET.
>>
>>
>> Thanks,
>> Dattatrya Moin
>>
>>
>
Re: Fwd: ETL using Hadoop
Posted by Blade Liu <ha...@gmail.com>.
Why not process data on-the-fly? I guess reading and writing data in HDFS
would incur high latency.
2014-10-08 15:20 GMT+08:00 snv <sm...@foxmail.com>:
> using mr job to "ETL" the temporary data store in hdfs
>
> ------------------
> ---------------------------------------------
> BestWishes！
> Blog:http://snv.iteye.com/
>
>
>
>
> ------------------ 原始邮件 ------------------
> *发件人:* "Dattatrya Moin";<da...@gmail.com>;
> *发送时间:* 2014年10月8日(星期三) 下午3:44
> *收件人:* "user"<us...@hadoop.apache.org>;
> *主题:* Re: Fwd: ETL using Hadoop
>
> Hi ,
>
> We are extracting data from Oracle database, we are processing that data
> (Transformation) i.e. Substring ,Replace and loading modified data back to
> Oracle database.
>
> On Wed, Oct 8, 2014 at 12:13 PM, snv <sm...@foxmail.com> wrote:
>
>> where to "E" where to "L"? what do you do in "E" and "T"?
>>
>> ------------------
>> ---------------------------------------------
>> BestWishes！
>> Blog:http://snv.iteye.com/
>>
>>
>>
>>
>> ------------------ 原始邮件 ------------------
>> *发件人:* "Dattatrya Moin";<da...@gmail.com>;
>> *发送时间:* 2014年10月8日(星期三) 下午3:01
>> *收件人:* "user"<us...@hadoop.apache.org>;
>> *主题:* Fwd: ETL using Hadoop
>>
>>
>> Hi ,
>>
>> We have our own ETL , but we are planning to use Hadoop for data
>> processing as it gives better scalability and performance. As i am new to
>> hadoop kindly guide to start with Hadoop. Can we replace ETL using Hadoop .
>> And we have any API to connect to Hadoop using .NET.
>>
>>
>> Thanks,
>> Dattatrya Moin
>>
>>
>
Re: Fwd: ETL using Hadoop
Posted by Blade Liu <ha...@gmail.com>.
Why not process data on-the-fly? I guess reading and writing data in HDFS
would incur high latency.
2014-10-08 15:20 GMT+08:00 snv <sm...@foxmail.com>:
> using mr job to "ETL" the temporary data store in hdfs
>
> ------------------
> ---------------------------------------------
> BestWishes！
> Blog:http://snv.iteye.com/
>
>
>
>
> ------------------ 原始邮件 ------------------
> *发件人:* "Dattatrya Moin";<da...@gmail.com>;
> *发送时间:* 2014年10月8日(星期三) 下午3:44
> *收件人:* "user"<us...@hadoop.apache.org>;
> *主题:* Re: Fwd: ETL using Hadoop
>
> Hi ,
>
> We are extracting data from Oracle database, we are processing that data
> (Transformation) i.e. Substring ,Replace and loading modified data back to
> Oracle database.
>
> On Wed, Oct 8, 2014 at 12:13 PM, snv <sm...@foxmail.com> wrote:
>
>> where to "E" where to "L"? what do you do in "E" and "T"?
>>
>> ------------------
>> ---------------------------------------------
>> BestWishes！
>> Blog:http://snv.iteye.com/
>>
>>
>>
>>
>> ------------------ 原始邮件 ------------------
>> *发件人:* "Dattatrya Moin";<da...@gmail.com>;
>> *发送时间:* 2014年10月8日(星期三) 下午3:01
>> *收件人:* "user"<us...@hadoop.apache.org>;
>> *主题:* Fwd: ETL using Hadoop
>>
>>
>> Hi ,
>>
>> We have our own ETL , but we are planning to use Hadoop for data
>> processing as it gives better scalability and performance. As i am new to
>> hadoop kindly guide to start with Hadoop. Can we replace ETL using Hadoop .
>> And we have any API to connect to Hadoop using .NET.
>>
>>
>> Thanks,
>> Dattatrya Moin
>>
>>
>
Re: Fwd: ETL using Hadoop
Posted by Blade Liu <ha...@gmail.com>.
Why not process data on-the-fly? I guess reading and writing data in HDFS
would incur high latency.
2014-10-08 15:20 GMT+08:00 snv <sm...@foxmail.com>:
> using mr job to "ETL" the temporary data store in hdfs
>
> ------------------
> ---------------------------------------------
> BestWishes！
> Blog:http://snv.iteye.com/
>
>
>
>
> ------------------ 原始邮件 ------------------
> *发件人:* "Dattatrya Moin";<da...@gmail.com>;
> *发送时间:* 2014年10月8日(星期三) 下午3:44
> *收件人:* "user"<us...@hadoop.apache.org>;
> *主题:* Re: Fwd: ETL using Hadoop
>
> Hi ,
>
> We are extracting data from Oracle database, we are processing that data
> (Transformation) i.e. Substring ,Replace and loading modified data back to
> Oracle database.
>
> On Wed, Oct 8, 2014 at 12:13 PM, snv <sm...@foxmail.com> wrote:
>
>> where to "E" where to "L"? what do you do in "E" and "T"?
>>
>> ------------------
>> ---------------------------------------------
>> BestWishes！
>> Blog:http://snv.iteye.com/
>>
>>
>>
>>
>> ------------------ 原始邮件 ------------------
>> *发件人:* "Dattatrya Moin";<da...@gmail.com>;
>> *发送时间:* 2014年10月8日(星期三) 下午3:01
>> *收件人:* "user"<us...@hadoop.apache.org>;
>> *主题:* Fwd: ETL using Hadoop
>>
>>
>> Hi ,
>>
>> We have our own ETL , but we are planning to use Hadoop for data
>> processing as it gives better scalability and performance. As i am new to
>> hadoop kindly guide to start with Hadoop. Can we replace ETL using Hadoop .
>> And we have any API to connect to Hadoop using .NET.
>>
>>
>> Thanks,
>> Dattatrya Moin
>>
>>
>