Hadoop Usecase

[Sh...@cognizant.com]

Hi,

I am trying to implement the following use case, is that possible in
hadoop:
I would have to use Hive or Hbase?

Data comes in at hourly intervals, 15 min, 10 min and 5 min interval
Goal are :
1. Compare incoming data with the data stored in existing system 
2. Identifying incremental changes
3. Changes should be identified as : Insert, Update, Delete
4. Loading the incremental changes in target system    

Is this possible or efficient if Hadoop has to be used?
Please Advice

Regards,
Shreya
This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information.
If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message.
Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email or any action taken in reliance on this e-mail is strictly prohibited and may be unlawful.

RE: Hadoop Usecase

[Ravi teja ch n v <ra...@huawei.com>]

Hi Shreya,

We had a similar question and some discussions, this mailing thread may help you.

http://mail-archives.apache.org/mod_mbox/hadoop-common-user/201112.mbox/%3cCALH6cCNSXQye8F6geJiUDu+30Q4==EOd1pmU+rzpj50_evC5=w@mail.gmail.com%3e

Regards,
Ravi Teja
________________________________________
From: Shreya.Pal@cognizant.com [Shreya.Pal@cognizant.com]
Sent: 07 December 2011 13:47:02
To: common-user@hadoop.apache.org
Subject: Hadoop Usecase

Hi,

I am trying to implement the following use case, is that possible in
hadoop:
I would have to use Hive or Hbase?

Data comes in at hourly intervals, 15 min, 10 min and 5 min interval
Goal are :
1. Compare incoming data with the data stored in existing system
2. Identifying incremental changes
3. Changes should be identified as : Insert, Update, Delete
4. Loading the incremental changes in target system

Is this possible or efficient if Hadoop has to be used?
Please Advice

Regards,
Shreya
This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information.
If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message.
Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email or any action taken in reliance on this e-mail is strictly prohibited and may be unlawful.