Sqoop Merge using three data sets

[sh...@accenture.com]

Hi,

Is it possible to do sqoop merge on three data sets where first has incremental records, second one is the original full data & the third one has records that are marked for deletion?

Thanks,
Shouvanik

________________________________

This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in error, please notify the sender immediately and delete the original. Any other use of the e-mail by you is prohibited. Where allowed by local law, electronic communications with Accenture and its affiliates, including e-mail and instant messaging (including content), may be scanned by our systems for the purposes of information security and assessment of internal compliance with Accenture policy. .
______________________________________________________________________________________

www.accenture.com

Re: Sqoop Merge using three data sets

[Jarek Jarcec Cecho <ja...@apache.org>]

Hi Shouvanik,
sadly Sqoop currently do not have facility to remove deleted rows when merging multiple data sets. I would highly encourage you to file a feature request on [1] to add that. Feel free to give it a shot!

Jarcec

Links:
1: https://issues.apache.org/jira/browse/SQOOP

On Tue, Nov 12, 2013 at 03:58:55PM +0000, shouvanik.haldar@accenture.com wrote:
> Hi,
> 
> Is it possible to do sqoop merge on three data sets where first has incremental records, second one is the original full data & the third one has records that are marked for deletion?
> 
> Thanks,
> Shouvanik
> 
> ________________________________
> 
> This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in error, please notify the sender immediately and delete the original. Any other use of the e-mail by you is prohibited. Where allowed by local law, electronic communications with Accenture and its affiliates, including e-mail and instant messaging (including content), may be scanned by our systems for the purposes of information security and assessment of internal compliance with Accenture policy. .
> ______________________________________________________________________________________
> 
> www.accenture.com