You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by samir das mohapatra <sa...@gmail.com> on 2013/03/14 11:10:29 UTC
How to pull Delta data from one cluster to another cluster ?
Regards,
samir.
Re: How to pull Delta data from one cluster to another cluster ?
Posted by Mohammad Tariq <do...@gmail.com>.
I have never tried it personally, but it might work. Also have a look at
Flume. You might find it helpful.
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Mar 14, 2013 at 4:23 PM, samir das mohapatra <
samir.helpdoc@gmail.com> wrote:
> will sqoop support inter-cluster data copy after filder.
>
> Senario:
> 1) cluster-1, cluster-2
> 2) taking data from cluster-1 to cluster-2 based on filter condition
> Will sqoop support ?
>
>
>
> On Thu, Mar 14, 2013 at 4:19 PM, Tariq <do...@gmail.com> wrote:
>
>> You can do that through Pig.
>>
>> samir das mohapatra <sa...@gmail.com> wrote:
>>>
>>> how to pull delta data that means filter data not whole data as off now
>>> i know we can do whole data through the distcp, colud you plese help if i
>>> am wrong or any other way to pull efficiently.
>>>
>>>
>>> like : get data based on filter condition.
>>>
>>>
>>>
>>>
>>> On Thu, Mar 14, 2013 at 3:43 PM, Mohammad Tariq <do...@gmail.com>wrote:
>>>
>>>> Use distcp.
>>>>
>>>> Warm Regards,
>>>> Tariq
>>>> https://mtariq.jux.com/
>>>> cloudfront.blogspot.com
>>>>
>>>>
>>>> On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
>>>> samir.helpdoc@gmail.com> wrote:
>>>>
>>>>> Regards,
>>>>> samir.
>>>>>
>>>>
>>>>
>>>
>> --
>> Sent from my Android phone with K-9 Mail. Please excuse my brevity.
>>
>
>
Re: How to pull Delta data from one cluster to another cluster ?
Posted by Mohammad Tariq <do...@gmail.com>.
I have never tried it personally, but it might work. Also have a look at
Flume. You might find it helpful.
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Mar 14, 2013 at 4:23 PM, samir das mohapatra <
samir.helpdoc@gmail.com> wrote:
> will sqoop support inter-cluster data copy after filder.
>
> Senario:
> 1) cluster-1, cluster-2
> 2) taking data from cluster-1 to cluster-2 based on filter condition
> Will sqoop support ?
>
>
>
> On Thu, Mar 14, 2013 at 4:19 PM, Tariq <do...@gmail.com> wrote:
>
>> You can do that through Pig.
>>
>> samir das mohapatra <sa...@gmail.com> wrote:
>>>
>>> how to pull delta data that means filter data not whole data as off now
>>> i know we can do whole data through the distcp, colud you plese help if i
>>> am wrong or any other way to pull efficiently.
>>>
>>>
>>> like : get data based on filter condition.
>>>
>>>
>>>
>>>
>>> On Thu, Mar 14, 2013 at 3:43 PM, Mohammad Tariq <do...@gmail.com>wrote:
>>>
>>>> Use distcp.
>>>>
>>>> Warm Regards,
>>>> Tariq
>>>> https://mtariq.jux.com/
>>>> cloudfront.blogspot.com
>>>>
>>>>
>>>> On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
>>>> samir.helpdoc@gmail.com> wrote:
>>>>
>>>>> Regards,
>>>>> samir.
>>>>>
>>>>
>>>>
>>>
>> --
>> Sent from my Android phone with K-9 Mail. Please excuse my brevity.
>>
>
>
Re: How to pull Delta data from one cluster to another cluster ?
Posted by Mohammad Tariq <do...@gmail.com>.
I have never tried it personally, but it might work. Also have a look at
Flume. You might find it helpful.
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Mar 14, 2013 at 4:23 PM, samir das mohapatra <
samir.helpdoc@gmail.com> wrote:
> will sqoop support inter-cluster data copy after filder.
>
> Senario:
> 1) cluster-1, cluster-2
> 2) taking data from cluster-1 to cluster-2 based on filter condition
> Will sqoop support ?
>
>
>
> On Thu, Mar 14, 2013 at 4:19 PM, Tariq <do...@gmail.com> wrote:
>
>> You can do that through Pig.
>>
>> samir das mohapatra <sa...@gmail.com> wrote:
>>>
>>> how to pull delta data that means filter data not whole data as off now
>>> i know we can do whole data through the distcp, colud you plese help if i
>>> am wrong or any other way to pull efficiently.
>>>
>>>
>>> like : get data based on filter condition.
>>>
>>>
>>>
>>>
>>> On Thu, Mar 14, 2013 at 3:43 PM, Mohammad Tariq <do...@gmail.com>wrote:
>>>
>>>> Use distcp.
>>>>
>>>> Warm Regards,
>>>> Tariq
>>>> https://mtariq.jux.com/
>>>> cloudfront.blogspot.com
>>>>
>>>>
>>>> On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
>>>> samir.helpdoc@gmail.com> wrote:
>>>>
>>>>> Regards,
>>>>> samir.
>>>>>
>>>>
>>>>
>>>
>> --
>> Sent from my Android phone with K-9 Mail. Please excuse my brevity.
>>
>
>
Re: How to pull Delta data from one cluster to another cluster ?
Posted by Mohammad Tariq <do...@gmail.com>.
I have never tried it personally, but it might work. Also have a look at
Flume. You might find it helpful.
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Mar 14, 2013 at 4:23 PM, samir das mohapatra <
samir.helpdoc@gmail.com> wrote:
> will sqoop support inter-cluster data copy after filder.
>
> Senario:
> 1) cluster-1, cluster-2
> 2) taking data from cluster-1 to cluster-2 based on filter condition
> Will sqoop support ?
>
>
>
> On Thu, Mar 14, 2013 at 4:19 PM, Tariq <do...@gmail.com> wrote:
>
>> You can do that through Pig.
>>
>> samir das mohapatra <sa...@gmail.com> wrote:
>>>
>>> how to pull delta data that means filter data not whole data as off now
>>> i know we can do whole data through the distcp, colud you plese help if i
>>> am wrong or any other way to pull efficiently.
>>>
>>>
>>> like : get data based on filter condition.
>>>
>>>
>>>
>>>
>>> On Thu, Mar 14, 2013 at 3:43 PM, Mohammad Tariq <do...@gmail.com>wrote:
>>>
>>>> Use distcp.
>>>>
>>>> Warm Regards,
>>>> Tariq
>>>> https://mtariq.jux.com/
>>>> cloudfront.blogspot.com
>>>>
>>>>
>>>> On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
>>>> samir.helpdoc@gmail.com> wrote:
>>>>
>>>>> Regards,
>>>>> samir.
>>>>>
>>>>
>>>>
>>>
>> --
>> Sent from my Android phone with K-9 Mail. Please excuse my brevity.
>>
>
>
Re: How to pull Delta data from one cluster to another cluster ?
Posted by samir das mohapatra <sa...@gmail.com>.
will sqoop support inter-cluster data copy after filder.
Senario:
1) cluster-1, cluster-2
2) taking data from cluster-1 to cluster-2 based on filter condition
Will sqoop support ?
On Thu, Mar 14, 2013 at 4:19 PM, Tariq <do...@gmail.com> wrote:
> You can do that through Pig.
>
> samir das mohapatra <sa...@gmail.com> wrote:
>>
>> how to pull delta data that means filter data not whole data as off now i
>> know we can do whole data through the distcp, colud you plese help if i am
>> wrong or any other way to pull efficiently.
>>
>>
>> like : get data based on filter condition.
>>
>>
>>
>>
>> On Thu, Mar 14, 2013 at 3:43 PM, Mohammad Tariq <do...@gmail.com>wrote:
>>
>>> Use distcp.
>>>
>>> Warm Regards,
>>> Tariq
>>> https://mtariq.jux.com/
>>> cloudfront.blogspot.com
>>>
>>>
>>> On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
>>> samir.helpdoc@gmail.com> wrote:
>>>
>>>> Regards,
>>>> samir.
>>>>
>>>
>>>
>>
> --
> Sent from my Android phone with K-9 Mail. Please excuse my brevity.
>
Re: How to pull Delta data from one cluster to another cluster ?
Posted by samir das mohapatra <sa...@gmail.com>.
will sqoop support inter-cluster data copy after filder.
Senario:
1) cluster-1, cluster-2
2) taking data from cluster-1 to cluster-2 based on filter condition
Will sqoop support ?
On Thu, Mar 14, 2013 at 4:19 PM, Tariq <do...@gmail.com> wrote:
> You can do that through Pig.
>
> samir das mohapatra <sa...@gmail.com> wrote:
>>
>> how to pull delta data that means filter data not whole data as off now i
>> know we can do whole data through the distcp, colud you plese help if i am
>> wrong or any other way to pull efficiently.
>>
>>
>> like : get data based on filter condition.
>>
>>
>>
>>
>> On Thu, Mar 14, 2013 at 3:43 PM, Mohammad Tariq <do...@gmail.com>wrote:
>>
>>> Use distcp.
>>>
>>> Warm Regards,
>>> Tariq
>>> https://mtariq.jux.com/
>>> cloudfront.blogspot.com
>>>
>>>
>>> On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
>>> samir.helpdoc@gmail.com> wrote:
>>>
>>>> Regards,
>>>> samir.
>>>>
>>>
>>>
>>
> --
> Sent from my Android phone with K-9 Mail. Please excuse my brevity.
>
Re: How to pull Delta data from one cluster to another cluster ?
Posted by samir das mohapatra <sa...@gmail.com>.
will sqoop support inter-cluster data copy after filder.
Senario:
1) cluster-1, cluster-2
2) taking data from cluster-1 to cluster-2 based on filter condition
Will sqoop support ?
On Thu, Mar 14, 2013 at 4:19 PM, Tariq <do...@gmail.com> wrote:
> You can do that through Pig.
>
> samir das mohapatra <sa...@gmail.com> wrote:
>>
>> how to pull delta data that means filter data not whole data as off now i
>> know we can do whole data through the distcp, colud you plese help if i am
>> wrong or any other way to pull efficiently.
>>
>>
>> like : get data based on filter condition.
>>
>>
>>
>>
>> On Thu, Mar 14, 2013 at 3:43 PM, Mohammad Tariq <do...@gmail.com>wrote:
>>
>>> Use distcp.
>>>
>>> Warm Regards,
>>> Tariq
>>> https://mtariq.jux.com/
>>> cloudfront.blogspot.com
>>>
>>>
>>> On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
>>> samir.helpdoc@gmail.com> wrote:
>>>
>>>> Regards,
>>>> samir.
>>>>
>>>
>>>
>>
> --
> Sent from my Android phone with K-9 Mail. Please excuse my brevity.
>
Re: How to pull Delta data from one cluster to another cluster ?
Posted by samir das mohapatra <sa...@gmail.com>.
will sqoop support inter-cluster data copy after filder.
Senario:
1) cluster-1, cluster-2
2) taking data from cluster-1 to cluster-2 based on filter condition
Will sqoop support ?
On Thu, Mar 14, 2013 at 4:19 PM, Tariq <do...@gmail.com> wrote:
> You can do that through Pig.
>
> samir das mohapatra <sa...@gmail.com> wrote:
>>
>> how to pull delta data that means filter data not whole data as off now i
>> know we can do whole data through the distcp, colud you plese help if i am
>> wrong or any other way to pull efficiently.
>>
>>
>> like : get data based on filter condition.
>>
>>
>>
>>
>> On Thu, Mar 14, 2013 at 3:43 PM, Mohammad Tariq <do...@gmail.com>wrote:
>>
>>> Use distcp.
>>>
>>> Warm Regards,
>>> Tariq
>>> https://mtariq.jux.com/
>>> cloudfront.blogspot.com
>>>
>>>
>>> On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
>>> samir.helpdoc@gmail.com> wrote:
>>>
>>>> Regards,
>>>> samir.
>>>>
>>>
>>>
>>
> --
> Sent from my Android phone with K-9 Mail. Please excuse my brevity.
>
Re: How to pull Delta data from one cluster to another cluster ?
Posted by Tariq <do...@gmail.com>.
You can do that through Pig.
samir das mohapatra <sa...@gmail.com> wrote:
>how to pull delta data that means filter data not whole data as off now
>i
>know we can do whole data through the distcp, colud you plese help if i
>am
>wrong or any other way to pull efficiently.
>
>
>like : get data based on filter condition.
>
>
>
>
>On Thu, Mar 14, 2013 at 3:43 PM, Mohammad Tariq <do...@gmail.com>
>wrote:
>
>> Use distcp.
>>
>> Warm Regards,
>> Tariq
>> https://mtariq.jux.com/
>> cloudfront.blogspot.com
>>
>>
>> On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
>> samir.helpdoc@gmail.com> wrote:
>>
>>> Regards,
>>> samir.
>>>
>>
>>
--
Sent from my Android phone with K-9 Mail. Please excuse my brevity.
Re: How to pull Delta data from one cluster to another cluster ?
Posted by Tariq <do...@gmail.com>.
You can do that through Pig.
samir das mohapatra <sa...@gmail.com> wrote:
>how to pull delta data that means filter data not whole data as off now
>i
>know we can do whole data through the distcp, colud you plese help if i
>am
>wrong or any other way to pull efficiently.
>
>
>like : get data based on filter condition.
>
>
>
>
>On Thu, Mar 14, 2013 at 3:43 PM, Mohammad Tariq <do...@gmail.com>
>wrote:
>
>> Use distcp.
>>
>> Warm Regards,
>> Tariq
>> https://mtariq.jux.com/
>> cloudfront.blogspot.com
>>
>>
>> On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
>> samir.helpdoc@gmail.com> wrote:
>>
>>> Regards,
>>> samir.
>>>
>>
>>
--
Sent from my Android phone with K-9 Mail. Please excuse my brevity.
Re: How to pull Delta data from one cluster to another cluster ?
Posted by Tariq <do...@gmail.com>.
You can do that through Pig.
samir das mohapatra <sa...@gmail.com> wrote:
>how to pull delta data that means filter data not whole data as off now
>i
>know we can do whole data through the distcp, colud you plese help if i
>am
>wrong or any other way to pull efficiently.
>
>
>like : get data based on filter condition.
>
>
>
>
>On Thu, Mar 14, 2013 at 3:43 PM, Mohammad Tariq <do...@gmail.com>
>wrote:
>
>> Use distcp.
>>
>> Warm Regards,
>> Tariq
>> https://mtariq.jux.com/
>> cloudfront.blogspot.com
>>
>>
>> On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
>> samir.helpdoc@gmail.com> wrote:
>>
>>> Regards,
>>> samir.
>>>
>>
>>
--
Sent from my Android phone with K-9 Mail. Please excuse my brevity.
Re: How to pull Delta data from one cluster to another cluster ?
Posted by Tariq <do...@gmail.com>.
You can do that through Pig.
samir das mohapatra <sa...@gmail.com> wrote:
>how to pull delta data that means filter data not whole data as off now
>i
>know we can do whole data through the distcp, colud you plese help if i
>am
>wrong or any other way to pull efficiently.
>
>
>like : get data based on filter condition.
>
>
>
>
>On Thu, Mar 14, 2013 at 3:43 PM, Mohammad Tariq <do...@gmail.com>
>wrote:
>
>> Use distcp.
>>
>> Warm Regards,
>> Tariq
>> https://mtariq.jux.com/
>> cloudfront.blogspot.com
>>
>>
>> On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
>> samir.helpdoc@gmail.com> wrote:
>>
>>> Regards,
>>> samir.
>>>
>>
>>
--
Sent from my Android phone with K-9 Mail. Please excuse my brevity.
Re: How to pull Delta data from one cluster to another cluster ?
Posted by samir das mohapatra <sa...@gmail.com>.
how to pull delta data that means filter data not whole data as off now i
know we can do whole data through the distcp, colud you plese help if i am
wrong or any other way to pull efficiently.
like : get data based on filter condition.
On Thu, Mar 14, 2013 at 3:43 PM, Mohammad Tariq <do...@gmail.com> wrote:
> Use distcp.
>
> Warm Regards,
> Tariq
> https://mtariq.jux.com/
> cloudfront.blogspot.com
>
>
> On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
> samir.helpdoc@gmail.com> wrote:
>
>> Regards,
>> samir.
>>
>
>
Re: How to pull Delta data from one cluster to another cluster ?
Posted by samir das mohapatra <sa...@gmail.com>.
how to pull delta data that means filter data not whole data as off now i
know we can do whole data through the distcp, colud you plese help if i am
wrong or any other way to pull efficiently.
like : get data based on filter condition.
On Thu, Mar 14, 2013 at 3:43 PM, Mohammad Tariq <do...@gmail.com> wrote:
> Use distcp.
>
> Warm Regards,
> Tariq
> https://mtariq.jux.com/
> cloudfront.blogspot.com
>
>
> On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
> samir.helpdoc@gmail.com> wrote:
>
>> Regards,
>> samir.
>>
>
>
Re: How to pull Delta data from one cluster to another cluster ?
Posted by samir das mohapatra <sa...@gmail.com>.
how to pull delta data that means filter data not whole data as off now i
know we can do whole data through the distcp, colud you plese help if i am
wrong or any other way to pull efficiently.
like : get data based on filter condition.
On Thu, Mar 14, 2013 at 3:43 PM, Mohammad Tariq <do...@gmail.com> wrote:
> Use distcp.
>
> Warm Regards,
> Tariq
> https://mtariq.jux.com/
> cloudfront.blogspot.com
>
>
> On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
> samir.helpdoc@gmail.com> wrote:
>
>> Regards,
>> samir.
>>
>
>
Re: How to pull Delta data from one cluster to another cluster ?
Posted by samir das mohapatra <sa...@gmail.com>.
how to pull delta data that means filter data not whole data as off now i
know we can do whole data through the distcp, colud you plese help if i am
wrong or any other way to pull efficiently.
like : get data based on filter condition.
On Thu, Mar 14, 2013 at 3:43 PM, Mohammad Tariq <do...@gmail.com> wrote:
> Use distcp.
>
> Warm Regards,
> Tariq
> https://mtariq.jux.com/
> cloudfront.blogspot.com
>
>
> On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
> samir.helpdoc@gmail.com> wrote:
>
>> Regards,
>> samir.
>>
>
>
Re: How to pull Delta data from one cluster to another cluster ?
Posted by Mohammad Tariq <do...@gmail.com>.
Use distcp.
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
samir.helpdoc@gmail.com> wrote:
> Regards,
> samir.
>
Re: How to pull Delta data from one cluster to another cluster ?
Posted by Mohammad Tariq <do...@gmail.com>.
Use distcp.
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
samir.helpdoc@gmail.com> wrote:
> Regards,
> samir.
>
Re: How to pull Delta data from one cluster to another cluster ?
Posted by Mohammad Tariq <do...@gmail.com>.
Use distcp.
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
samir.helpdoc@gmail.com> wrote:
> Regards,
> samir.
>
Re: How to pull Delta data from one cluster to another cluster ?
Posted by Mohammad Tariq <do...@gmail.com>.
Use distcp.
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Mar 14, 2013 at 3:40 PM, samir das mohapatra <
samir.helpdoc@gmail.com> wrote:
> Regards,
> samir.
>