You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by samir das mohapatra <sa...@gmail.com> on 2013/01/31 06:44:25 UTC
What is the best way to load data from one cluster to another cluster
(Urgent requirement)
Hi All,
Any one knows, how to load data from one hadoop cluster(CDH4) to
another Cluster (CDH4) . They way our project needs are
1) It should be delta load or incremental load.
2) It should be based on the timestamp
3) Data volume are 5PB
Any Help ????????????
Regards,
samir.
Re: What is the best way to load data from one cluster to another
cluster (Urgent requirement)
Posted by samir das mohapatra <sa...@gmail.com>.
thanks all.
On Thu, Jan 31, 2013 at 11:19 AM, Satbeer Lamba <sa...@gmail.com>wrote:
> I might be wrong but have you considered distcp?
> On Jan 31, 2013 11:15 AM, "samir das mohapatra" <sa...@gmail.com>
> wrote:
>
>> Hi All,
>>
>> Any one knows, how to load data from one hadoop cluster(CDH4) to
>> another Cluster (CDH4) . They way our project needs are
>> 1) It should be delta load or incremental load.
>> 2) It should be based on the timestamp
>> 3) Data volume are 5PB
>>
>> Any Help ????????????
>>
>> Regards,
>> samir.
>>
>
Re: What is the best way to load data from one cluster to another
cluster (Urgent requirement)
Posted by samir das mohapatra <sa...@gmail.com>.
thanks all.
On Thu, Jan 31, 2013 at 11:19 AM, Satbeer Lamba <sa...@gmail.com>wrote:
> I might be wrong but have you considered distcp?
> On Jan 31, 2013 11:15 AM, "samir das mohapatra" <sa...@gmail.com>
> wrote:
>
>> Hi All,
>>
>> Any one knows, how to load data from one hadoop cluster(CDH4) to
>> another Cluster (CDH4) . They way our project needs are
>> 1) It should be delta load or incremental load.
>> 2) It should be based on the timestamp
>> 3) Data volume are 5PB
>>
>> Any Help ????????????
>>
>> Regards,
>> samir.
>>
>
Re: What is the best way to load data from one cluster to another
cluster (Urgent requirement)
Posted by samir das mohapatra <sa...@gmail.com>.
thanks all.
On Thu, Jan 31, 2013 at 11:19 AM, Satbeer Lamba <sa...@gmail.com>wrote:
> I might be wrong but have you considered distcp?
> On Jan 31, 2013 11:15 AM, "samir das mohapatra" <sa...@gmail.com>
> wrote:
>
>> Hi All,
>>
>> Any one knows, how to load data from one hadoop cluster(CDH4) to
>> another Cluster (CDH4) . They way our project needs are
>> 1) It should be delta load or incremental load.
>> 2) It should be based on the timestamp
>> 3) Data volume are 5PB
>>
>> Any Help ????????????
>>
>> Regards,
>> samir.
>>
>
Re: What is the best way to load data from one cluster to another
cluster (Urgent requirement)
Posted by samir das mohapatra <sa...@gmail.com>.
thanks all.
On Thu, Jan 31, 2013 at 11:19 AM, Satbeer Lamba <sa...@gmail.com>wrote:
> I might be wrong but have you considered distcp?
> On Jan 31, 2013 11:15 AM, "samir das mohapatra" <sa...@gmail.com>
> wrote:
>
>> Hi All,
>>
>> Any one knows, how to load data from one hadoop cluster(CDH4) to
>> another Cluster (CDH4) . They way our project needs are
>> 1) It should be delta load or incremental load.
>> 2) It should be based on the timestamp
>> 3) Data volume are 5PB
>>
>> Any Help ????????????
>>
>> Regards,
>> samir.
>>
>
Re: What is the best way to load data from one cluster to another
cluster (Urgent requirement)
Posted by Satbeer Lamba <sa...@gmail.com>.
I might be wrong but have you considered distcp?
On Jan 31, 2013 11:15 AM, "samir das mohapatra" <sa...@gmail.com>
wrote:
> Hi All,
>
> Any one knows, how to load data from one hadoop cluster(CDH4) to
> another Cluster (CDH4) . They way our project needs are
> 1) It should be delta load or incremental load.
> 2) It should be based on the timestamp
> 3) Data volume are 5PB
>
> Any Help ????????????
>
> Regards,
> samir.
>
Re: What is the best way to load data from one cluster to another
cluster (Urgent requirement)
Posted by Satbeer Lamba <sa...@gmail.com>.
I might be wrong but have you considered distcp?
On Jan 31, 2013 11:15 AM, "samir das mohapatra" <sa...@gmail.com>
wrote:
> Hi All,
>
> Any one knows, how to load data from one hadoop cluster(CDH4) to
> another Cluster (CDH4) . They way our project needs are
> 1) It should be delta load or incremental load.
> 2) It should be based on the timestamp
> 3) Data volume are 5PB
>
> Any Help ????????????
>
> Regards,
> samir.
>
Re: What is the best way to load data from one cluster to another
cluster (Urgent requirement)
Posted by Satbeer Lamba <sa...@gmail.com>.
I might be wrong but have you considered distcp?
On Jan 31, 2013 11:15 AM, "samir das mohapatra" <sa...@gmail.com>
wrote:
> Hi All,
>
> Any one knows, how to load data from one hadoop cluster(CDH4) to
> another Cluster (CDH4) . They way our project needs are
> 1) It should be delta load or incremental load.
> 2) It should be based on the timestamp
> 3) Data volume are 5PB
>
> Any Help ????????????
>
> Regards,
> samir.
>
Re: What is the best way to load data from one cluster to another
cluster (Urgent requirement)
Posted by Satbeer Lamba <sa...@gmail.com>.
I might be wrong but have you considered distcp?
On Jan 31, 2013 11:15 AM, "samir das mohapatra" <sa...@gmail.com>
wrote:
> Hi All,
>
> Any one knows, how to load data from one hadoop cluster(CDH4) to
> another Cluster (CDH4) . They way our project needs are
> 1) It should be delta load or incremental load.
> 2) It should be based on the timestamp
> 3) Data volume are 5PB
>
> Any Help ????????????
>
> Regards,
> samir.
>