You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Siddharth Tiwari <si...@live.com> on 2013/01/30 17:43:38 UTC
Data migration from one cluster to other running diff. versions
Hi Team,
What is the best way to migrate data residing on one cluster to another cluster ?
Are there better methods available than distcp ?
What if both the clusters running different RPC protocol versions ?
*------------------------*
Cheers !!!
Siddharth Tiwari
Have a refreshing day !!!
"Every duty is holy, and devotion to duty is the highest form of worship of God.”
"Maybe other people will try to limit me but I don't limit myself"
Re: Data migration from one cluster to other running diff. versions
Posted by Harsh J <ha...@cloudera.com>.
DistCp is the fastest option, letting you copy data in parallel. For
incompatible RPC versions between different HDFS clusters, the HFTP
solution can work (documented on the DistCp manual).
On Wed, Jan 30, 2013 at 10:13 PM, Siddharth Tiwari
<si...@live.com> wrote:
> Hi Team,
>
> What is the best way to migrate data residing on one cluster to another
> cluster ?
> Are there better methods available than distcp ?
> What if both the clusters running different RPC protocol versions ?
>
>
> *------------------------*
> Cheers !!!
> Siddharth Tiwari
> Have a refreshing day !!!
> "Every duty is holy, and devotion to duty is the highest form of worship of
> God.”
> "Maybe other people will try to limit me but I don't limit myself"
--
Harsh J
Re: Data migration from one cluster to other running diff. versions
Posted by Harsh J <ha...@cloudera.com>.
DistCp is the fastest option, letting you copy data in parallel. For
incompatible RPC versions between different HDFS clusters, the HFTP
solution can work (documented on the DistCp manual).
On Wed, Jan 30, 2013 at 10:13 PM, Siddharth Tiwari
<si...@live.com> wrote:
> Hi Team,
>
> What is the best way to migrate data residing on one cluster to another
> cluster ?
> Are there better methods available than distcp ?
> What if both the clusters running different RPC protocol versions ?
>
>
> *------------------------*
> Cheers !!!
> Siddharth Tiwari
> Have a refreshing day !!!
> "Every duty is holy, and devotion to duty is the highest form of worship of
> God.”
> "Maybe other people will try to limit me but I don't limit myself"
--
Harsh J
Re: Data migration from one cluster to other running diff. versions
Posted by Harsh J <ha...@cloudera.com>.
DistCp is the fastest option, letting you copy data in parallel. For
incompatible RPC versions between different HDFS clusters, the HFTP
solution can work (documented on the DistCp manual).
On Wed, Jan 30, 2013 at 10:13 PM, Siddharth Tiwari
<si...@live.com> wrote:
> Hi Team,
>
> What is the best way to migrate data residing on one cluster to another
> cluster ?
> Are there better methods available than distcp ?
> What if both the clusters running different RPC protocol versions ?
>
>
> *------------------------*
> Cheers !!!
> Siddharth Tiwari
> Have a refreshing day !!!
> "Every duty is holy, and devotion to duty is the highest form of worship of
> God.”
> "Maybe other people will try to limit me but I don't limit myself"
--
Harsh J
Re: Data migration from one cluster to other running diff. versions
Posted by Harsh J <ha...@cloudera.com>.
DistCp is the fastest option, letting you copy data in parallel. For
incompatible RPC versions between different HDFS clusters, the HFTP
solution can work (documented on the DistCp manual).
On Wed, Jan 30, 2013 at 10:13 PM, Siddharth Tiwari
<si...@live.com> wrote:
> Hi Team,
>
> What is the best way to migrate data residing on one cluster to another
> cluster ?
> Are there better methods available than distcp ?
> What if both the clusters running different RPC protocol versions ?
>
>
> *------------------------*
> Cheers !!!
> Siddharth Tiwari
> Have a refreshing day !!!
> "Every duty is holy, and devotion to duty is the highest form of worship of
> God.”
> "Maybe other people will try to limit me but I don't limit myself"
--
Harsh J