You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by "S. Zhou" <my...@yahoo.com> on 2013/10/28 20:14:34 UTC
copy data inter-cluster with different version of Hadoop
I need to copy data from Hadoop cluster A to cluster B. I know I can use "distCp" tool to do that. Now the problem is: cluster A has version 1.2.1 and cluster B has version 0.20.x. So "distcp" tool from either version does not work on both versions. Is there a possible way to do that? So far I copy data from cluster A to local and upload to cluster B.
Thanks
Senqiang
Re: copy data inter-cluster with different version of Hadoop
Posted by Shahab Yunus <sh...@gmail.com>.
Sorry, last email was accidentally sent before I can finish it.
Take a look at using webHDFS protocol to use distcp between clusters with
different versions:
http://books.google.com/books?id=Wu_xeGdU4G8C&pg=PA76&lpg=PA76&dq=distcp+webhdfs+different+versions&source=bl&ots=i7BOYEXaYp&sig=R8TJ6QmLG8QUhkSHxiNOhEdOlhc&hl=en&sa=X&ei=Mb5uUtnwFcL72QWQuIHwAg&ved=0CE8Q6AEwBA#v=onepage&q=distcp%20webhdfs%20different%20versions&f=false
http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
Also, please note that this is not a HBase question and should be sent to
Hadoop mailing list. Thanks.
Regards,
Shahab
On Mon, Oct 28, 2013 at 3:14 PM, S. Zhou <my...@yahoo.com> wrote:
> I need to copy data from Hadoop cluster A to cluster B. I know I can use
> "distCp" tool to do that. Now the problem is: cluster A has version 1.2.1
> and cluster B has version 0.20.x. So "distcp" tool from either version
> does not work on both versions. Is there a possible way to do that? So far
> I copy data from cluster A to local and upload to cluster B.
>
> Thanks
> Senqiang
>
Re: copy data inter-cluster with different version of Hadoop
Posted by Shahab Yunus <sh...@gmail.com>.
Take a lookat using webHDFS protocol to use distcp between clusters with
different versions:
On Mon, Oct 28, 2013 at 3:14 PM, S. Zhou <my...@yahoo.com> wrote:
> I need to copy data from Hadoop cluster A to cluster B. I know I can use
> "distCp" tool to do that. Now the problem is: cluster A has version 1.2.1
> and cluster B has version 0.20.x. So "distcp" tool from either version
> does not work on both versions. Is there a possible way to do that? So far
> I copy data from cluster A to local and upload to cluster B.
>
> Thanks
> Senqiang
>