Copying data between Hadoop

[arindam choudhury <ar...@gmail.com>]

HI,

I want to copy some files from one HDFS to another. is it possible to do it
split by split like split a1 from node a go to node b?

-Arindam

Re: Copying data between Hadoop

[Linden Hillenbrand <li...@cloudera.com>]

I agree, distcp is the way to go here, you can specify down to the
individual directory on HDFS. Also, you can add some flags to overwrite/not
overwrite. It's pretty flexible IMO.

On Thu, Nov 24, 2011 at 6:15 AM, Uma Maheswara Rao G
<ma...@huawei.com>wrote:

> Why con't you use distcp command here?
>
> Regards,
> Uma
> ________________________________________
> From: arindam choudhury [arindam732111@gmail.com]
> Sent: Thursday, November 24, 2011 4:38 PM
> To: common-dev@hadoop.apache.org
> Subject: Copying data between Hadoop
>
> HI,
>
> I want to copy some files from one HDFS to another. is it possible to do it
> split by split like split a1 from node a go to node b?
>
> -Arindam
>



-- 
Linden Hillenbrand
Customer Operations Engineer

Phone:  650.644.3900 x4946
Email:   linden@cloudera.com
Twitter: @lhillenbrand
Data:    http://www.cloudera.com

RE: Copying data between Hadoop

[Uma Maheswara Rao G <ma...@huawei.com>]

Why con't you use distcp command here?

Regards,
Uma
________________________________________
From: arindam choudhury [arindam732111@gmail.com]
Sent: Thursday, November 24, 2011 4:38 PM
To: common-dev@hadoop.apache.org
Subject: Copying data between Hadoop

HI,

I want to copy some files from one HDFS to another. is it possible to do it
split by split like split a1 from node a go to node b?

-Arindam