You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-user@hadoop.apache.org by Shashidhar Rao <ra...@gmail.com> on 2014/06/06 16:26:59 UTC

Best way to transfer data to HDFS

Hi Hadoop Experts,

I have to transfer 5 yrs of historical billing data to the tune of 25 -30
TB to HDFS to be later analyzed by Map Reduce program. Sqoop is out of
question as these files are not residing in OLTP and so is Flume as these
are not log files generated by App Server.

What tools are available to transfer such Big data? Would it be prudent to
use Hadoop put command to transfer these files

Regards
Shashi