You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Parul Kudtarkar <Pa...@hms.harvard.edu> on 2009/04/21 06:40:43 UTC

Copying files from HDFS to remote database

Our application is using hadoop to parallelize jobs across ec2 cluster. HDFS
is used to store output files. How would you ideally copy output files from
HDFS to remote databases? 

Thanks,
Parul V. Kudtarkar
-- 
View this message in context: http://www.nabble.com/Copying-files-from-HDFS-to-remote-database-tp23149085p23149085.html
Sent from the Hadoop lucene-users mailing list archive at Nabble.com.

Re: Copying files from HDFS to remote database

Posted by Parul Kudtarkar <Pa...@hms.harvard.edu>.

Thanks Mr. Borthakur.

Parul V. Kudtarkar

Dhruba Borthakur-2 wrote:
> 
> You can use any of these:
> 
> 1. bin/hadoop dfs -get hdfsfile <remote filename>
> 2. Thrift API : http://wiki.apache.org/hadoop/HDFS-APIs
> 3. use fuse-mount ot mount hdfs as a regular file system on remote
> machine:
>     http://wiki.apache.org/hadoop/MountableHDFS
> 
> thanks,
> dhruba
> 
> 
> 
> On Mon, Apr 20, 2009 at 9:40 PM, Parul Kudtarkar <
> Parul_Kudtarkar@hms.harvard.edu> wrote:
> 
>>
>> Our application is using hadoop to parallelize jobs across ec2 cluster.
>> HDFS
>> is used to store output files. How would you ideally copy output files
>> from
>> HDFS to remote databases?
>>
>> Thanks,
>> Parul V. Kudtarkar
>> --
>> View this message in context:
>> http://www.nabble.com/Copying-files-from-HDFS-to-remote-database-tp23149085p23149085.html
>> Sent from the Hadoop lucene-users mailing list archive at Nabble.com.
>>
>>
> 
> 

-- 
View this message in context: http://www.nabble.com/Re%3A-Copying-files-from-HDFS-to-remote-database-tp23163462p23223847.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.

Re: Copying files from HDFS to remote database

Posted by Dhruba Borthakur <dh...@gmail.com>.

You can use any of these:

1. bin/hadoop dfs -get hdfsfile <remote filename>
2. Thrift API : http://wiki.apache.org/hadoop/HDFS-APIs
3. use fuse-mount ot mount hdfs as a regular file system on remote machine:
    http://wiki.apache.org/hadoop/MountableHDFS

thanks,
dhruba



On Mon, Apr 20, 2009 at 9:40 PM, Parul Kudtarkar <
Parul_Kudtarkar@hms.harvard.edu> wrote:

>
> Our application is using hadoop to parallelize jobs across ec2 cluster.
> HDFS
> is used to store output files. How would you ideally copy output files from
> HDFS to remote databases?
>
> Thanks,
> Parul V. Kudtarkar
> --
> View this message in context:
> http://www.nabble.com/Copying-files-from-HDFS-to-remote-database-tp23149085p23149085.html
> Sent from the Hadoop lucene-users mailing list archive at Nabble.com.
>
>