You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-user@hadoop.apache.org by Shayan Pooya <sh...@liveve.org> on 2014/03/12 20:30:36 UTC

Creating a new file in HDFS from a URL

Hello,

I'd like to create a new file in HDFS from a remote URL.  Is there any way
to do that with webhdfs?
So instead of using the following command
curl -i -X PUT -T FILE 'data_node_url'

I like to use a url instead of the FILE.  The input will be in another
distributed filesystem (Disco's DFS) so the client should not be required
to download the file and then re-upload it to HDFS.
The files in DDFS can be accessed with an HTTP API.

(I am using the latest version of hdfs).

Regards.