You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Oleg Ruchovets <or...@gmail.com> on 2010/06/30 10:59:08 UTC
copy files to HDFS protocols
Hi ,
I use HDFS Shell to copy files from local FileSystem to Hadoop HDFS.
(copyFromLocal command).
1) How can I provide Path to file which locates on local FS but on different
machine then hadoop locates?
2) What other protocols (way) can I use to write files to HDFS? Is it
possible to use streaming data to write to HDFS ?
Thank in Advance
Oleg.
Re: copy files to HDFS protocols
Posted by Ken Goodhope <ke...@gmail.com>.
Also, hadoop fs -put can read from stdin by specifying '-' as your input
file.
On Wed, Jun 30, 2010 at 2:19 AM, Jeff Zhang <zj...@gmail.com> wrote:
> 1. You can use mount the files on another machine to your local machine,
> and
> invoke the copyFromLocal
> 2. Sure, you can write stream to HDFS, but I'm afraid you have to use Java
> API of hadoop, refer FileSystem.java in hadoop
>
>
>
> On Wed, Jun 30, 2010 at 4:59 PM, Oleg Ruchovets <oruchovets@gmail.com
> >wrote:
>
> > Hi ,
> >
> > I use HDFS Shell to copy files from local FileSystem to Hadoop HDFS.
> > (copyFromLocal command).
> >
> > 1) How can I provide Path to file which locates on local FS but on
> > different
> > machine then hadoop locates?
> > 2) What other protocols (way) can I use to write files to HDFS? Is it
> > possible to use streaming data to write to HDFS ?
> >
> > Thank in Advance
> > Oleg.
> >
>
>
>
> --
> Best Regards
>
> Jeff Zhang
>
Re: copy files to HDFS protocols
Posted by Jeff Zhang <zj...@gmail.com>.
1. You can use mount the files on another machine to your local machine, and
invoke the copyFromLocal
2. Sure, you can write stream to HDFS, but I'm afraid you have to use Java
API of hadoop, refer FileSystem.java in hadoop
On Wed, Jun 30, 2010 at 4:59 PM, Oleg Ruchovets <or...@gmail.com>wrote:
> Hi ,
>
> I use HDFS Shell to copy files from local FileSystem to Hadoop HDFS.
> (copyFromLocal command).
>
> 1) How can I provide Path to file which locates on local FS but on
> different
> machine then hadoop locates?
> 2) What other protocols (way) can I use to write files to HDFS? Is it
> possible to use streaming data to write to HDFS ?
>
> Thank in Advance
> Oleg.
>
--
Best Regards
Jeff Zhang