how to upload files by web page

[lr...@gmail.com]

 

Hi, all,

   I’m new to HDFS and want to upload files by JSP.

Are there some APIs can use?  Are there some demo?

   Thanks for your help：）

Re: how to upload files by web page

[nitesh bhatia <ni...@gmail.com>]

Hi
Even I was looking for solution of the same problem. I haven't tested
but I think we can use Globus Toolkit's GSI-FTP feature for this work.
 In the RSL config file one can write the hdfs copy command to copy
the file to hdfs. I've used this feature to upload and process file
from Globus to Sun N1 Grid Engine.
--nitesh


2009/3/10 Yang Zhou <ya...@gmail.com>:
> :-) I am afraid you have to solve both of your questions yourself.
> 1. submit the urls to your own servlet.
> 2. develop your own codes to read input bytes from those urls and save them
> to HDFS.
> There is no ready-made tool.
>
> Good Luck.
>
> 2009/3/10 李睿 <lr...@gmail.com>
>
>> Thanks:)
>>
>>
>>
>> Could you tell more detail about your solution?
>>
>> I have some questions below:
>>
>> 1,where can  I submit the urls to ?
>>
>> 2,what is the backend service? Does it belong to HDFS?
>>
>>
>>
>>
>>
>>
>> 2009/3/10 Yang Zhou <ya...@gmail.com>
>>
>> > Hi,
>> >
>> > I have done that before.
>> >
>> > My solution is :
>> > 1. submit some FTP/SFTP/GridFTP urls of what you want to upload
>> > 2. backend service will fetch those files/directories from FTP to HDFS
>> > directly.
>> >
>> > Of course you can upload those files to the web server machine and then
>> > move
>> > them to HDFS. But since Hadoop is designed to process vast amounts of
>> data,
>> > I do think my solution is more efficient. :-)
>> >
>> > You can find how to make directory and save files to HDFS in the source
>> > code
>> > of "org.apache.hadoop.fs.FsShell".
>> > 2009/3/9 <lr...@gmail.com>
>> >
>> > >
>> > >
>> > > Hi, all,
>> > >
>> > >   I'm new to HDFS and want to upload files by JSP.
>> > >
>> > > Are there some APIs can use?  Are there some demo?
>> > >
>> > >   Thanks for your help：）
>> > >
>> > >
>> >
>>
>



-- 
Nitesh Bhatia
Dhirubhai Ambani Institute of Information & Communication Technology
Gandhinagar
Gujarat

"Life is never perfect. It just depends where you draw the line."

visit:
http://www.awaaaz.com - connecting through music
http://www.volstreet.com - lets volunteer for better tomorrow
http://www.instibuzz.com - Voice opinions, Transact easily, Have fun

Re: how to upload files by web page

[Yang Zhou <ya...@gmail.com>]

:-) I am afraid you have to solve both of your questions yourself.
1. submit the urls to your own servlet.
2. develop your own codes to read input bytes from those urls and save them
to HDFS.
There is no ready-made tool.

Good Luck.

2009/3/10 李睿 <lr...@gmail.com>

> Thanks:)
>
>
>
> Could you tell more detail about your solution?
>
> I have some questions below:
>
> 1,where can  I submit the urls to ?
>
> 2,what is the backend service? Does it belong to HDFS?
>
>
>
>
>
>
> 2009/3/10 Yang Zhou <ya...@gmail.com>
>
> > Hi,
> >
> > I have done that before.
> >
> > My solution is :
> > 1. submit some FTP/SFTP/GridFTP urls of what you want to upload
> > 2. backend service will fetch those files/directories from FTP to HDFS
> > directly.
> >
> > Of course you can upload those files to the web server machine and then
> > move
> > them to HDFS. But since Hadoop is designed to process vast amounts of
> data,
> > I do think my solution is more efficient. :-)
> >
> > You can find how to make directory and save files to HDFS in the source
> > code
> > of "org.apache.hadoop.fs.FsShell".
> > 2009/3/9 <lr...@gmail.com>
> >
> > >
> > >
> > > Hi, all,
> > >
> > >   I’m new to HDFS and want to upload files by JSP.
> > >
> > > Are there some APIs can use?  Are there some demo?
> > >
> > >   Thanks for your help：）
> > >
> > >
> >
>

Re: how to upload files by web page

[李睿 <lr...@gmail.com>]

Thanks:)



Could you tell more detail about your solution?

I have some questions below:

1,where can  I submit the urls to ?

2,what is the backend service? Does it belong to HDFS?






2009/3/10 Yang Zhou <ya...@gmail.com>

> Hi,
>
> I have done that before.
>
> My solution is :
> 1. submit some FTP/SFTP/GridFTP urls of what you want to upload
> 2. backend service will fetch those files/directories from FTP to HDFS
> directly.
>
> Of course you can upload those files to the web server machine and then
> move
> them to HDFS. But since Hadoop is designed to process vast amounts of data,
> I do think my solution is more efficient. :-)
>
> You can find how to make directory and save files to HDFS in the source
> code
> of "org.apache.hadoop.fs.FsShell".
> 2009/3/9 <lr...@gmail.com>
>
> >
> >
> > Hi, all,
> >
> >   I’m new to HDFS and want to upload files by JSP.
> >
> > Are there some APIs can use?  Are there some demo?
> >
> >   Thanks for your help：）
> >
> >
>

Re: how to upload files by web page

[Yang Zhou <ya...@gmail.com>]

Hi,

I have done that before.

My solution is :
1. submit some FTP/SFTP/GridFTP urls of what you want to upload
2. backend service will fetch those files/directories from FTP to HDFS
directly.

Of course you can upload those files to the web server machine and then move
them to HDFS. But since Hadoop is designed to process vast amounts of data,
I do think my solution is more efficient. :-)

You can find how to make directory and save files to HDFS in the source code
of "org.apache.hadoop.fs.FsShell".
2009/3/9 <lr...@gmail.com>

>
>
> Hi, all,
>
>   I’m new to HDFS and want to upload files by JSP.
>
> Are there some APIs can use?  Are there some demo?
>
>   Thanks for your help：）
>
>