You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by eluharani zineellabidine <el...@gmail.com> on 2010/07/28 16:01:01 UTC
REST web service on top of Hadoop
Hi All,
I am still a newbie to Hadoop so please understand my confusions. I went
through many tutorials and through Hadoop's API and yet couldn't figure out
how to make REST webserbvice that would initialize a Map/Reduce Job and read
the result. Can anybody help with this issue? Is(are) there any specific
class(es) to use, or do I have to make some specific integration?
I really appreciate your time and help.
--
ZineEllabidine Eluharani
Re: REST web service on top of Hadoop
Posted by Alejandro Abdelnur <tu...@gmail.com>.
In Oozie are working on MR/Pig jobs submission over HTTP.
On Thu, Jul 29, 2010 at 5:09 PM, Steve Loughran <st...@apache.org> wrote:
> S. Venkatesh wrote:
>>
>> HDFS Proxy in contrib provides HTTP interface over HDFS. Its not very
>> RESTful but we are working on a new version which will have a REST
>> API.
>>
>> AFAIK, Oozie will provide REST API for launching MR jobs.
>>
>
>
> I've done a webapp to do this (and some trickier things like creating the
> cluster when needed), some slides on it
> http://www.slideshare.net/steve_l/long-haul-hadoop
>
> there are links on there to the various JIRA issues which have discussed the
> topic
>
Re: REST web service on top of Hadoop
Posted by Steve Loughran <st...@apache.org>.
S. Venkatesh wrote:
> HDFS Proxy in contrib provides HTTP interface over HDFS. Its not very
> RESTful but we are working on a new version which will have a REST
> API.
>
> AFAIK, Oozie will provide REST API for launching MR jobs.
>
I've done a webapp to do this (and some trickier things like creating
the cluster when needed), some slides on it
http://www.slideshare.net/steve_l/long-haul-hadoop
there are links on there to the various JIRA issues which have discussed
the topic
Re: REST web service on top of Hadoop
Posted by "S. Venkatesh" <ve...@innerzeal.com>.
HDFS Proxy in contrib provides HTTP interface over HDFS. Its not very
RESTful but we are working on a new version which will have a REST
API.
AFAIK, Oozie will provide REST API for launching MR jobs.
Venkatesh
On Wed, Jul 28, 2010 at 7:31 PM, eluharani zineellabidine
<el...@gmail.com> wrote:
> Hi All,
>
> I am still a newbie to Hadoop so please understand my confusions. I went
> through many tutorials and through Hadoop's API and yet couldn't figure out
> how to make REST webserbvice that would initialize a Map/Reduce Job and read
> the result. Can anybody help with this issue? Is(are) there any specific
> class(es) to use, or do I have to make some specific integration?
>
> I really appreciate your time and help.
>
> --
> ZineEllabidine Eluharani
>
--
Regards,
Venkatesh
“Perfection (in design) is achieved not when there is nothing more to
add, but rather when there is nothing more to take away.”
- Antoine de Saint-Exupéry
Re: REST web service on top of Hadoop
Posted by "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov>.
Hi Alex,
I had one of my students in my Search Engines class at USC prepare this very project. I will work on cleaning it up and trying to get it patch-ready...
Cheers,
Chris
On 7/28/10 1:03 PM, "Alex Kozlov" <al...@cloudera.com> wrote:
Since noone answered: AFAIK there is no REST interface to Hadoop/HDFS.
Would be an interesting contrib project. -- Alex K
On Wed, Jul 28, 2010 at 7:01 AM, eluharani zineellabidine <
eluharani@gmail.com> wrote:
> Hi All,
>
> I am still a newbie to Hadoop so please understand my confusions. I went
> through many tutorials and through Hadoop's API and yet couldn't figure out
> how to make REST webserbvice that would initialize a Map/Reduce Job and
> read
> the result. Can anybody help with this issue? Is(are) there any specific
> class(es) to use, or do I have to make some specific integration?
>
> I really appreciate your time and help.
>
> --
> ZineEllabidine Eluharani
>
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: Chris.Mattmann@jpl.nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Re: REST web service on top of Hadoop
Posted by Alex Kozlov <al...@cloudera.com>.
Since noone answered: AFAIK there is no REST interface to Hadoop/HDFS.
Would be an interesting contrib project. -- Alex K
On Wed, Jul 28, 2010 at 7:01 AM, eluharani zineellabidine <
eluharani@gmail.com> wrote:
> Hi All,
>
> I am still a newbie to Hadoop so please understand my confusions. I went
> through many tutorials and through Hadoop's API and yet couldn't figure out
> how to make REST webserbvice that would initialize a Map/Reduce Job and
> read
> the result. Can anybody help with this issue? Is(are) there any specific
> class(es) to use, or do I have to make some specific integration?
>
> I really appreciate your time and help.
>
> --
> ZineEllabidine Eluharani
>