You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Nipun Arora <ni...@gmail.com> on 2017/05/12 20:00:18 UTC
Restful API Spark Application
Hi,
We have written a java spark application (primarily uses spark sql). We
want to expand this to provide our application "as a service". For this, we
are trying to write a REST API. While a simple REST API can be easily made,
and I can get Spark to run through the launcher. I wonder, how the spark
context can be used by service requests, to process data.
Are there any simple JAVA examples to illustrate this use-case? I am sure
people have faced this before.
Thanks
Nipun
Re: Restful API Spark Application
Posted by Debasish Das <de...@gmail.com>.
You can run l
On May 15, 2017 3:29 PM, "Nipun Arora" <ni...@gmail.com> wrote:
> Thanks all for your response. I will have a look at them.
>
> Nipun
>
> On Sat, May 13, 2017 at 2:38 AM vincent gromakowski <
> vincent.gromakowski@gmail.com> wrote:
>
>> It's in scala but it should be portable in java
>> https://github.com/vgkowski/akka-spark-experiments
>>
>>
>> Le 12 mai 2017 10:54 PM, "Василец Дмитрий" <pr...@gmail.com> a
>> écrit :
>>
>> and livy https://hortonworks.com/blog/livy-a-rest-interface-for-
>> apache-spark/
>>
>> On Fri, May 12, 2017 at 10:51 PM, Sam Elamin <hu...@gmail.com>
>> wrote:
>> > Hi Nipun
>> >
>> > Have you checked out the job servwr
>> >
>> > https://github.com/spark-jobserver/spark-jobserver
>> >
>> > Regards
>> > Sam
>> > On Fri, 12 May 2017 at 21:00, Nipun Arora <ni...@gmail.com>
>> wrote:
>> >>
>> >> Hi,
>> >>
>> >> We have written a java spark application (primarily uses spark sql). We
>> >> want to expand this to provide our application "as a service". For
>> this, we
>> >> are trying to write a REST API. While a simple REST API can be easily
>> made,
>> >> and I can get Spark to run through the launcher. I wonder, how the
>> spark
>> >> context can be used by service requests, to process data.
>> >>
>> >> Are there any simple JAVA examples to illustrate this use-case? I am
>> sure
>> >> people have faced this before.
>> >>
>> >>
>> >> Thanks
>> >> Nipun
>>
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>>
>>
>>
Re: Restful API Spark Application
Posted by Nipun Arora <ni...@gmail.com>.
Thanks all for your response. I will have a look at them.
Nipun
On Sat, May 13, 2017 at 2:38 AM vincent gromakowski <
vincent.gromakowski@gmail.com> wrote:
> It's in scala but it should be portable in java
> https://github.com/vgkowski/akka-spark-experiments
>
>
> Le 12 mai 2017 10:54 PM, "Василец Дмитрий" <pr...@gmail.com> a
> écrit :
>
> and livy
> https://hortonworks.com/blog/livy-a-rest-interface-for-apache-spark/
>
> On Fri, May 12, 2017 at 10:51 PM, Sam Elamin <hu...@gmail.com>
> wrote:
> > Hi Nipun
> >
> > Have you checked out the job servwr
> >
> > https://github.com/spark-jobserver/spark-jobserver
> >
> > Regards
> > Sam
> > On Fri, 12 May 2017 at 21:00, Nipun Arora <ni...@gmail.com>
> wrote:
> >>
> >> Hi,
> >>
> >> We have written a java spark application (primarily uses spark sql). We
> >> want to expand this to provide our application "as a service". For
> this, we
> >> are trying to write a REST API. While a simple REST API can be easily
> made,
> >> and I can get Spark to run through the launcher. I wonder, how the spark
> >> context can be used by service requests, to process data.
> >>
> >> Are there any simple JAVA examples to illustrate this use-case? I am
> sure
> >> people have faced this before.
> >>
> >>
> >> Thanks
> >> Nipun
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
>
>
Re: Restful API Spark Application
Posted by vincent gromakowski <vi...@gmail.com>.
It's in scala but it should be portable in java
https://github.com/vgkowski/akka-spark-experiments
Le 12 mai 2017 10:54 PM, "Василец Дмитрий" <pr...@gmail.com> a
écrit :
and livy https://hortonworks.com/blog/livy-a-rest-interface-for-
apache-spark/
On Fri, May 12, 2017 at 10:51 PM, Sam Elamin <hu...@gmail.com>
wrote:
> Hi Nipun
>
> Have you checked out the job servwr
>
> https://github.com/spark-jobserver/spark-jobserver
>
> Regards
> Sam
> On Fri, 12 May 2017 at 21:00, Nipun Arora <ni...@gmail.com>
wrote:
>>
>> Hi,
>>
>> We have written a java spark application (primarily uses spark sql). We
>> want to expand this to provide our application "as a service". For this,
we
>> are trying to write a REST API. While a simple REST API can be easily
made,
>> and I can get Spark to run through the launcher. I wonder, how the spark
>> context can be used by service requests, to process data.
>>
>> Are there any simple JAVA examples to illustrate this use-case? I am sure
>> people have faced this before.
>>
>>
>> Thanks
>> Nipun
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: Restful API Spark Application
Posted by Василец Дмитрий <pr...@gmail.com>.
and livy https://hortonworks.com/blog/livy-a-rest-interface-for-apache-spark/
On Fri, May 12, 2017 at 10:51 PM, Sam Elamin <hu...@gmail.com> wrote:
> Hi Nipun
>
> Have you checked out the job servwr
>
> https://github.com/spark-jobserver/spark-jobserver
>
> Regards
> Sam
> On Fri, 12 May 2017 at 21:00, Nipun Arora <ni...@gmail.com> wrote:
>>
>> Hi,
>>
>> We have written a java spark application (primarily uses spark sql). We
>> want to expand this to provide our application "as a service". For this, we
>> are trying to write a REST API. While a simple REST API can be easily made,
>> and I can get Spark to run through the launcher. I wonder, how the spark
>> context can be used by service requests, to process data.
>>
>> Are there any simple JAVA examples to illustrate this use-case? I am sure
>> people have faced this before.
>>
>>
>> Thanks
>> Nipun
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: Restful API Spark Application
Posted by Sam Elamin <hu...@gmail.com>.
Hi Nipun
Have you checked out the job servwr
https://github.com/spark-jobserver/spark-jobserver
Regards
Sam
On Fri, 12 May 2017 at 21:00, Nipun Arora <ni...@gmail.com> wrote:
> Hi,
>
> We have written a java spark application (primarily uses spark sql). We
> want to expand this to provide our application "as a service". For this, we
> are trying to write a REST API. While a simple REST API can be easily made,
> and I can get Spark to run through the launcher. I wonder, how the spark
> context can be used by service requests, to process data.
>
> Are there any simple JAVA examples to illustrate this use-case? I am sure
> people have faced this before.
>
>
> Thanks
> Nipun
>