You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by anshu shukla <an...@gmail.com> on 2015/10/18 14:13:07 UTC

REST api to avoid spark context creation

I have a web based appllication for  analytics over the data stored in
Hbase .Every time User can query about any fix time duration data.But the
response time to that query is about ~ 40 sec.On every request most of time
is wasted in Context creation and Job submission .

1-How can i avoid context creation for every Job.
2-Can i have something like pool to serve requests .

-- 
Thanks & Regards,
Anshu Shukla

Re: REST api to avoid spark context creation

Posted by Raghavendra Pandey <ra...@gmail.com>.

You may like to look at spark job server.
https://github.com/spark-jobserver/spark-jobserver

Raghavendra