What's the best way to have Spark a service?

[David Espinosa <es...@gmail.com>]

Hi all,

I'm quite new to Spark, and I would like to ask whats the best way to have
Spark as a service, and for that I mean being able to include the response
of a scala app/job running in a Spark into a RESTful common request.

Up now I have read about Apache Livy (which I tried and found
incompatibility problems with my scala app), Spark Jobsserver, Finch and I
read that I could use also Spark Streams.

Thanks in advance,
David

Re: What's the best way to have Spark a service?

[Jean Georges Perrin <jg...@jgp.net>]

Hi David,

I ended building up my own. Livy sounded great on paper, but heavy to manipulate. I found out about Jobserver too late. We did not find too complicated to build ours, with a small Spring boot app that was holding the session (we did not need more than one session).

jg


> On Mar 15, 2018, at 07:06, David Espinosa <es...@gmail.com> wrote:
> 
> Hi all,
> 
> I'm quite new to Spark, and I would like to ask whats the best way to have Spark as a service, and for that I mean being able to include the response of a scala app/job running in a Spark into a RESTful common request.
> 
> Up now I have read about Apache Livy (which I tried and found incompatibility problems with my scala app), Spark Jobsserver, Finch and I read that I could use also Spark Streams.
> 
> Thanks in advance,
> David


---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org

Re: What's the best way to have Spark a service?

[Liana Napalkova <li...@eurecat.org>]

Hi David,

Which type of incompatibility problems do you have with Apache Livy?

BR,

Liana


________________________________
From: David Espinosa <es...@gmail.com>
Sent: 15 March 2018 12:06:20
To: user@spark.apache.org
Subject: What's the best way to have Spark a service?

Hi all,

I'm quite new to Spark, and I would like to ask whats the best way to have Spark as a service, and for that I mean being able to include the response of a scala app/job running in a Spark into a RESTful common request.

Up now I have read about Apache Livy (which I tried and found incompatibility problems with my scala app), Spark Jobsserver, Finch and I read that I could use also Spark Streams.

Thanks in advance,
David
________________________________
DISCLAIMER: Aquest missatge pot contenir informaci? confidencial. Si vost? no n'?s el destinatari, si us plau, esborri'l i faci'ns-ho saber immediatament a la seg?ent adre?a: legal@eurecat.org Si el destinatari d'aquest missatge no consent la utilitzaci? del correu electr?nic via Internet i la gravaci? de missatges, li preguem que ens ho comuniqui immediatament.

DISCLAIMER: Este mensaje puede contener informaci?n confidencial. Si usted no es el destinatario del mensaje, por favor b?rrelo y notif?quenoslo inmediatamente a la siguiente direcci?n: legal@eurecat.org Si el destinatario de este mensaje no consintiera la utilizaci?n del correo electr?nico v?a Internet y la grabaci?n de los mensajes, rogamos lo ponga en nuestro conocimiento de forma inmediata.

DISCLAIMER: Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message you should destroy this message, and notify us immediately to the following address: legal@eurecat.org. If the addressee of this message does not consent to the use of Internet e-mail and message recording, please notify us immediately.
________________________________