You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Sasi <sa...@gmail.com> on 2014/12/24 12:21:48 UTC
Need help for Spark-JobServer setup on Maven (for Java programming)
Dear All,
We are trying to share RDDs across different sessions of same Web
application (Java). We need to share single RDD between those sessions. As
we understand from some posts, it is possible through Spark-JobServer.
Is there any guidelines you can provide to setup Spark-JobServer for Maven
(for Apache Spark - Java programming).
We will be glad for your suggestion.
Sasi
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Need-help-for-Spark-JobServer-setup-on-Maven-for-Java-programming-tp20849.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Need help for Spark-JobServer setup on Maven (for Java
programming)
Posted by Sasi <sa...@gmail.com>.
Thanks Abhishek. We are good know with an answer to try.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Need-help-for-Spark-JobServer-setup-on-Maven-for-Java-programming-tp20849p20906.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Need help for Spark-JobServer setup on Maven (for Java
programming)
Posted by abhishek <re...@gmail.com>.
Frankly saying I never tried for this volume in practical. But I believe it
should work.
On 30 Dec 2014 15:26, "Sasi [via Apache Spark User List]" <
ml-node+s1001560n20902h36@n3.nabble.com> wrote:
> Thanks Abhishek. We understand your point and will try using REST URL.
> However one concern, we had around 1 lakh rows in our Cassandra table
> presently. Will REST URL result can withstand the response size?
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://apache-spark-user-list.1001560.n3.nabble.com/Need-help-for-Spark-JobServer-setup-on-Maven-for-Java-programming-tp20849p20902.html
> To start a new topic under Apache Spark User List, email
> ml-node+s1001560n1h5@n3.nabble.com
> To unsubscribe from Apache Spark User List, click here
> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1&code=cmVhY2hhYmhpc2hlay5rQGdtYWlsLmNvbXwxfC0zNjM4MzA5Nzg=>
> .
> NAML
> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Need-help-for-Spark-JobServer-setup-on-Maven-for-Java-programming-tp20849p20904.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
Re: Need help for Spark-JobServer setup on Maven (for Java
programming)
Posted by Sasi <sa...@gmail.com>.
Thanks Abhishek. We understand your point and will try using REST URL.
However one concern, we had around 1 lakh rows in our Cassandra table
presently. Will REST URL result can withstand the response size?
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Need-help-for-Spark-JobServer-setup-on-Maven-for-Java-programming-tp20849p20902.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Need help for Spark-JobServer setup on Maven (for Java
programming)
Posted by abhishek <re...@gmail.com>.
Ohh...
Just curious, we did similar use case like yours getting data out of
Cassandra since job server is a rest architecture all we need is an URL to
access it. Why integrating with your framework matters here when all we
need is a URL.
On 30 Dec 2014 14:05, "Sasi [via Apache Spark User List]" <
ml-node+s1001560n20898h12@n3.nabble.com> wrote:
>
> The reason being, we had Vaadin (Java Framework) application which
displays data from Spark RDD, which in turn gets data from Cassandra. As we
know, we need to use Maven for building Spark API in Java.
>
> We tested the spark-jobserver using SBT and able to run it. However, for
our requirement, we need to integrate with Vaadin (Java Framework).
>
> ________________________________
> If you reply to this email, your message will be added to the discussion
below:
>
http://apache-spark-user-list.1001560.n3.nabble.com/Need-help-for-Spark-JobServer-setup-on-Maven-for-Java-programming-tp20849p20898.html
> To start a new topic under Apache Spark User List, email
ml-node+s1001560n1h5@n3.nabble.com
> To unsubscribe from Apache Spark User List, click here.
> NAML
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Need-help-for-Spark-JobServer-setup-on-Maven-for-Java-programming-tp20849p20900.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
Re: Need help for Spark-JobServer setup on Maven (for Java
programming)
Posted by Sasi <sa...@gmail.com>.
The reason being, we had Vaadin (Java Framework) application which displays
data from Spark RDD, which in turn gets data from Cassandra. As we know, we
need to use Maven for building Spark API in Java.
We tested the spark-jobserver using SBT and able to run it. However, for our
requirement, we need to integrate with Vaadin (Java Framework).
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Need-help-for-Spark-JobServer-setup-on-Maven-for-Java-programming-tp20849p20898.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Need help for Spark-JobServer setup on Maven (for Java
programming)
Posted by abhishek <re...@gmail.com>.
Hey,
why specific in maven??
we setup a spark job server thru sbt which is easy way to up and running
job server.
On 30 Dec 2014 13:32, "Sasi [via Apache Spark User List]" <
ml-node+s1001560n20896h50@n3.nabble.com> wrote:
>
> Does my question make sense or required some elaboration?
>
> Sasi
>
> ________________________________
> If you reply to this email, your message will be added to the discussion
below:
>
http://apache-spark-user-list.1001560.n3.nabble.com/Need-help-for-Spark-JobServer-setup-on-Maven-for-Java-programming-tp20849p20896.html
> To start a new topic under Apache Spark User List, email
ml-node+s1001560n1h5@n3.nabble.com
> To unsubscribe from Apache Spark User List, click here.
> NAMLNAMLNAMLNAMLNAML
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Need-help-for-Spark-JobServer-setup-on-Maven-for-Java-programming-tp20849p20897.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
Re: Need help for Spark-JobServer setup on Maven (for Java
programming)
Posted by Sasi <sa...@gmail.com>.
Does my question make sense or required some elaboration?
Sasi
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Need-help-for-Spark-JobServer-setup-on-Maven-for-Java-programming-tp20849p20896.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org