You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Siva Reddy <ks...@gmail.com> on 2015/07/24 07:26:01 UTC

Spark - Eclipse IDE - Maven

Hi All,

    I am trying to setup the Eclipse (LUNA)  with Maven so that I create a
maven projects for developing spark programs.  I am having some issues and I
am not sure what is the issue.


  Can Anyone share a nice step-step document to configure eclipse with maven
for spark development.


Thanks
Siva



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Eclipse-IDE-Maven-tp23977.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Re: Spark - Eclipse IDE - Maven

Posted by Dean Wampler <de...@gmail.com>.
If you don't mind using SBT with your Scala instead of Maven, you can see
the example I created here: https://github.com/deanwampler/spark-workshop

It can be loaded into Eclipse or IntelliJ

Dean Wampler, Ph.D.
Author: Programming Scala, 2nd Edition
<http://shop.oreilly.com/product/0636920033073.do> (O'Reilly)
Typesafe <http://typesafe.com>
@deanwampler <http://twitter.com/deanwampler>
http://polyglotprogramming.com

On Wed, Jul 29, 2015 at 10:52 AM, Venkat Reddy <ks...@gmail.com> wrote:

> Thanks Petar,
>
>     I will purchase. Thanks for the input.
>
>
> Thanks
> Siva
>
> On Tue, Jul 28, 2015 at 4:39 PM, Carol McDonald <cm...@maprtech.com>
> wrote:
>
>> I agree,  I found this book very useful for getting started with spark
>> and eclipse
>>
>> On Tue, Jul 28, 2015 at 11:10 AM, Petar Zecevic <pe...@gmail.com>
>> wrote:
>>
>>>
>>> Sorry about self-promotion, but there's a really nice tutorial for
>>> setting up Eclipse for Spark in "Spark in Action" book:
>>> http://www.manning.com/bonaci/
>>>
>>>
>>> On 24.7.2015. 7:26, Siva Reddy wrote:
>>>
>>>> Hi All,
>>>>
>>>>      I am trying to setup the Eclipse (LUNA)  with Maven so that I
>>>> create a
>>>> maven projects for developing spark programs.  I am having some issues
>>>> and I
>>>> am not sure what is the issue.
>>>>
>>>>
>>>>    Can Anyone share a nice step-step document to configure eclipse with
>>>> maven
>>>> for spark development.
>>>>
>>>>
>>>> Thanks
>>>> Siva
>>>>
>>>>
>>>>
>>>> --
>>>> View this message in context:
>>>> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Eclipse-IDE-Maven-tp23977.html
>>>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>>>> For additional commands, e-mail: user-help@spark.apache.org
>>>>
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>>> For additional commands, e-mail: user-help@spark.apache.org
>>>
>>>
>>
>

Re: Spark - Eclipse IDE - Maven

Posted by Venkat Reddy <ks...@gmail.com>.
Thanks Petar,

    I will purchase. Thanks for the input.


Thanks
Siva

On Tue, Jul 28, 2015 at 4:39 PM, Carol McDonald <cm...@maprtech.com>
wrote:

> I agree,  I found this book very useful for getting started with spark and
> eclipse
>
> On Tue, Jul 28, 2015 at 11:10 AM, Petar Zecevic <pe...@gmail.com>
> wrote:
>
>>
>> Sorry about self-promotion, but there's a really nice tutorial for
>> setting up Eclipse for Spark in "Spark in Action" book:
>> http://www.manning.com/bonaci/
>>
>>
>> On 24.7.2015. 7:26, Siva Reddy wrote:
>>
>>> Hi All,
>>>
>>>      I am trying to setup the Eclipse (LUNA)  with Maven so that I
>>> create a
>>> maven projects for developing spark programs.  I am having some issues
>>> and I
>>> am not sure what is the issue.
>>>
>>>
>>>    Can Anyone share a nice step-step document to configure eclipse with
>>> maven
>>> for spark development.
>>>
>>>
>>> Thanks
>>> Siva
>>>
>>>
>>>
>>> --
>>> View this message in context:
>>> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Eclipse-IDE-Maven-tp23977.html
>>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>>> For additional commands, e-mail: user-help@spark.apache.org
>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>>
>

Re: Spark - Eclipse IDE - Maven

Posted by Carol McDonald <cm...@maprtech.com>.
I agree,  I found this book very useful for getting started with spark and
eclipse

On Tue, Jul 28, 2015 at 11:10 AM, Petar Zecevic <pe...@gmail.com>
wrote:

>
> Sorry about self-promotion, but there's a really nice tutorial for setting
> up Eclipse for Spark in "Spark in Action" book:
> http://www.manning.com/bonaci/
>
>
> On 24.7.2015. 7:26, Siva Reddy wrote:
>
>> Hi All,
>>
>>      I am trying to setup the Eclipse (LUNA)  with Maven so that I create
>> a
>> maven projects for developing spark programs.  I am having some issues
>> and I
>> am not sure what is the issue.
>>
>>
>>    Can Anyone share a nice step-step document to configure eclipse with
>> maven
>> for spark development.
>>
>>
>> Thanks
>> Siva
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Eclipse-IDE-Maven-tp23977.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>

Re: Spark - Eclipse IDE - Maven

Posted by Petar Zecevic <pe...@gmail.com>.
Sorry about self-promotion, but there's a really nice tutorial for 
setting up Eclipse for Spark in "Spark in Action" book:
http://www.manning.com/bonaci/


On 24.7.2015. 7:26, Siva Reddy wrote:
> Hi All,
>
>      I am trying to setup the Eclipse (LUNA)  with Maven so that I create a
> maven projects for developing spark programs.  I am having some issues and I
> am not sure what is the issue.
>
>
>    Can Anyone share a nice step-step document to configure eclipse with maven
> for spark development.
>
>
> Thanks
> Siva
>
>
>
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Eclipse-IDE-Maven-tp23977.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>


---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Re: Spark - Eclipse IDE - Maven

Posted by Naveen Madhire <vm...@umail.iu.edu>.
You can use Intellij for Scala. There are many articles online which you
can refer for setting up Intellij and scala pluggin.

Thanks

On Friday, July 24, 2015, Siva Reddy <ks...@gmail.com> wrote:

> I want to program in scala  for spark.
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Eclipse-IDE-Maven-tp23977p23981.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org <javascript:;>
> For additional commands, e-mail: user-help@spark.apache.org <javascript:;>
>
>

Re: Spark - Eclipse IDE - Maven

Posted by Siva Reddy <ks...@gmail.com>.
I want to program in scala  for spark.  



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Eclipse-IDE-Maven-tp23977p23981.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Re: Spark - Eclipse IDE - Maven

Posted by Petar Zecevic <pe...@gmail.com>.
Sorry about self-promotion, but there's a really nice tutorial for 
setting up Eclipse for Spark in "Spark in Action" book:
http://www.manning.com/bonaci/


On 27.7.2015. 10:22, Akhil Das wrote:
> You can follow this doc 
> https://cwiki.apache.org/confluence/display/SPARK/Useful+Developer+Tools#UsefulDeveloperTools-IDESetup
>
> Thanks
> Best Regards
>
> On Fri, Jul 24, 2015 at 10:56 AM, Siva Reddy <ksivaus@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     Hi All,
>
>         I am trying to setup the Eclipse (LUNA)  with Maven so that I
>     create a
>     maven projects for developing spark programs.  I am having some
>     issues and I
>     am not sure what is the issue.
>
>
>       Can Anyone share a nice step-step document to configure eclipse
>     with maven
>     for spark development.
>
>
>     Thanks
>     Siva
>
>
>
>     --
>     View this message in context:
>     http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Eclipse-IDE-Maven-tp23977.html
>     Sent from the Apache Spark User List mailing list archive at
>     Nabble.com.
>
>     ---------------------------------------------------------------------
>     To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>     <ma...@spark.apache.org>
>     For additional commands, e-mail: user-help@spark.apache.org
>     <ma...@spark.apache.org>
>
>


Re: Spark - Eclipse IDE - Maven

Posted by Akhil Das <ak...@sigmoidanalytics.com>.
You can follow this doc
https://cwiki.apache.org/confluence/display/SPARK/Useful+Developer+Tools#UsefulDeveloperTools-IDESetup

Thanks
Best Regards

On Fri, Jul 24, 2015 at 10:56 AM, Siva Reddy <ks...@gmail.com> wrote:

> Hi All,
>
>     I am trying to setup the Eclipse (LUNA)  with Maven so that I create a
> maven projects for developing spark programs.  I am having some issues and
> I
> am not sure what is the issue.
>
>
>   Can Anyone share a nice step-step document to configure eclipse with
> maven
> for spark development.
>
>
> Thanks
> Siva
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Eclipse-IDE-Maven-tp23977.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>

Re: Spark - Eclipse IDE - Maven

Posted by Anas Sherwani <an...@gmail.com>.
Can you explain the issue? Further, in which language do you want to code?
There are number of blogs to create a simple a maven project in Eclipse, and
they are pretty simple and straightforward.



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Eclipse-IDE-Maven-tp23977p23979.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org