You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by sequoiadb <ma...@sequoiadb.com> on 2015/03/14 01:57:58 UTC

building all modules in spark by mvn

guys, is there any easier way to build all modules by mvn ?
right now if I run “mvn package” in spark root directory I got:
[INFO] Reactor Summary:
[INFO] 
[INFO] Spark Project Parent POM ........................... SUCCESS [  8.327 s]
[INFO] Spark Project Networking ........................... SKIPPED
[INFO] Spark Project Shuffle Streaming Service ............ SKIPPED
[INFO] Spark Project Core ................................. SKIPPED
[INFO] Spark Project Bagel ................................ SKIPPED
[INFO] Spark Project GraphX ............................... SKIPPED
[INFO] Spark Project Streaming ............................ SKIPPED
[INFO] Spark Project Catalyst ............................. SKIPPED
[INFO] Spark Project SQL .................................. SKIPPED
[INFO] Spark Project ML Library ........................... SKIPPED
…

Apprently only Parent project is built and all other children projects are skipped.
I can get sparksql/stream projects built by sbt/sbt, but if I’d like to use mvn and do not want to build each dependent module separately, is there any good way to do it?

Thanks

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Re: building all modules in spark by mvn

Posted by Sean Owen <so...@cloudera.com>.
I can't reproduce that. 'mvn package' builds everything. You're not
showing additional output from Maven that would explain what it
skipped and why.

On Sat, Mar 14, 2015 at 12:57 AM, sequoiadb
<ma...@sequoiadb.com> wrote:
> guys, is there any easier way to build all modules by mvn ?
> right now if I run “mvn package” in spark root directory I got:
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Spark Project Parent POM ........................... SUCCESS [  8.327 s]
> [INFO] Spark Project Networking ........................... SKIPPED
> [INFO] Spark Project Shuffle Streaming Service ............ SKIPPED
> [INFO] Spark Project Core ................................. SKIPPED
> [INFO] Spark Project Bagel ................................ SKIPPED
> [INFO] Spark Project GraphX ............................... SKIPPED
> [INFO] Spark Project Streaming ............................ SKIPPED
> [INFO] Spark Project Catalyst ............................. SKIPPED
> [INFO] Spark Project SQL .................................. SKIPPED
> [INFO] Spark Project ML Library ........................... SKIPPED
> …
>
> Apprently only Parent project is built and all other children projects are skipped.
> I can get sparksql/stream projects built by sbt/sbt, but if I’d like to use mvn and do not want to build each dependent module separately, is there any good way to do it?
>
> Thanks
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Re: building all modules in spark by mvn

Posted by Ted Yu <yu...@gmail.com>.
Please try the following command:

mvn -DskipTests -Phadoop-2.4 -Pyarn -Phive clean package


Cheers


On Fri, Mar 13, 2015 at 5:57 PM, sequoiadb <ma...@sequoiadb.com>
wrote:

> guys, is there any easier way to build all modules by mvn ?
> right now if I run “mvn package” in spark root directory I got:
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Spark Project Parent POM ........................... SUCCESS [
> 8.327 s]
> [INFO] Spark Project Networking ........................... SKIPPED
> [INFO] Spark Project Shuffle Streaming Service ............ SKIPPED
> [INFO] Spark Project Core ................................. SKIPPED
> [INFO] Spark Project Bagel ................................ SKIPPED
> [INFO] Spark Project GraphX ............................... SKIPPED
> [INFO] Spark Project Streaming ............................ SKIPPED
> [INFO] Spark Project Catalyst ............................. SKIPPED
> [INFO] Spark Project SQL .................................. SKIPPED
> [INFO] Spark Project ML Library ........................... SKIPPED
> …
>
> Apprently only Parent project is built and all other children projects are
> skipped.
> I can get sparksql/stream projects built by sbt/sbt, but if I’d like to
> use mvn and do not want to build each dependent module separately, is there
> any good way to do it?
>
> Thanks
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>