Multi-threaded Maven, skipped projects, "successful" build

[Dan Fabulich <da...@fabulich.com>]

Has anybody ever seen this before? I'm running Maven 3.04 with "--threads 16" on an AWS High-Memory Quadruple Extra Large Instance, and I'm getting weird build behavior: the build claims to have succeeded, but not all of the projects were finished building.

This reactor summary below (censored for privacy) reports that the "build succeeded" but a dozen projects were marked "SKIPPED." The process ultimately returns with exit code 0, as if everything were fine, but you can see one last running unit test on the console *after* the reactor summary, before the whole process exits.

What's going on here? Is there a good way to diagnose this problem? We can workaround it by not using multi-threaded builds, but that will seriously hurt our build performance.

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Full xxxxxx Build (Trunk) ......................... SUCCESS [2.151s]
[INFO] xxxxxxxxxxSearch .................................. SUCCESS [5.971s]
[INFO] xxxxxxxx Group .................................... SUCCESS [0.708s]
[INFO] xxxxxxx ........................................... SUCCESS [6.142s]
[INFO] xxxxxx.hibernateConfig ............................ SUCCESS [5.050s]
[INFO] xxxxxx Public Test Data ........................... SUCCESS [2.717s]
[INFO] xxxxxx Business Logic Build ....................... SUCCESS [0.395s]
[INFO] xxxxxx Util Library (xxxxxx.util) ................. SUCCESS [20.003s]
[INFO] xxxxxx.core.domain ................................ SUCCESS [24.734s]
[INFO] xxxxxx Production Data ............................ SUCCESS [5.105s]
[INFO] Assorted Build Tools .............................. SUCCESS [7.377s]
[INFO] xxxxxx Data Layer Test Utilities .................. SUCCESS [2:09.089s]
[INFO] xxxxxx.core.dataAccess ............................ SUCCESS [7:45.951s]
[INFO] xxxxxx Core Build ................................. SUCCESS [0.730s]
[INFO] xxxxxx.core.domain ................................ SUCCESS [2.868s]
[INFO] xxxxxx Data Access ................................ SUCCESS [9.795s]
[INFO] xxxxxxxx .......................................... SUCCESS [17.346s]
[INFO] emailService ...................................... SUCCESS [6.925s]
[INFO] xxxxxx Test Util (xxxxxx.testUtil) ................ SUCCESS [1.848s]
[INFO] xxxxxx Common Tests ............................... SUCCESS [1.796s]
[INFO] xxxxxx Business Logic ............................. SUCCESS [2:54.245s]
[INFO] xxxxxx.crm.sforce.client .......................... SUCCESS [19.909s]
[INFO] xxxxxx.crm.client ................................. SUCCESS [15.082s]
[INFO] xxxxxxxxCore ...................................... SUCCESS [5.912s]
[INFO] xxxxxx.crm.service.adapter ........................ SUCCESS [8.355s]
[INFO] xxxxxx.core.mvc ................................... SUCCESS [36.263s]
[INFO] xxxxxxxxxxxxxPlatform ............................. SUCCESS [9.672s]
[INFO] xxxxxx.xxxxxxxxConfig ............................. SUCCESS [4.311s]
[INFO] xxxxxx.crm.job.proxy .............................. SUCCESS [4.591s]
[INFO] xxxxxxx ........................................... SUCCESS [27.871s]
[INFO] xxxxx ............................................. SUCCESS [19.499s]
[INFO] Active xxxxxxxx Aggregator ........................ SUCCESS [5.404s]
[INFO] xxxxxxxxxxxxxxxx .................................. SUCCESS [14.795s]
[INFO] xxxxxxxx.alerts ................................... SUCCESS [19.158s]
[INFO] dataServices ...................................... SUCCESS [0.713s]
[INFO] xxxxxClient ....................................... SUCCESS [7.120s]
[INFO] xxxxxService ...................................... SUCCESS [9.809s]
[INFO] dataService Webservice ............................ SUCCESS [12.964s]
[INFO] Imports ........................................... SUCCESS [0.714s]
[INFO] importerUtils ..................................... SUCCESS [26.396s]
[INFO] xxxxxxxx xxxxxx Graph and ID importer ............. SUCCESS [6.891s]
[INFO] xxxxSynchronizer .................................. SUCCESS [8.604s]
[INFO] buildingImporter .................................. SUCCESS [3.855s]
[INFO] cycleImporter ..................................... SUCCESS [19.862s]
[INFO] xxxxxxxImporter ................................... SUCCESS [39.024s]
[INFO] xxxxx ............................................. SUCCESS [6.838s]
[INFO] propertyImporter .................................. SUCCESS [14.468s]
[INFO] xxxxxxImporter .................................... SUCCESS [17.224s]
[INFO] xxxxxxImporter .................................... SUCCESS [1:14.325s]
[INFO] importerTools ..................................... SUCCESS [18.044s]
[INFO] xxxxxx.alerts ..................................... SKIPPED
[INFO] xxxxxxAggregator .................................. SUCCESS [8.655s]
[INFO] com.xxxxxx.xxxxxxxxx .............................. SUCCESS [7.402s]
[INFO] xxxxxx Datamover Core ............................. SUCCESS [32.291s]
[INFO] xxxxxx xxxxxxxxxx Monitor / Synchronizer .......... SUCCESS [4.699s]
[INFO] xxxxxx.precalculation ............................. SUCCESS [9.707s]
[INFO] jobAssembler ...................................... SKIPPED
[INFO] jobServer ......................................... SUCCESS [2.450s]
[INFO] nagios ............................................ SUCCESS [10.988s]
[INFO] xxxxxx.apacheConfig ............................... SUCCESS [3.526s]
[INFO] BigData ........................................... SUCCESS [0.697s]
[INFO] BigData Platform for AWS .......................... SUCCESS [1.761s]
[INFO] BigData Tools ..................................... SUCCESS [2.529s]
[INFO] BigData Service ................................... SUCCESS [11.605s]
[INFO] xxxxxx.buildTools.svnMavenPlugin .................. SUCCESS [8.321s]
[INFO] xxxxxx.crm.service ................................ SUCCESS [7.408s]
[INFO] xxxxxx QA Project ................................. SUCCESS [0.686s]
[INFO] xxxxxx QA Domain Classes .......................... SUCCESS [1.612s]
[INFO] xxxxxx QA Data Access ............................. SUCCESS [3.301s]
[INFO] xxxxxx QA Automation Core Classes ................. SUCCESS [3.463s]
[INFO] xxxxxx QA Automated Tests ......................... SUCCESS [8.184s]
[INFO] xxxxxxxx Static ................................... SKIPPED
[INFO] xxxxxxxx Webapp Core .............................. SKIPPED
[INFO] xxxxxxxx Webapp ................................... SKIPPED
[INFO] Deploy xxxxxx to a test server .................... SKIPPED
[INFO] xxxxxx QA Tools ................................... SKIPPED
[INFO] xxxxxx QA Webapp .................................. SKIPPED
[INFO] xxxxxx.qa.contactScoreApp ......................... SUCCESS [1.364s]
[INFO] xxxxxx QA URL Sanity .............................. SUCCESS [13.251s]
[INFO] xxxxxx.xxxxxxxxUITest Maven Webapp ................ SKIPPED
[INFO] com.xxxxxx.xxxxxxxxxx ............................. SUCCESS [30.934s]
[INFO] xxxxxx.tests.smallUnit ............................ SKIPPED
[INFO] xxxxxx Tools ...................................... SUCCESS [0.197s]
[INFO] xxxxxx.tools.xxxxxRecTools ........................ SUCCESS [4.119s]
[INFO] xxxxxx.tools.xxxxxxxCategorizerTools .............. SUCCESS [3.855s]
[INFO] mailTester ........................................ SUCCESS [6.851s]
[INFO] xxxxxx.tools.samplexxxxxxxAlert ................... SKIPPED
[INFO] xxxxxxNameAndDisplay .............................. SUCCESS [6.925s]
[INFO] xxxxxx.tools.xxxxxxShapesImport ................... SUCCESS [0.948s]
[INFO] scripts ........................................... SUCCESS [1.603s]
[INFO] xxxxxx xxxxxxxx Webapp ............................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17:41.214s (Wall Clock)
[INFO] Finished at: Sat Feb 02 20:31:49 PST 2013
Running xxxxxx.web.myxxxxxx.xxxxxxxx.feed.CustomerDealFeedAPIControllerTest
[INFO] Final Memory: 1287M/2963M
[INFO] ------------------------------------------------------------------------
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.725 sec
Running xxxxxx.web.myxxxxxx.xxxxxxxx.xxxxxxxxControllerTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.837 sec