You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@syncope.apache.org by "Alan D. Cabrera" <li...@toolazydogs.com> on 2015/03/02 22:49:24 UTC
Trying to build Syncope
Hello,
I’m trying to build Syncope and am getting a Rat error. I’m wondering if I’m doing something wrong.
[acabrera-mn:syncope 520]$ mvn -v
Apache Maven 3.2.2 (45f7c06d68e745d05611f7fd14efb6594181933e; 2014-06-17T06:51:42-07:00)
Maven home: /usr/local/Cellar/maven/3.2.2/libexec
Java version: 1.8.0_31, vendor: Oracle Corporation
Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_31.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.10.2", arch: "x86_64", family: "mac"
[INFO] --- apache-rat-plugin:0.11:check (default) @ syncope-common ---
[INFO] 51 implicit excludes (use -debug for more details).
[INFO] Exclude: nbactions.xml
[INFO] Exclude: nb-configuration.xml
[INFO] Exclude: **/META-INF/cxf/**
[INFO] Exclude: **/META-INF/services/**
[INFO] Exclude: **/META-INF/MANIFEST.MF
[INFO] Exclude: **/*.csv
[INFO] Exclude: **/archetype-resources/**
[INFO] Exclude: **/goal.txt
[INFO] Exclude: **/rat.txt
[INFO] Exclude: **/build-copy-javadoc-files.xml
[INFO] Exclude: **/maven-eclipse.xml
[INFO] Exclude: **/*.iml
[INFO] Exclude: **/*.log
[INFO] Exclude: .externalToolBuilders/**
[INFO] Exclude: .git/**
[INFO] Exclude: .idea/**
[INFO] Exclude: **/.*
[INFO] Exclude: **/deb/control/conffiles
[INFO] Exclude: **/deb/control/control
[INFO] Exclude: **/*.lst
[INFO] 403 resources included (use -debug for more details)
Warning: org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser: Property 'http://www.oracle.com/xml/jaxp/properties/entityExpansionLimit' is not recognized.
Compiler warnings:
WARNING: 'org.apache.xerces.jaxp.SAXParserImpl: Property 'http://javax.xml.XMLConstants/property/accessExternalDTD' is not recognized.'
Warning: org.apache.xerces.parsers.SAXParser: Feature 'http://javax.xml.XMLConstants/feature/secure-processing' is not recognized.
Warning: org.apache.xerces.parsers.SAXParser: Property 'http://javax.xml.XMLConstants/property/accessExternalDTD' is not recognized.
Warning: org.apache.xerces.parsers.SAXParser: Property 'http://www.oracle.com/xml/jaxp/properties/entityExpansionLimit' is not recognized.
[INFO] Rat check: Summary of files. Unapproved: 4 unknown: 4 generated: 0 approved: 156 licence.
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Syncope ..................................... SUCCESS [ 5.122 s]
[INFO] Apache Syncope Build Tools ......................... SUCCESS [ 29.342 s]
[INFO] Apache Syncope Archetype ........................... SUCCESS [ 2.805 s]
[INFO] Apache Syncope Common .............................. FAILURE [ 10.019 s]
[INFO] Apache Syncope Client .............................. SKIPPED
[INFO] Apache Syncope Core ................................ SKIPPED
[INFO] Apache Syncope Core Upgrader ....................... SKIPPED
[INFO] Apache Syncope Console ............................. SKIPPED
[INFO] Apache Syncope Standalone Distribution ............. SKIPPED
[INFO] Apache Syncope Installer ........................... SKIPPED
[INFO] Apache Syncope Deb ................................. SKIPPED
[INFO] Apache Syncope Deb Core ............................ SKIPPED
[INFO] Apache Syncope Deb Console ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 48.537 s
[INFO] Finished at: 2015-03-02T13:39:56-08:00
[INFO] Final Memory: 90M/1963M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.rat:apache-rat-plugin:0.11:check (default) on project syncope-common: Too many files with unapproved license: 4 See RAT report in: /Users/acabrera/asf/syncope/common/target/rat.txt -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :syncope-common
Re: Trying to build Syncope
Posted by "Alan D. Cabrera" <li...@toolazydogs.com>.
> On Mar 3, 2015, at 11:41 AM, Alan D. Cabrera <li...@toolazydogs.com> wrote:
>
>
>> On Mar 2, 2015, at 11:51 PM, Francesco Chicchiriccò <il...@apache.org> wrote:
>>
>> Hi Alan,
>> this seems very weird: could you please check which are the 4 files failing the RAT check under common/?
>>
>> I can't verify how the build is working under Mac OS X - neither Jenkins nor Travis are reporting troubles: it seems you're building from the 1_2_X branch or one of 1.2 tags, right?
>
> The 1_2_X branch.
>
> Unapproved licenses:
>
> /Users/acabrera/asf/syncope/common/rest-api/target/apidocs/package-list
> /Users/acabrera/asf/syncope/common/rest-api/target/apidocs/script.js
> /Users/acabrera/asf/syncope/common/rest-api/target/javadoc-bundle-options/javadoc-options-javadoc-resources.xml
> /Users/acabrera/asf/syncope/common/rest-api/target/javadoc-bundle-options/package-list
I added those to the excludes in the root pom and now run into:
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Syncope Client 1.2.3-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-enforcer-plugin:1.4:enforce (enforce-java) @ syncope-client ---
[INFO]
[INFO] --- gmaven-plugin:1.5:execute (default) @ syncope-client ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ syncope-client ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources to META-INF
[INFO] Copying 1 resource to META-INF
[INFO]
[INFO] --- maven-resources-plugin:2.6:copy-resources (copy-javadoc-legal-files) @ syncope-client ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ syncope-client ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 4 source files to /Users/acabrera/asf/syncope/client/target/classes
[WARNING] bootstrap class path not set in conjunction with -source 1.6
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ syncope-client ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /Users/acabrera/asf/syncope/client/src/test/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ syncope-client ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /Users/acabrera/asf/syncope/client/target/test-classes
[WARNING] bootstrap class path not set in conjunction with -source 1.6
[INFO]
[INFO] --- maven-surefire-plugin:2.18.1:test (default-test) @ syncope-client ---
[INFO] Surefire report directory: /Users/acabrera/asf/syncope/client/target/surefire-reports
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=256m; support was removed in 8.0
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0
Running org.apache.syncope.client.ConcurrencyTest
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 11.947 sec <<< FAILURE! - in org.apache.syncope.client.ConcurrencyTest
multiThreadTest(org.apache.syncope.client.ConcurrencyTest) Time elapsed: 0.433 sec <<< ERROR!
java.lang.OutOfMemoryError: unable to create new native thread
at java.lang.Thread.start0(Native Method)
at java.lang.Thread.start(Thread.java:714)
at org.apache.syncope.client.ConcurrencyTest.multiThreadTest(ConcurrencyTest.java:55)
Results :
Tests in error:
ConcurrencyTest.multiThreadTest:55 » OutOfMemory unable to create new native t...
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0
Re: Trying to build Syncope
Posted by Francesco Chicchiriccò <il...@apache.org>.
On 05/03/2015 05:41, Alan D. Cabrera wrote:
>> On 03/03/2015 23:03, Alan D. Cabrera wrote:
>>> So, I’m working on using Syncope to wrap all the disparate data that needs to be managed at ASF. Where should I start? I’m thinking LDAP, podlings.xml, and committers.txt. Thoughts?
>> Wow, this is worth a new thread actually!
>>
>> First of all, you shouldn't need to build Syncope from source but create your own project as explained in [4].
>>
>> Then, as in any IdM project you need to identify:
>>
>> 1. the resources you want to deal with (LDAP, podlings.xml, and committers.txt as you suggest above)
>> 1.1 does a connector exist for all identified resources?
> LDAP : yes (I’m pretty sure)
> podlings.xml: no, I have to write one
> committers.txt: no, I have to write one
It would be much easier if you could actually avoid writing new
connectors and empower - by providing your own scripts - the CMD
connector [8].
>> 1.2 are there authoritative resources?
> Yes
"Authoritative" in this context means that, after the initial load, when
the IdM system is fully operational, a change occurring on the
authoritative resource(s) needs to be propagated to all other resources,
possibly overwriting the mapped values.
Example: changing e-mail address in LDAP (via ldapmodify, for example)
will cause Syncope to overwrite the e-mail address on committers.txt.
Generally speaking, one should possibly have as less authoritative
resources as possible, because they induct a non-standard data flow:
normally data should be managed via Syncope (in the sample above, one
should change the e-mail address in Syncope - either via admin console
or REST, not via ldapmodify).
Anyway, authoritative resources are supported.
>> 2. the data flows, for each resource against Syncope:
>> 2.1 do you want to deal with users only? or you need also to take into account groups / roles?
> all of the above
>
>> 2.2 will Syncope be only reading / only writing / reading & writing from that particular resource?
> reading and writing. Think about what it takes to add a podling to the incubator:
>
> podlings.xml needs to be updated w/ podling, mentors
> committers.txt needs to be updated
> svn/git need to be provisioned
> jira needs to be provisioned
> etc.
Agree, but shouldn't this mean that you are writing to all connected
resources (after the initial load for which you have all user and role
data in Syncope)?
BTW, how is the SVN / GIT / JIRA provisioning working? Don't you need to
define additional resources?
>> 3. the attribute schema to define in Syncope and the attribute mapping for each resource (how the "givenName" LDAP attribute relate to corresponding attribute(s) on other resource(s)?)
> That, I’m going to have to do. Does Syncope require a complete mapping or can I incrementally add stuff as processes are discovered?
You can naturally proceed incrementally.
>> In particular regarding connectors:
>>
>> * for LDAP we rely on the well-established LDAP connector [5] but it would be anyway useful to be aware of the actual technology: OpenLDAP? ApacheDS? other?
>> * for podlings.xml and committers.txt there might be the need to built custom connectors from scratch, unless
>> ** you are able to report data to CSV [6] / other XML format [7] or
>> ** you provide some (bash?) scripts to manipulate such files and empowers the CMD connector [8] (suggested)
>>
>> Regards.
>>
>> [1] https://travis-ci.org/apache/syncope/builds/52704980
>> [2] https://travis-ci.org/apache/syncope/builds/52896946
>> [3] https://paste.apache.org/0slX
>> [4] https://cwiki.apache.org/confluence/display/SYNCOPE/Create+a+new+Syncope+project
>> [5] https://github.com/Tirasa/ConnIdLDAPBundle
>> [6] https://github.com/Tirasa/ConnIdCSVDirBundle
>> [7] http://openicf.forgerock.org/connectors/index.html#XML_File_Connector
>> [8] https://github.com/Tirasa/ConnIdCMDBundle
--
Francesco Chicchiriccò
Tirasa - Open Source Excellence
http://www.tirasa.net/
Involved at The Apache Software Foundation:
member, Syncope PMC chair, Cocoon PMC, Olingo PMC
http://people.apache.org/~ilgrosso/
Re: Trying to build Syncope
Posted by "Alan D. Cabrera" <li...@toolazydogs.com>.
> On Mar 3, 2015, at 11:57 PM, Francesco Chicchiriccò <il...@apache.org> wrote:
>
> On 03/03/2015 23:03, Alan D. Cabrera wrote:
>>
>> So, I’m working on using Syncope to wrap all the disparate data that needs to be managed at ASF. Where should I start? I’m thinking LDAP, podlings.xml, and committers.txt. Thoughts?
>
> Wow, this is worth a new thread actually!
>
> First of all, you shouldn't need to build Syncope from source but create your own project as explained in [4].
>
> Then, as in any IdM project you need to identify:
>
> 1. the resources you want to deal with (LDAP, podlings.xml, and committers.txt as you suggest above)
> 1.1 does a connector exist for all identified resources?
LDAP : yes (I’m pretty sure)
podlings.xml: no, I have to write one
committers.txt: no, I have to write one
etc.
> 1.2 are there authoritative resources?
Yes
> 2. the data flows, for each resource against Syncope:
> 2.1 do you want to deal with users only? or you need also to take into account groups / roles?
all of the above
> 2.2 will Syncope be only reading / only writing / reading & writing from that particular resource?
reading and writing. Think about what it takes to add a podling to the incubator:
podlings.xml needs to be updated w/ podling, mentors
committers.txt needs to be updated
svn/git need to be provisioned
jira needs to be provisioned
etc.
> 3. the attribute schema to define in Syncope and the attribute mapping for each resource (how the "givenName" LDAP attribute relate to corresponding attribute(s) on other resource(s)?)
That, I’m going to have to do. Does Syncope require a complete mapping or can I incrementally add stuff as processes are discovered?
>
> In particular regarding connectors:
>
> * for LDAP we rely on the well-established LDAP connector [5] but it would be anyway useful to be aware of the actual technology: OpenLDAP? ApacheDS? other?
> * for podlings.xml and committers.txt there might be the need to built custom connectors from scratch, unless
> ** you are able to report data to CSV [6] / other XML format [7] or
> ** you provide some (bash?) scripts to manipulate such files and empowers the CMD connector [8] (suggested)
>
> Regards.
>
> [1] https://travis-ci.org/apache/syncope/builds/52704980 <https://travis-ci.org/apache/syncope/builds/52704980>
> [2] https://travis-ci.org/apache/syncope/builds/52896946 <https://travis-ci.org/apache/syncope/builds/52896946>
> [3] https://paste.apache.org/0slX <https://paste.apache.org/0slX>
> [4] https://cwiki.apache.org/confluence/display/SYNCOPE/Create+a+new+Syncope+project <https://cwiki.apache.org/confluence/display/SYNCOPE/Create+a+new+Syncope+project>
> [5] https://github.com/Tirasa/ConnIdLDAPBundle <https://github.com/Tirasa/ConnIdLDAPBundle>
> [6] https://github.com/Tirasa/ConnIdCSVDirBundle <https://github.com/Tirasa/ConnIdCSVDirBundle>
> [7] http://openicf.forgerock.org/connectors/index.html#XML_File_Connector <http://openicf.forgerock.org/connectors/index.html#XML_File_Connector>
> [8] https://github.com/Tirasa/ConnIdCMDBundle <https://github.com/Tirasa/ConnIdCMDBundle>
>
> --
> Francesco Chicchiriccò
>
> Tirasa - Open Source Excellence
> http://www.tirasa.net/ <http://www.tirasa.net/>
>
> Involved at The Apache Software Foundation:
> member, Syncope PMC chair, Cocoon PMC, Olingo PMC
> http://people.apache.org/~ilgrosso/ <http://people.apache.org/~ilgrosso/>
Re: Trying to build Syncope
Posted by Francesco Chicchiriccò <il...@apache.org>.
On 03/03/2015 23:03, Alan D. Cabrera wrote:
>> On Mar 3, 2015, at 1:34 PM, Francesco Chicchiriccò <il...@apache.org> wrote:
>>
>> On 03/03/2015 22:10, Alan D. Cabrera wrote:
>>>> On Mar 3, 2015, at 1:03 PM, Francesco Chicchiriccò <il...@apache.org> wrote:
>>>>
>>>> On 03/03/2015 20:41, Alan D. Cabrera wrote:
>>>>>> On Mar 2, 2015, at 11:51 PM, Francesco Chicchiriccò <il...@apache.org> wrote:
>>>>>>
>>>>>> Hi Alan,
>>>>>> this seems very weird: could you please check which are the 4 files failing the RAT check under common/?
>>>>>>
>>>>>> I can't verify how the build is working under Mac OS X - neither Jenkins nor Travis are reporting troubles: it seems you're building from the 1_2_X branch or one of 1.2 tags, right?
>>>>> The 1_2_X branch.
>>>>>
>>>>> Unapproved licenses:
>>>>>
>>>>> /Users/acabrera/asf/syncope/common/rest-api/target/apidocs/package-list
>>>>> /Users/acabrera/asf/syncope/common/rest-api/target/apidocs/script.js
>>>>> /Users/acabrera/asf/syncope/common/rest-api/target/javadoc-bundle-options/javadoc-options-javadoc-resources.xml
>>>>> /Users/acabrera/asf/syncope/common/rest-api/target/javadoc-bundle-options/package-list
>>>> Ah, now I see what happened: you first built from master, then switched to 1_2_X without running "mvn clean": the problem occurs because 1_2_X and master share some modules with different type, as consequence of the huge code re-organization with had as per SYNCOPE-620.
>>>>
>>>> An idea could be to explicitly add **/target/* to RAT exclusions, I guess: WDYT?
>>> If you’re sure that there are no generated artifacts that need to have licenses then I guess that would work.
>> Or we can just add a note on the build instructions page: please remember, when switching from / to master branch, to perform a "mvn clean" before.
> I get these errors even though I perform a mV clean.
I guess that you are still on the 1_2_X branch when running "mvn clean":
the whole point is that when you built something on master and then
switch to 1_2_X (or any other branch, currently), git is not able to
remove some directories, which remain stale and cause RAT to fail.
The common/rest-api directory, in particular, is a JAR module on master
but does not exist at all in other branches, being 'common' a JAR module
elsewhere.
So, from your own situation (on 1_2_X branch with some stale
directories) you should either (more generally):
git checkout master
mvn clean
git checkout 1_2_X
or simply
rm -rf common/rest-api
You could see at that point via "git status" that nothing is actually
missing.
(These things make me sometime regret the good old SVN days...).
>>>> About
>>>>
>>>>> java.lang.OutOfMemoryError: unable to create new native thread
>>>> you should be setting MAVEN_OPTS as suggested by
>>>>
>>>> http://syncope.apache.org/building.html#Building_Syncope <http://syncope.apache.org/building.html#Building_Syncope>
>>> No joy. (BTW, I had previously set my memory to 2G)
>> It seems this problem is intermittently happening (see [1] and [2], for example): this is probably due to the very high (probably exaggerated) number of concurrent threads (10000) created by ConcurrencyTest tests - I believe this number can be lowered to - say - 1000 and still keep the test effective.
>>
>> Can you please check if such change makes any difference for you? See this patch [3] for 1_2_X.
> That did the trick.
Ok, I am going to apply that patch on 1_2_X and master.
> So, I’m working on using Syncope to wrap all the disparate data that needs to be managed at ASF. Where should I start? I’m thinking LDAP, podlings.xml, and committers.txt. Thoughts?
Wow, this is worth a new thread actually!
First of all, you shouldn't need to build Syncope from source but create
your own project as explained in [4].
Then, as in any IdM project you need to identify:
1. the resources you want to deal with (LDAP, podlings.xml, and
committers.txt as you suggest above)
1.1 does a connector exist for all identified resources?
1.2 are there authoritative resources?
2. the data flows, for each resource against Syncope:
2.1 do you want to deal with users only? or you need also to take
into account groups / roles?
2.2 will Syncope be only reading / only writing / reading & writing
from that particular resource?
3. the attribute schema to define in Syncope and the attribute mapping
for each resource (how the "givenName" LDAP attribute relate to
corresponding attribute(s) on other resource(s)?)
In particular regarding connectors:
* for LDAP we rely on the well-established LDAP connector [5] but it
would be anyway useful to be aware of the actual technology: OpenLDAP?
ApacheDS? other?
* for podlings.xml and committers.txt there might be the need to built
custom connectors from scratch, unless
** you are able to report data to CSV [6] / other XML format [7] or
** you provide some (bash?) scripts to manipulate such files and
empowers the CMD connector [8] (suggested)
Regards.
[1] https://travis-ci.org/apache/syncope/builds/52704980
[2] https://travis-ci.org/apache/syncope/builds/52896946
[3] https://paste.apache.org/0slX
[4]
https://cwiki.apache.org/confluence/display/SYNCOPE/Create+a+new+Syncope+project
[5] https://github.com/Tirasa/ConnIdLDAPBundle
[6] https://github.com/Tirasa/ConnIdCSVDirBundle
[7] http://openicf.forgerock.org/connectors/index.html#XML_File_Connector
[8] https://github.com/Tirasa/ConnIdCMDBundle
--
Francesco Chicchiriccò
Tirasa - Open Source Excellence
http://www.tirasa.net/
Involved at The Apache Software Foundation:
member, Syncope PMC chair, Cocoon PMC, Olingo PMC
http://people.apache.org/~ilgrosso/
Re: Trying to build Syncope
Posted by "Alan D. Cabrera" <li...@toolazydogs.com>.
> On Mar 3, 2015, at 1:34 PM, Francesco Chicchiriccò <il...@apache.org> wrote:
>
> On 03/03/2015 22:10, Alan D. Cabrera wrote:
>>> On Mar 3, 2015, at 1:03 PM, Francesco Chicchiriccò <il...@apache.org> wrote:
>>>
>>> On 03/03/2015 20:41, Alan D. Cabrera wrote:
>>>>> On Mar 2, 2015, at 11:51 PM, Francesco Chicchiriccò <il...@apache.org> wrote:
>>>>>
>>>>> Hi Alan,
>>>>> this seems very weird: could you please check which are the 4 files failing the RAT check under common/?
>>>>>
>>>>> I can't verify how the build is working under Mac OS X - neither Jenkins nor Travis are reporting troubles: it seems you're building from the 1_2_X branch or one of 1.2 tags, right?
>>>> The 1_2_X branch.
>>>>
>>>> Unapproved licenses:
>>>>
>>>> /Users/acabrera/asf/syncope/common/rest-api/target/apidocs/package-list
>>>> /Users/acabrera/asf/syncope/common/rest-api/target/apidocs/script.js
>>>> /Users/acabrera/asf/syncope/common/rest-api/target/javadoc-bundle-options/javadoc-options-javadoc-resources.xml
>>>> /Users/acabrera/asf/syncope/common/rest-api/target/javadoc-bundle-options/package-list
>>> Ah, now I see what happened: you first built from master, then switched to 1_2_X without running "mvn clean": the problem occurs because 1_2_X and master share some modules with different type, as consequence of the huge code re-organization with had as per SYNCOPE-620.
>>>
>>> An idea could be to explicitly add **/target/* to RAT exclusions, I guess: WDYT?
>> If you’re sure that there are no generated artifacts that need to have licenses then I guess that would work.
>
> Or we can just add a note on the build instructions page: please remember, when switching from / to master branch, to perform a "mvn clean" before.
I get these errors even though I perform a mV clean.
>>> About
>>>
>>>> java.lang.OutOfMemoryError: unable to create new native thread
>>> you should be setting MAVEN_OPTS as suggested by
>>>
>>> http://syncope.apache.org/building.html#Building_Syncope <http://syncope.apache.org/building.html#Building_Syncope>
>> No joy. (BTW, I had previously set my memory to 2G)
>
> It seems this problem is intermittently happening (see [1] and [2], for example): this is probably due to the very high (probably exaggerated) number of concurrent threads (10000) created by ConcurrencyTest tests - I believe this number can be lowered to - say - 1000 and still keep the test effective.
>
> Can you please check if such change makes any difference for you? See this patch [3] for 1_2_X.
That did the trick.
So, I’m working on using Syncope to wrap all the disparate data that needs to be managed at ASF. Where should I start? I’m thinking LDAP, podlings.xml, and committers.txt. Thoughts?
Regards,
Alan
Re: Trying to build Syncope
Posted by Francesco Chicchiriccò <il...@apache.org>.
On 03/03/2015 22:10, Alan D. Cabrera wrote:
>> On Mar 3, 2015, at 1:03 PM, Francesco Chicchiriccò <il...@apache.org> wrote:
>>
>> On 03/03/2015 20:41, Alan D. Cabrera wrote:
>>>> On Mar 2, 2015, at 11:51 PM, Francesco Chicchiriccò <il...@apache.org> wrote:
>>>>
>>>> Hi Alan,
>>>> this seems very weird: could you please check which are the 4 files failing the RAT check under common/?
>>>>
>>>> I can't verify how the build is working under Mac OS X - neither Jenkins nor Travis are reporting troubles: it seems you're building from the 1_2_X branch or one of 1.2 tags, right?
>>> The 1_2_X branch.
>>>
>>> Unapproved licenses:
>>>
>>> /Users/acabrera/asf/syncope/common/rest-api/target/apidocs/package-list
>>> /Users/acabrera/asf/syncope/common/rest-api/target/apidocs/script.js
>>> /Users/acabrera/asf/syncope/common/rest-api/target/javadoc-bundle-options/javadoc-options-javadoc-resources.xml
>>> /Users/acabrera/asf/syncope/common/rest-api/target/javadoc-bundle-options/package-list
>> Ah, now I see what happened: you first built from master, then switched to 1_2_X without running "mvn clean": the problem occurs because 1_2_X and master share some modules with different type, as consequence of the huge code re-organization with had as per SYNCOPE-620.
>>
>> An idea could be to explicitly add **/target/* to RAT exclusions, I guess: WDYT?
> If you’re sure that there are no generated artifacts that need to have licenses then I guess that would work.
Or we can just add a note on the build instructions page: please
remember, when switching from / to master branch, to perform a "mvn
clean" before.
>> About
>>
>>> java.lang.OutOfMemoryError: unable to create new native thread
>> you should be setting MAVEN_OPTS as suggested by
>>
>> http://syncope.apache.org/building.html#Building_Syncope <http://syncope.apache.org/building.html#Building_Syncope>
> No joy. (BTW, I had previously set my memory to 2G)
It seems this problem is intermittently happening (see [1] and [2], for
example): this is probably due to the very high (probably exaggerated)
number of concurrent threads (10000) created by ConcurrencyTest tests -
I believe this number can be lowered to - say - 1000 and still keep the
test effective.
Can you please check if such change makes any difference for you? See
this patch [3] for 1_2_X.
Thanks.
Regards.
[1] https://travis-ci.org/apache/syncope/builds/52704980
[2] https://travis-ci.org/apache/syncope/builds/52896946
[3] https://paste.apache.org/0slX
--
Francesco Chicchiriccò
Tirasa - Open Source Excellence
http://www.tirasa.net/
Involved at The Apache Software Foundation:
member, Syncope PMC chair, Cocoon PMC, Olingo PMC
http://people.apache.org/~ilgrosso/
Re: Trying to build Syncope
Posted by "Alan D. Cabrera" <li...@toolazydogs.com>.
> On Mar 3, 2015, at 1:03 PM, Francesco Chicchiriccò <il...@apache.org> wrote:
>
> On 03/03/2015 20:41, Alan D. Cabrera wrote:
>>
> >> On Mar 2, 2015, at 11:51 PM, Francesco Chicchiriccò <il...@apache.org> wrote:
> >>
> >> Hi Alan,
> >> this seems very weird: could you please check which are the 4 files failing the RAT check under common/?
> >>
> >> I can't verify how the build is working under Mac OS X - neither Jenkins nor Travis are reporting troubles: it seems you're building from the 1_2_X branch or one of 1.2 tags, right?
> >
> > The 1_2_X branch.
> >
> > Unapproved licenses:
> >
> > /Users/acabrera/asf/syncope/common/rest-api/target/apidocs/package-list
> > /Users/acabrera/asf/syncope/common/rest-api/target/apidocs/script.js
> > /Users/acabrera/asf/syncope/common/rest-api/target/javadoc-bundle-options/javadoc-options-javadoc-resources.xml
> > /Users/acabrera/asf/syncope/common/rest-api/target/javadoc-bundle-options/package-list
>
> Ah, now I see what happened: you first built from master, then switched to 1_2_X without running "mvn clean": the problem occurs because 1_2_X and master share some modules with different type, as consequence of the huge code re-organization with had as per SYNCOPE-620.
>
> An idea could be to explicitly add **/target/* to RAT exclusions, I guess: WDYT?
If you’re sure that there are no generated artifacts that need to have licenses then I guess that would work.
> About
>
>> java.lang.OutOfMemoryError: unable to create new native thread
>
> you should be setting MAVEN_OPTS as suggested by
>
> http://syncope.apache.org/building.html#Building_Syncope <http://syncope.apache.org/building.html#Building_Syncope>
No joy. (BTW, I had previously set my memory to 2G)
Regards,
Alan
Re: Trying to build Syncope
Posted by Francesco Chicchiriccò <il...@apache.org>.
On 03/03/2015 20:41, Alan D. Cabrera wrote:
>
>> On Mar 2, 2015, at 11:51 PM, Francesco Chicchiriccò
<il...@apache.org> wrote:
>>
>> Hi Alan,
>> this seems very weird: could you please check which are the 4 files
failing the RAT check under common/?
>>
>> I can't verify how the build is working under Mac OS X - neither
Jenkins nor Travis are reporting troubles: it seems you're building from
the 1_2_X branch or one of 1.2 tags, right?
>
> The 1_2_X branch.
>
> Unapproved licenses:
>
> /Users/acabrera/asf/syncope/common/rest-api/target/apidocs/package-list
> /Users/acabrera/asf/syncope/common/rest-api/target/apidocs/script.js
>
/Users/acabrera/asf/syncope/common/rest-api/target/javadoc-bundle-options/javadoc-options-javadoc-resources.xml
>
/Users/acabrera/asf/syncope/common/rest-api/target/javadoc-bundle-options/package-list
Ah, now I see what happened: you first built from master, then switched
to 1_2_X without running "mvn clean": the problem occurs because 1_2_X
and master share some modules with different type, as consequence of the
huge code re-organization with had as per SYNCOPE-620.
An idea could be to explicitly add **/target/* to RAT exclusions, I
guess: WDYT?
About
> java.lang.OutOfMemoryError: unable to create new native thread
you should be setting MAVEN_OPTS as suggested by
http://syncope.apache.org/building.html#Building_Syncope
HTH
Regards.
--
Francesco Chicchiriccò
Tirasa - Open Source Excellence
http://www.tirasa.net/
Involved at The Apache Software Foundation:
member, Syncope PMC chair, Cocoon PMC, Olingo PMC
http://people.apache.org/~ilgrosso/
Re: Trying to build Syncope
Posted by "Alan D. Cabrera" <li...@toolazydogs.com>.
> On Mar 2, 2015, at 11:51 PM, Francesco Chicchiriccò <il...@apache.org> wrote:
>
> Hi Alan,
> this seems very weird: could you please check which are the 4 files failing the RAT check under common/?
>
> I can't verify how the build is working under Mac OS X - neither Jenkins nor Travis are reporting troubles: it seems you're building from the 1_2_X branch or one of 1.2 tags, right?
The 1_2_X branch.
Unapproved licenses:
/Users/acabrera/asf/syncope/common/rest-api/target/apidocs/package-list
/Users/acabrera/asf/syncope/common/rest-api/target/apidocs/script.js
/Users/acabrera/asf/syncope/common/rest-api/target/javadoc-bundle-options/javadoc-options-javadoc-resources.xml
/Users/acabrera/asf/syncope/common/rest-api/target/javadoc-bundle-options/package-list
Regards,
Alan
Re: Trying to build Syncope
Posted by Francesco Chicchiriccò <il...@apache.org>.
Hi Alan,
this seems very weird: could you please check which are the 4 files
failing the RAT check under common/?
I can't verify how the build is working under Mac OS X - neither Jenkins
nor Travis are reporting troubles: it seems you're building from the
1_2_X branch or one of 1.2 tags, right?
Regards.
On 02/03/2015 22:49, Alan D. Cabrera wrote:
> Hello,
>
> I’m trying to build Syncope and am getting a Rat error. I’m wondering if I’m doing something wrong.
>
> [acabrera-mn:syncope 520]$ mvn -v
> Apache Maven 3.2.2 (45f7c06d68e745d05611f7fd14efb6594181933e; 2014-06-17T06:51:42-07:00)
> Maven home: /usr/local/Cellar/maven/3.2.2/libexec
> Java version: 1.8.0_31, vendor: Oracle Corporation
> Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_31.jdk/Contents/Home/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "mac os x", version: "10.10.2", arch: "x86_64", family: "mac"
>
> [INFO] --- apache-rat-plugin:0.11:check (default) @ syncope-common ---
> [INFO] 51 implicit excludes (use -debug for more details).
> [INFO] Exclude: nbactions.xml
> [INFO] Exclude: nb-configuration.xml
> [INFO] Exclude: **/META-INF/cxf/**
> [INFO] Exclude: **/META-INF/services/**
> [INFO] Exclude: **/META-INF/MANIFEST.MF
> [INFO] Exclude: **/*.csv
> [INFO] Exclude: **/archetype-resources/**
> [INFO] Exclude: **/goal.txt
> [INFO] Exclude: **/rat.txt
> [INFO] Exclude: **/build-copy-javadoc-files.xml
> [INFO] Exclude: **/maven-eclipse.xml
> [INFO] Exclude: **/*.iml
> [INFO] Exclude: **/*.log
> [INFO] Exclude: .externalToolBuilders/**
> [INFO] Exclude: .git/**
> [INFO] Exclude: .idea/**
> [INFO] Exclude: **/.*
> [INFO] Exclude: **/deb/control/conffiles
> [INFO] Exclude: **/deb/control/control
> [INFO] Exclude: **/*.lst
> [INFO] 403 resources included (use -debug for more details)
> Warning: org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser: Property 'http://www.oracle.com/xml/jaxp/properties/entityExpansionLimit' is not recognized.
> Compiler warnings:
> WARNING: 'org.apache.xerces.jaxp.SAXParserImpl: Property 'http://javax.xml.XMLConstants/property/accessExternalDTD' is not recognized.'
> Warning: org.apache.xerces.parsers.SAXParser: Feature 'http://javax.xml.XMLConstants/feature/secure-processing' is not recognized.
> Warning: org.apache.xerces.parsers.SAXParser: Property 'http://javax.xml.XMLConstants/property/accessExternalDTD' is not recognized.
> Warning: org.apache.xerces.parsers.SAXParser: Property 'http://www.oracle.com/xml/jaxp/properties/entityExpansionLimit' is not recognized.
> [INFO] Rat check: Summary of files. Unapproved: 4 unknown: 4 generated: 0 approved: 156 licence.
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Syncope ..................................... SUCCESS [ 5.122 s]
> [INFO] Apache Syncope Build Tools ......................... SUCCESS [ 29.342 s]
> [INFO] Apache Syncope Archetype ........................... SUCCESS [ 2.805 s]
> [INFO] Apache Syncope Common .............................. FAILURE [ 10.019 s]
> [INFO] Apache Syncope Client .............................. SKIPPED
> [INFO] Apache Syncope Core ................................ SKIPPED
> [INFO] Apache Syncope Core Upgrader ....................... SKIPPED
> [INFO] Apache Syncope Console ............................. SKIPPED
> [INFO] Apache Syncope Standalone Distribution ............. SKIPPED
> [INFO] Apache Syncope Installer ........................... SKIPPED
> [INFO] Apache Syncope Deb ................................. SKIPPED
> [INFO] Apache Syncope Deb Core ............................ SKIPPED
> [INFO] Apache Syncope Deb Console ......................... SKIPPED
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 48.537 s
> [INFO] Finished at: 2015-03-02T13:39:56-08:00
> [INFO] Final Memory: 90M/1963M
> [INFO] ------------------------------------------------------------------------
> [ERROR] Failed to execute goal org.apache.rat:apache-rat-plugin:0.11:check (default) on project syncope-common: Too many files with unapproved license: 4 See RAT report in: /Users/acabrera/asf/syncope/common/target/rat.txt -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the command
> [ERROR] mvn <goals> -rf :syncope-common
--
Francesco Chicchiriccò
Tirasa - Open Source Excellence
http://www.tirasa.net/
Involved at The Apache Software Foundation:
member, Syncope PMC chair, Cocoon PMC, Olingo PMC
http://people.apache.org/~ilgrosso/