You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@jena.apache.org by Andy Seaborne <an...@apache.org> on 2017/10/25 17:26:22 UTC

@Test TestDatabaseOps.compact_prefixes_3 [Was Re: [] Release Apache Jena 3.5.0]

Bruno,

The absence of the Data-0001 is very strange. It is created for every 
test in the DatabaseMgr.connectDatasetGraph call and other tests work.

I don't have access to OSX or Windows for testing and compaction is 
playing around with directories and files on disk (java, portable, ...) 
but the code for compaction, and its tests, is quite recent.

I did run a build+test with source-release zip file on Linux.

A few things to try:

1/ Could you try running the test in isolation? it should run in Eclipse 
by pointing at the test and running just that one @Test.

Is there a stacktrace?

2/ Run with mvn -fn (--fail-never) which should make maven run the other 
modules and tests so showing if there are any other problems.

3/ I can see that parallel tests would mess it up the test setup. I've 
just read the surefire plugin docs and I'm still not sure what he 
default is - it might be thread per core.  Can you try forcing no 
parallel tests please? [*]


I can't see a NPE place in line 142, I'm guessing it comes in the 
Txn.executeRead that follows.

g.getPrefixMapping().getNsURIPrefix(

and I'll guess that its the second object access (getPrefixMapping()) 
but it might be deeper - no stack trace?

I can't see how that connects to the absence of Data-0001.


[*]
Module jena-tdb2 does not set up surefire and replies on defaults. It 
should run TC_TDB

       <plugin>
         <groupId>org.apache.maven.plugins</groupId>
         <artifactId>maven-surefire-report-plugin</artifactId>
         <configuration>
           <includes>
             <include>**/TC_*.java</include>
           </includes>
         </configuration>
       </plugin>


     Andy


On 25/10/17 12:19, Bruno P. Kinoshita wrote:
> I think one of the tests is failing when I run
> 
> `mvn clean test install`, and also when I run the same `mvn clean test -e -X -DforkMode=never` in debug mode in Eclipse.
> 
> 
> The compact_prefixes_3 test method expects a directory like DB/Data-0001, but there is only a DB folder. The methods to create the Data-0001 switchable location was called, but for some reason nothing happened.
> 
> Didn't have much time to thoroughly investigate it, so will have to leave the error here for others to take a look. Will have more time to look into it tomorrow evening NZ time.
> Running org.apache.jena.tdb2.sys.TestDatabaseOps
> Tests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.028 sec <<< FAILURE! - in org.apache.jena.tdb2.sys.TestDatabaseOps
> compact_prefixes_3(org.apache.jena.tdb2.sys.TestDatabaseOps)  Time elapsed: 0.053 sec  <<< ERROR!
> java.lang.NullPointerException
> at org.apache.jena.tdb2.sys.TestDatabaseOps.compact_prefixes_3(TestDatabaseOps.java:142)
> 
> Running org.apache.jena.tdb2.sys.TestSys
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in org.apache.jena.tdb2.sys.TestSys
> Running org.apache.jena.tdb2.sys.TestDatabaseConnection
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.103 sec - in org.apache.jena.tdb2.sys.TestDatabaseConnection
> Running org.apache.jena.tdb2.assembler.TestTDBAssembler
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.449 sec - in org.apache.jena.tdb2.assembler.TestTDBAssembler
> Running org.apache.jena.tdb2.TestDatabaseMgr
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.088 sec - in org.apache.jena.tdb2.TestDatabaseMgr
> Running org.apache.jena.tdb2.solver.TestSolverTDB
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.048 sec - in org.apache.jena.tdb2.solver.TestSolverTDB
> Running org.apache.jena.tdb2.solver.TestStats
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 sec - in org.apache.jena.tdb2.solver.TestStats
> 
> Results :
> 
> Tests in error:
>    TestDatabaseOps.compact_prefixes_3:142 » NullPointer
> 
> Tests run: 537, Failures: 0, Errors: 1, Skipped: 7
> 
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Jena - Project .............................. SUCCESS [  1.902 s]
> [INFO] Apache Jena - Shadowed external libraries .......... SUCCESS [ 16.081 s]
> [INFO] Apache Jena - IRI .................................. SUCCESS [  5.970 s]
> [INFO] Apache Jena - Base Common Environment .............. SUCCESS [ 16.289 s]
> [INFO] Apache Jena - Core ................................. SUCCESS [01:28 min]
> [INFO] Apache Jena - ARQ (SPARQL 1.1 Query Engine) ........ SUCCESS [01:30 min]
> [INFO] Apache Jena - RDF Connection ....................... SUCCESS [  8.349 s]
> [INFO] Apache Jena - TDB (Native Triple Store) ............ SUCCESS [ 24.995 s]
> [INFO] Apache Jena - Database Operation Environment ....... SUCCESS [  0.201 s]
> [INFO] Apache Jena - DBOE Base ............................ SUCCESS [  9.072 s]
> [INFO] Apache Jena - DBOE Transactions .................... SUCCESS [  7.257 s]
> [INFO] Apache Jena - DBOE Indexes ......................... SUCCESS [  4.289 s]
> [INFO] Apache Jena - DBOE Index test suite ................ SUCCESS [  4.663 s]
> [INFO] Apache Jena - DBOE Transactional Datastructures .... SUCCESS [ 11.756 s]
> [INFO] Apache Jena - TDB2 ................................. FAILURE [ 13.688 s]
> [INFO] Apache Jena - Libraries POM ........................ SKIPPED
> [INFO] Apache Jena - Command line tools ................... SKIPPED
> [INFO] Apache Jena - SPARQL Text Search ................... SKIPPED
> [INFO] Apache Jena - SPARQL Text Search - Elasticsearch ... SKIPPED
> [INFO] Apache Jena - SPARQL Spatial Search ................ SKIPPED
> [INFO] Apache Jena - Fuseki - A SPARQL 1.1 Server ......... SKIPPED
> [INFO] Apache Jena - Fuseki Server Engine ................. SKIPPED
> [INFO] Apache Jena - Fuseki Embedded Server ............... SKIPPED
> [INFO] Apache Jena - Fuseki WAR File ...................... SKIPPED
> [INFO] Apache Jena - Fuseki Server Standalone Jar ......... SKIPPED
> [INFO] Apache Jena - Fuseki Basic Server .................. SKIPPED
> [INFO] Apache Jena - Fuseki Binary Distribution ........... SKIPPED
> [INFO] Apache Jena - Integration Testing .................. SKIPPED
> [INFO] Apache Jena - Distribution ......................... SKIPPED
> [INFO] Apache Jena - Fuseki1 .............................. SKIPPED
> [INFO] Apache Jena - Data Tables for RDF and SPARQL ....... SKIPPED
> [INFO] Apache Jena - SDB (SQL based triple store) ......... SKIPPED
> [INFO] Apache Jena - Maven Plugins, including schemagen ... SKIPPED
> [INFO] Apache Jena - Security Permissions ................. SKIPPED
> [INFO] Apache Jena - Extras ............................... SKIPPED
> [INFO] Apache Jena - Extras - Query Builder ............... SKIPPED
> [INFO] Apache Jena - JDBC Parent .......................... SKIPPED
> [INFO] Apache Jena - JDBC Core API ........................ SKIPPED
> [INFO] Apache Jena - JDBC Remote Endpoint Driver .......... SKIPPED
> [INFO] Apache Jena - JDBC In-Memory Driver ................ SKIPPED
> [INFO] Apache Jena - JDBC TDB Driver ...................... SKIPPED
> [INFO] Apache Jena - JDBC Driver Bundle ................... SKIPPED
> [INFO] Apache Jena - Elephas .............................. SKIPPED
> [INFO] Apache Jena - Elephas - Common API ................. SKIPPED
> [INFO] Apache Jena - Elephas - I/O ........................ SKIPPED
> [INFO] Apache Jena - Elephas - Map/Reduce ................. SKIPPED
> [INFO] Apache Jena - Elephas - Statistics Demo App ........ SKIPPED
> [INFO] Apache Jena - OSGi ................................. SKIPPED
> [INFO] Apache Jena - OSGi bundle .......................... SKIPPED
> [INFO] Apache Jena - OSGi Karaf features .................. SKIPPED
> [INFO] Apache Jena ........................................ SKIPPED
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 05:20 min
> [INFO] Finished at: 2017-10-25T22:46:37+13:00
> [INFO] Final Memory: 91M/1478M
> [INFO] ------------------------------------------------------------------------
> 
> Bruno
> 
> ________________________________
> From: Andy Seaborne <an...@apache.org>
> To: dev@jena.apache.org
> Sent: Wednesday, 25 October 2017 5:47 AM
> Subject: [VOTE] Release Apache Jena 3.5.0
> 
> 
> 
> Hi,
> 
> 
> Here is a vote on a release of Jena 3.5.0.
> 
> 
> This is the first proposed candidate for a 3.5.0 release.
> 
> 
> Note - the deadline is 18:00 UTC on Friday - not midnight - if things go
> 
> well, I am be able to push bytes out Friday evening and have them sync
> 
> over night.
> 
> 
> 
> ==== Release changes
> 
> 
> Introducing TDB2:
> 
> http://jena.staging.apache.org/documentation/tdb2/
> 
> 
> *TDB2 is not compatible with TDB1*
> 
> 
> Compared to TDB1:
> 
> * No size limits on transactions : bulk uploads into a live Fuseki
> 
>     can be 100's of millions of triples.
> 
> * Models and Graphs can be passed across transactions
> 
> * No queue of delayed updates, no transaction backlog problems.
> 
> * "Writer pays" - readers don't
> 
>     All work for update is done on the writer thread.
> 
> * Datatypes of numerics preserved; xsd:doubles supported.
> 
> 
> TDB2 is subject to change.
> 
> 
> We solicit any and all feedback (good and bad!) about TDB2 to help
> 
> advance it to deployment-ready.
> 
> 
> 
> JENA-1390 : Add StmtIterator.toModel :
> 
> 
> JENA-1392 : Add dynamic dataset support to SDB.
> 
> 
> JENA-1395 : "--output RDF/XML" now prints using the basic block-oriented
> 
> writer, which uses less memory.  Use "--formatted" (same as "--pretty")
> 
> for pretty printed RDF/XML.
> 
> 
> JENA-1398 :
> 
> Upgrade FOAF to add new spelling and deprecation of old for archaic FOAF
> 
> properties
> 
> 
> == Dependency changes:
> 
> 
> No license changes.
> 
> 
> Upgrade jsonld-java to 0.11
> 
>     jackson to 2.9.0
> 
>     commons-fileuploader to 1.3.2->1.3.3
> 
>     commons-io 2.5 in jena-base
> 
>       (was pulled in anyway by jsonld-java)
> 
> 
> ==== Release Vote
> 
> 
> Everyone, not just committers, is invited to test and vote.
> 
> Please download and test the proposed release.
> 
> 
> Staging repository:
> 
>    https://repository.apache.org/content/repositories/orgapachejena-1019/
> 
> 
> Proposed dist/ area:
> 
>      https://dist.apache.org/repos/dist/dev/jena/
> 
> 
> Keys:
> 
>      https://svn.apache.org/repos/asf/jena/dist/KEYS
> 
> 
> Git commit (browser URL):
> 
>      http://git-wip-us.apache.org/repos/asf/jena/commit/8235ee33
> 
> 
> Git Commit Hash:
> 
>       8235ee335eea114aecffd55525ad36e408a2f39b
> 
> 
> Git Commit Tag:
> 
>       jena-3.5.0-rc1
> 
> 
> Please vote to approve this release:
> 
> 
>         [ ] +1 Approve the release
> 
>         [ ]  0 Don't care
> 
>         [ ] -1 Don't release, because ...
> 
> 
> This vote will be open to at least
> 
> 
>         Friday, 2017-10-27, 18:00 UTC.
> 
> 
> If you expect to check the release but the 72 hour limit does not work
> 
> for you, please email within the schedule above with an expected time
> 
> and we can extend the vote period.
> 
> 
> Thanks,
> 
> 
>       Andy
> 
> 
> Checking needed:
> 
> 
> + does everything work on Linux?
> 
> + does everything work on MS Windows?
> 
> + does everything work on OS X?
> 
> + are the GPG signatures fine?
> 
> + are the checksums correct?
> 
> + is there a source archive?
> 
> 
> + can the source archive really be built?
> 
>           (NB This requires a "mvn install" first time)
> 
> + is there a correct LICENSE and NOTICE file in each artifact
> 
>           (both source and binary artifacts)?
> 
> + does the NOTICE file contain all necessary attributions?
> 
> + have any licenses of dependencies changed due to upgrades?
> 
>            if so have LICENSE and NOTICE been upgraded appropriately?
> 
> + does the tag/commit in the SCM contain reproducible sources?
>