You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@jena.apache.org by Andy Seaborne <an...@apache.org> on 2016/07/29 09:48:11 UTC
TDB2: preview
There are snapshot/preview builds of TDB2 now available.
* TDB2 has scalable transactions
* TDB2 has write-once transactions (no RDF data in the journal)
and generally better written for long term maintenance and stability.
** TDB2 is not compatible with Apache Jena TDB (TDB1) databases. **
This is not part of Apache Jena - it is a personal project and does not
come with the backing of the Apache Software Foundation. (Whether it
will be in the future is for discussion with the PMC.)
This is a preview release - it is subject to change and while "it works
for me", it is likely to have rough edges.
TDB2 from Java:
https://github.com/afs/mantis/blob/master/use-tdb2.md
TDB2 in Fuseki:
https://github.com/afs/mantis/blob/master/use-fuseki-tdb2.md
Codebase:
https://github.com/afs/mantis
Note that the artifacts come from the Sonatype snapshot repo so you need
to configure maven/gradle/... appropriately.
Example:
Loading 100m of BSBM data into a live Fuseki (a single write transaction
while the server was able to answer queries at the same time) with a
default heap size:
SSD: 70K triples/s (about 24 minutes)
Disk: 47.5K TPS (about 35 minutes)
(That said, my SSD is in a desktop machine it's not particularly fast.
Modern servers have a much architecture.)
This would not have been possible without:
* The UK Government - InnovateUK (the Technology Strategy Board as was)
most of the work is a spin off from a grant-funded project
* Epimorphics for letting me work on that project
* GitHub for the code repository
* Sonatype for the maven repository and route to Maven Central
* TravisCI for the continuous integration server.
Andy
TDB2: development snapshots available
Posted by Andy Seaborne <an...@apache.org>.
There are snapshot/preview builds of TDB2 now available.
* TDB2 has scalable transactions
* TDB2 has write-once transactions (no RDF data in the journal)
and generally better written for long term maintenance and stability.
** TDB2 is not compatible with Apache Jena TDB (TDB1) databases. **
This is not part of Apache Jena - it is a personal project and does not
come with the backing of the Apache Software Foundation. (Whether it
will be in the future is for discussion with the PMC.)
This is a preview release - it is subject to change and while "it works
for me", it is likely to have rough edges.
TDB2 from Java:
https://github.com/afs/mantis/blob/master/use-tdb2.md
TDB2 in Fuseki:
https://github.com/afs/mantis/blob/master/use-fuseki-tdb2.md
Codebase:
https://github.com/afs/mantis
Note that the artifacts come from the Sonatype snapshot repo so you need
to configure maven/gradle/... appropriately.
Example:
Loading 100m of BSBM data into a live Fuseki (a single write transaction
while the server was able to answer queries at the same time) with a
default heap size:
SSD: 70K triples/s (about 24 minutes)
Disk: 47.5K TPS (about 35 minutes)
(That said, my SSD is in a desktop machine it's not particularly fast.
Modern servers have a much architecture.)
This would not have been possible without:
* The UK Government - InnovateUK (the Technology Strategy Board as was)
most of the work is a spin off from a grant-funded project
* Epimorphics, for letting me work on that project
* GitHub, for the code repository
* Sonatype, for the maven repository and route to Maven Central
* TravisCI, for the continuous integration server.
Andy
Re: TDB2: preview
Posted by Andy Seaborne <an...@apache.org>.
On 29/07/16 12:59, A. Soroka wrote:
> Andy,
>
> I seem to remember that there are some abilities to cluster in TDB2-- is that correct or am I getting different things mixed up?
TDB2 is single machine .
Another part of the grant funded project was/is clustering butthat is
not this code (and for that matter, the Fuseki2 UI by Ian is also an
outcome of grant).
----
I have a strong interest at the moment in change propagation - keeping a
number of RDF triple stores in sync. I've been working with an upgrade
to "RDF patch" [1], simplifying it and also adding transaction markers.
Combined with a router machine to coordination overlaps, replay lost
updates etc etc you get a collection of replicas that are eventually
consistent.
Andy
http://afs.github.io/rdf-patch/
>
> ---
> A. Soroka
> The University of Virginia Library
>
>> On Jul 29, 2016, at 5:48 AM, Andy Seaborne <an...@apache.org> wrote:
>>
>> There are snapshot/preview builds of TDB2 now available.
>>
>> * TDB2 has scalable transactions
>> * TDB2 has write-once transactions (no RDF data in the journal)
>>
>> and generally better written for long term maintenance and stability.
>>
>>
>> ** TDB2 is not compatible with Apache Jena TDB (TDB1) databases. **
>>
>>
>> This is not part of Apache Jena - it is a personal project and does not come with the backing of the Apache Software Foundation. (Whether it will be in the future is for discussion with the PMC.)
>>
>> This is a preview release - it is subject to change and while "it works for me", it is likely to have rough edges.
>>
>>
>> TDB2 from Java:
>> https://github.com/afs/mantis/blob/master/use-tdb2.md
>>
>> TDB2 in Fuseki:
>> https://github.com/afs/mantis/blob/master/use-fuseki-tdb2.md
>>
>>
>> Codebase:
>> https://github.com/afs/mantis
>>
>> Note that the artifacts come from the Sonatype snapshot repo so you need to configure maven/gradle/... appropriately.
>>
>>
>> Example:
>>
>> Loading 100m of BSBM data into a live Fuseki (a single write transaction while the server was able to answer queries at the same time) with a default heap size:
>>
>> SSD: 70K triples/s (about 24 minutes)
>> Disk: 47.5K TPS (about 35 minutes)
>>
>> (That said, my SSD is in a desktop machine it's not particularly fast. Modern servers have a much architecture.)
>>
>>
>> This would not have been possible without:
>>
>> * The UK Government - InnovateUK (the Technology Strategy Board as was)
>> most of the work is a spin off from a grant-funded project
>>
>> * Epimorphics for letting me work on that project
>>
>> * GitHub for the code repository
>>
>> * Sonatype for the maven repository and route to Maven Central
>>
>> * TravisCI for the continuous integration server.
>>
>> Andy
>>
>
Re: TDB2: preview
Posted by "A. Soroka" <aj...@virginia.edu>.
Andy,
I seem to remember that there are some abilities to cluster in TDB2-- is that correct or am I getting different things mixed up?
---
A. Soroka
The University of Virginia Library
> On Jul 29, 2016, at 5:48 AM, Andy Seaborne <an...@apache.org> wrote:
>
> There are snapshot/preview builds of TDB2 now available.
>
> * TDB2 has scalable transactions
> * TDB2 has write-once transactions (no RDF data in the journal)
>
> and generally better written for long term maintenance and stability.
>
>
> ** TDB2 is not compatible with Apache Jena TDB (TDB1) databases. **
>
>
> This is not part of Apache Jena - it is a personal project and does not come with the backing of the Apache Software Foundation. (Whether it will be in the future is for discussion with the PMC.)
>
> This is a preview release - it is subject to change and while "it works for me", it is likely to have rough edges.
>
>
> TDB2 from Java:
> https://github.com/afs/mantis/blob/master/use-tdb2.md
>
> TDB2 in Fuseki:
> https://github.com/afs/mantis/blob/master/use-fuseki-tdb2.md
>
>
> Codebase:
> https://github.com/afs/mantis
>
> Note that the artifacts come from the Sonatype snapshot repo so you need to configure maven/gradle/... appropriately.
>
>
> Example:
>
> Loading 100m of BSBM data into a live Fuseki (a single write transaction while the server was able to answer queries at the same time) with a default heap size:
>
> SSD: 70K triples/s (about 24 minutes)
> Disk: 47.5K TPS (about 35 minutes)
>
> (That said, my SSD is in a desktop machine it's not particularly fast. Modern servers have a much architecture.)
>
>
> This would not have been possible without:
>
> * The UK Government - InnovateUK (the Technology Strategy Board as was)
> most of the work is a spin off from a grant-funded project
>
> * Epimorphics for letting me work on that project
>
> * GitHub for the code repository
>
> * Sonatype for the maven repository and route to Maven Central
>
> * TravisCI for the continuous integration server.
>
> Andy
>