You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@jena.apache.org by "Bill Roberts (JIRA)" <ji...@apache.org> on 2011/08/18 12:30:28 UTC

[jira] [Created] (JENA-102) tdbloader creates stats.opt file in existing DB

tdbloader creates stats.opt file in existing DB
-----------------------------------------------

                 Key: JENA-102
                 URL: https://issues.apache.org/jira/browse/JENA-102
             Project: Jena
          Issue Type: Bug
          Components: Cmd line tools, TDB
         Environment: Linux, Macosx, TDB0.8.10
            Reporter: Bill Roberts
            Priority: Minor


running tdbloader to add new triples to an existing TDB database creates a new stats.opt file if one does not already exist (whether or not none.opt already exists in the DB directory).

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (JENA-102) tdbloader creates stats.opt file in existing DB

Posted by "Andy Seaborne (Assigned) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/JENA-102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andy Seaborne reassigned JENA-102:
----------------------------------

    Assignee: Andy Seaborne
    
> tdbloader creates stats.opt file in existing DB
> -----------------------------------------------
>
>                 Key: JENA-102
>                 URL: https://issues.apache.org/jira/browse/JENA-102
>             Project: Jena
>          Issue Type: Bug
>          Components: Cmd line tools, TDB
>         Environment: Linux, Macosx, TDB0.8.10
>            Reporter: Bill Roberts
>            Assignee: Andy Seaborne
>
> running tdbloader to add new triples to an existing TDB database creates a new stats.opt file if one does not already exist (whether or not none.opt already exists in the DB directory).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Closed] (JENA-102) tdbloader creates stats.opt file in existing DB

Posted by "Andy Seaborne (Closed) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/JENA-102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andy Seaborne closed JENA-102.
------------------------------

    
> tdbloader creates stats.opt file in existing DB
> -----------------------------------------------
>
>                 Key: JENA-102
>                 URL: https://issues.apache.org/jira/browse/JENA-102
>             Project: Jena
>          Issue Type: Bug
>          Components: Cmd line tools, TDB
>         Environment: Linux, Macosx, TDB0.8.10
>            Reporter: Bill Roberts
>            Assignee: Andy Seaborne
>             Fix For: TDB 0.9.0
>
>
> running tdbloader to add new triples to an existing TDB database creates a new stats.opt file if one does not already exist (whether or not none.opt already exists in the DB directory).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (JENA-102) tdbloader creates stats.opt file in existing DB

Posted by "Paolo Castagna (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/JENA-102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Paolo Castagna updated JENA-102:
--------------------------------

    Fix Version/s:     (was: TDB 0.9.0)
                       (was: Jena 2.6.5)
    
> tdbloader creates stats.opt file in existing DB
> -----------------------------------------------
>
>                 Key: JENA-102
>                 URL: https://issues.apache.org/jira/browse/JENA-102
>             Project: Jena
>          Issue Type: Bug
>          Components: Cmd line tools, TDB
>         Environment: Linux, Macosx, TDB0.8.10
>            Reporter: Bill Roberts
>
> running tdbloader to add new triples to an existing TDB database creates a new stats.opt file if one does not already exist (whether or not none.opt already exists in the DB directory).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Issue Comment Edited] (JENA-102) tdbloader creates stats.opt file in existing DB

Posted by "Paolo Castagna (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/JENA-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13087053#comment-13087053 ] 

Paolo Castagna edited comment on JENA-102 at 8/18/11 3:24 PM:
--------------------------------------------------------------

This is what BulkLoader.java does (in two different places):

    if ( ! dsg.getLocation().isMem() )
    {
        String filename = dsg.getLocation().getPath(Names.optStats) ;
        Stats.write(filename, stats) ;
    }

It's easy to check if Names.optFixed and/or Names.optNone file are there and skip writing the Names.optStats file.

However, what do we do when we have the Names.optStats file and we do an incremental load?

--Is there a way to read a stats.opt file and incrementally update stats?-- Apologies, I see how stats.opt should be updated incrementally now.





      was (Author: castagna):
    This is what BulkLoader.java does (in two different places):

    if ( ! dsg.getLocation().isMem() )
    {
        String filename = dsg.getLocation().getPath(Names.optStats) ;
        Stats.write(filename, stats) ;
    }

It's easy to check if Names.optFixed and/or Names.optNone file are there and skip writing the Names.optStats file.

However, what do we do when we have the Names.optStats file and we do an incremental load?

-Is there a way to read a stats.opt file and incrementally update stats?- Apologies, I see how stats.opt should be updated incrementally now.




  
> tdbloader creates stats.opt file in existing DB
> -----------------------------------------------
>
>                 Key: JENA-102
>                 URL: https://issues.apache.org/jira/browse/JENA-102
>             Project: Jena
>          Issue Type: Bug
>          Components: Cmd line tools, TDB
>         Environment: Linux, Macosx, TDB0.8.10
>            Reporter: Bill Roberts
>
> running tdbloader to add new triples to an existing TDB database creates a new stats.opt file if one does not already exist (whether or not none.opt already exists in the DB directory).

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (JENA-102) tdbloader creates stats.opt file in existing DB

Posted by "Paolo Castagna (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/JENA-102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Paolo Castagna updated JENA-102:
--------------------------------

    Priority: Major  (was: Minor)

> tdbloader creates stats.opt file in existing DB
> -----------------------------------------------
>
>                 Key: JENA-102
>                 URL: https://issues.apache.org/jira/browse/JENA-102
>             Project: Jena
>          Issue Type: Bug
>          Components: Cmd line tools, TDB
>         Environment: Linux, Macosx, TDB0.8.10
>            Reporter: Bill Roberts
>
> running tdbloader to add new triples to an existing TDB database creates a new stats.opt file if one does not already exist (whether or not none.opt already exists in the DB directory).

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Issue Comment Edited] (JENA-102) tdbloader creates stats.opt file in existing DB

Posted by "Paolo Castagna (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/JENA-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13087053#comment-13087053 ] 

Paolo Castagna edited comment on JENA-102 at 8/18/11 3:24 PM:
--------------------------------------------------------------

This is what BulkLoader.java does (in two different places):

    if ( ! dsg.getLocation().isMem() )
    {
        String filename = dsg.getLocation().getPath(Names.optStats) ;
        Stats.write(filename, stats) ;
    }

It's easy to check if Names.optFixed and/or Names.optNone file are there and skip writing the Names.optStats file.

However, what do we do when we have the Names.optStats file and we do an incremental load?

-Is there a way to read a stats.opt file and incrementally update stats?- Apologies, I see how stats.opt should be updated incrementally now.





      was (Author: castagna):
    This is what BulkLoader.java does (in two different places):

    if ( ! dsg.getLocation().isMem() )
    {
        String filename = dsg.getLocation().getPath(Names.optStats) ;
        Stats.write(filename, stats) ;
    }

It's easy to check if Names.optFixed and/or Names.optNone file are there and skip writing the Names.optStats file.

However, what do we do when we have the Names.optStats file and we do an incremental load?

Is there a way to read a stats.opt file and incrementally update stats?




  
> tdbloader creates stats.opt file in existing DB
> -----------------------------------------------
>
>                 Key: JENA-102
>                 URL: https://issues.apache.org/jira/browse/JENA-102
>             Project: Jena
>          Issue Type: Bug
>          Components: Cmd line tools, TDB
>         Environment: Linux, Macosx, TDB0.8.10
>            Reporter: Bill Roberts
>
> running tdbloader to add new triples to an existing TDB database creates a new stats.opt file if one does not already exist (whether or not none.opt already exists in the DB directory).

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (JENA-102) tdbloader creates stats.opt file in existing DB

Posted by "Paolo Castagna (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/JENA-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13087053#comment-13087053 ] 

Paolo Castagna commented on JENA-102:
-------------------------------------

This is what BulkLoader.java does (in two different places):

    if ( ! dsg.getLocation().isMem() )
    {
        String filename = dsg.getLocation().getPath(Names.optStats) ;
        Stats.write(filename, stats) ;
    }

It's easy to check if Names.optFixed and/or Names.optNone file are there and skip writing the Names.optStats file.

However, what do we do when we have the Names.optStats file and we do an incremental load?

Is there a way to read a stats.opt file and incrementally update stats?





> tdbloader creates stats.opt file in existing DB
> -----------------------------------------------
>
>                 Key: JENA-102
>                 URL: https://issues.apache.org/jira/browse/JENA-102
>             Project: Jena
>          Issue Type: Bug
>          Components: Cmd line tools, TDB
>         Environment: Linux, Macosx, TDB0.8.10
>            Reporter: Bill Roberts
>            Priority: Minor
>
> running tdbloader to add new triples to an existing TDB database creates a new stats.opt file if one does not already exist (whether or not none.opt already exists in the DB directory).

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (JENA-102) tdbloader creates stats.opt file in existing DB

Posted by "Paolo Castagna (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/JENA-102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Paolo Castagna updated JENA-102:
--------------------------------

    Fix Version/s: 2.6.5
    
> tdbloader creates stats.opt file in existing DB
> -----------------------------------------------
>
>                 Key: JENA-102
>                 URL: https://issues.apache.org/jira/browse/JENA-102
>             Project: Jena
>          Issue Type: Bug
>          Components: Cmd line tools, TDB
>         Environment: Linux, Macosx, TDB0.8.10
>            Reporter: Bill Roberts
>             Fix For: 2.6.5
>
>
> running tdbloader to add new triples to an existing TDB database creates a new stats.opt file if one does not already exist (whether or not none.opt already exists in the DB directory).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (JENA-102) tdbloader creates stats.opt file in existing DB

Posted by "Andy Seaborne (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/JENA-102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andy Seaborne resolved JENA-102.
--------------------------------

       Resolution: Fixed
    Fix Version/s: TDB 0.9.0

A new stats file was always being created on loading data into store with existing triples or quads.

The stats file is now only created automatically on loading empty datasets.
                
> tdbloader creates stats.opt file in existing DB
> -----------------------------------------------
>
>                 Key: JENA-102
>                 URL: https://issues.apache.org/jira/browse/JENA-102
>             Project: Jena
>          Issue Type: Bug
>          Components: Cmd line tools, TDB
>         Environment: Linux, Macosx, TDB0.8.10
>            Reporter: Bill Roberts
>            Assignee: Andy Seaborne
>             Fix For: TDB 0.9.0
>
>
> running tdbloader to add new triples to an existing TDB database creates a new stats.opt file if one does not already exist (whether or not none.opt already exists in the DB directory).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (JENA-102) tdbloader creates stats.opt file in existing DB

Posted by "Paolo Castagna (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/JENA-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13099579#comment-13099579 ] 

Paolo Castagna commented on JENA-102:
-------------------------------------

A related (although not exactly the same problem) message from jena-users mailing list: 
http://markmail.org/message/c2pj4p2j3z3hwgvy

> tdbloader creates stats.opt file in existing DB
> -----------------------------------------------
>
>                 Key: JENA-102
>                 URL: https://issues.apache.org/jira/browse/JENA-102
>             Project: Jena
>          Issue Type: Bug
>          Components: Cmd line tools, TDB
>         Environment: Linux, Macosx, TDB0.8.10
>            Reporter: Bill Roberts
>
> running tdbloader to add new triples to an existing TDB database creates a new stats.opt file if one does not already exist (whether or not none.opt already exists in the DB directory).

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (JENA-102) tdbloader creates stats.opt file in existing DB

Posted by "Paolo Castagna (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/JENA-102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Paolo Castagna updated JENA-102:
--------------------------------

    Fix Version/s: TDB 0.9.0
    
> tdbloader creates stats.opt file in existing DB
> -----------------------------------------------
>
>                 Key: JENA-102
>                 URL: https://issues.apache.org/jira/browse/JENA-102
>             Project: Jena
>          Issue Type: Bug
>          Components: Cmd line tools, TDB
>         Environment: Linux, Macosx, TDB0.8.10
>            Reporter: Bill Roberts
>             Fix For: Jena 2.6.5, TDB 0.9.0
>
>
> running tdbloader to add new triples to an existing TDB database creates a new stats.opt file if one does not already exist (whether or not none.opt already exists in the DB directory).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira