You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@jena.apache.org by "Stephen Allen (Created) (JIRA)" <ji...@apache.org> on 2011/11/07 00:37:52 UTC
[jira] [Created] (JENA-157) DataBag needs to pre-merge spill files
DataBag needs to pre-merge spill files
--------------------------------------
Key: JENA-157
URL: https://issues.apache.org/jira/browse/JENA-157
Project: Jena
Issue Type: Bug
Components: ARQ
Reporter: Stephen Allen
Priority: Minor
The DataBag implementations need to perform a pre-merge of the spill files if there are a large number (say more than 100). Otherwise too many resources are used (file handles and input buffers). See [1] for more info.
[1] http://markmail.org/message/5yiiav55ao7wqedz
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (JENA-157) DataBag needs to pre-merge spill
files
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226105#comment-13226105 ]
Hudson commented on JENA-157:
-----------------------------
Integrated in Jena_ARQ #487 (See [https://builds.apache.org/job/Jena_ARQ/487/])
JENA-157 - This adds a pre-merge phase to SortedDataBag to merge files 100 at the time max. If more than 100 files need to be merged, it is done in multiple rounds. (Revision 1298851)
Result = SUCCESS
castagna :
Files :
* /incubator/jena/Jena2/ARQ/trunk/src/main/java/org/openjena/atlas/data/SortedDataBag.java
> DataBag needs to pre-merge spill files
> --------------------------------------
>
> Key: JENA-157
> URL: https://issues.apache.org/jira/browse/JENA-157
> Project: Apache Jena
> Issue Type: Bug
> Components: ARQ
> Reporter: Stephen Allen
> Assignee: Paolo Castagna
> Priority: Minor
>
> The DataBag implementations need to perform a pre-merge of the spill files if there are a large number (say more than 100). Otherwise too many resources are used (file handles and input buffers). See [1] for more info.
> [1] http://markmail.org/message/5yiiav55ao7wqedz
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (JENA-157) DataBag needs to pre-merge spill files
Posted by "Paolo Castagna (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paolo Castagna reassigned JENA-157:
-----------------------------------
Assignee: Paolo Castagna
> DataBag needs to pre-merge spill files
> --------------------------------------
>
> Key: JENA-157
> URL: https://issues.apache.org/jira/browse/JENA-157
> Project: Apache Jena
> Issue Type: Bug
> Components: ARQ
> Reporter: Stephen Allen
> Assignee: Paolo Castagna
> Priority: Minor
>
> The DataBag implementations need to perform a pre-merge of the spill files if there are a large number (say more than 100). Otherwise too many resources are used (file handles and input buffers). See [1] for more info.
> [1] http://markmail.org/message/5yiiav55ao7wqedz
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (JENA-157) DataBag needs to pre-merge spill
files
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226960#comment-13226960 ]
Hudson commented on JENA-157:
-----------------------------
Integrated in Jena_ARQ #493 (See [https://builds.apache.org/job/Jena_ARQ/493/])
JENA-157 (DataBag needs to pre-merge spill files) - Added unit test for premerge. (Revision 1299301)
Result = SUCCESS
sallen :
Files :
* /incubator/jena/Jena2/ARQ/trunk/src/main/java/org/openjena/atlas/data/SortedDataBag.java
* /incubator/jena/Jena2/ARQ/trunk/src/test/java/org/openjena/atlas/data/TestSortedDataBag.java
> DataBag needs to pre-merge spill files
> --------------------------------------
>
> Key: JENA-157
> URL: https://issues.apache.org/jira/browse/JENA-157
> Project: Apache Jena
> Issue Type: Bug
> Components: ARQ
> Reporter: Stephen Allen
> Assignee: Paolo Castagna
> Priority: Minor
>
> The DataBag implementations need to perform a pre-merge of the spill files if there are a large number (say more than 100). Otherwise too many resources are used (file handles and input buffers). See [1] for more info.
> [1] http://markmail.org/message/5yiiav55ao7wqedz
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (JENA-157) DataBag needs to pre-merge spill files
Posted by "Stephen Allen (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stephen Allen resolved JENA-157.
--------------------------------
Resolution: Fixed
> DataBag needs to pre-merge spill files
> --------------------------------------
>
> Key: JENA-157
> URL: https://issues.apache.org/jira/browse/JENA-157
> Project: Apache Jena
> Issue Type: Bug
> Components: ARQ
> Reporter: Stephen Allen
> Assignee: Paolo Castagna
> Priority: Minor
>
> The DataBag implementations need to perform a pre-merge of the spill files if there are a large number (say more than 100). Otherwise too many resources are used (file handles and input buffers). See [1] for more info.
> [1] http://markmail.org/message/5yiiav55ao7wqedz
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira