You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "James Dyer (JIRA)" <ji...@apache.org> on 2011/06/21 23:35:47 UTC
[jira] [Created] (SOLR-2613) DIH Cache backed w/bdb-je
DIH Cache backed w/bdb-je
-------------------------
Key: SOLR-2613
URL: https://issues.apache.org/jira/browse/SOLR-2613
Project: Solr
Issue Type: Improvement
Components: contrib - DataImportHandler
Affects Versions: 4.0
Reporter: James Dyer
Priority: Minor
Attachments: SOLR-2613.patch
This is spun out of SOLR-2382, which provides a framework for multiple cacheing implementations with DIH. This cache implementation is fast & flexible, supporting persistence and delta updates. However, it depends on Berkley Database Java Edition so in order to evaluate this and use it you must download bdb-je from Oracle and accept the license requirements.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (SOLR-2613) DIH Cache backed w/bdb-je
Posted by "James Dyer (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
James Dyer updated SOLR-2613:
-----------------------------
Attachment: SOLR-2613.patch
Synced with Trunk. This version is compatible with the initial patch from SOLR-2943.
> DIH Cache backed w/bdb-je
> -------------------------
>
> Key: SOLR-2613
> URL: https://issues.apache.org/jira/browse/SOLR-2613
> Project: Solr
> Issue Type: Improvement
> Components: contrib - DataImportHandler
> Affects Versions: 4.0
> Reporter: James Dyer
> Priority: Minor
> Attachments: SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch
>
>
> This is spun out of SOLR-2382, which provides a framework for multiple cacheing implementations with DIH. This cache implementation is fast & flexible, supporting persistence and delta updates. However, it depends on Berkley Database Java Edition so in order to evaluate this and use it you must download bdb-je from Oracle and accept the license requirements.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (SOLR-2613) DIH Cache backed w/bdb-je
Posted by "James Dyer (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
James Dyer updated SOLR-2613:
-----------------------------
Attachment: SOLR-2613.patch
updated to fix a parameter-naming bug.
> DIH Cache backed w/bdb-je
> -------------------------
>
> Key: SOLR-2613
> URL: https://issues.apache.org/jira/browse/SOLR-2613
> Project: Solr
> Issue Type: Improvement
> Components: contrib - DataImportHandler
> Affects Versions: 4.0
> Reporter: James Dyer
> Priority: Minor
> Attachments: SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch
>
>
> This is spun out of SOLR-2382, which provides a framework for multiple cacheing implementations with DIH. This cache implementation is fast & flexible, supporting persistence and delta updates. However, it depends on Berkley Database Java Edition so in order to evaluate this and use it you must download bdb-je from Oracle and accept the license requirements.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (SOLR-2613) DIH Cache backed w/bdb-je
Posted by "James Dyer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
James Dyer updated SOLR-2613:
-----------------------------
Attachment: SOLR-2613.patch
This is an update to stay in-sync with recent changes in Trunk.
> DIH Cache backed w/bdb-je
> -------------------------
>
> Key: SOLR-2613
> URL: https://issues.apache.org/jira/browse/SOLR-2613
> Project: Solr
> Issue Type: Improvement
> Components: contrib - DataImportHandler
> Affects Versions: 4.0
> Reporter: James Dyer
> Priority: Minor
> Attachments: SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch
>
>
> This is spun out of SOLR-2382, which provides a framework for multiple cacheing implementations with DIH. This cache implementation is fast & flexible, supporting persistence and delta updates. However, it depends on Berkley Database Java Edition so in order to evaluate this and use it you must download bdb-je from Oracle and accept the license requirements.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (SOLR-2613) DIH Cache backed w/bdb-je
Posted by "James Dyer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13080041#comment-13080041 ]
James Dyer commented on SOLR-2613:
----------------------------------
{quote}
Try a non-Oracle implementation.
{quote}
I understand the difficulties with bdb-je. When I selected this, I though it would be ok to use because the Lucene db-contrib used it. But since then "db" has gone away, partly because of this dependency, partly because there were no unit tests.
{quote}
An ant target
{quote}
At least 1 commiter here was outraged that the Lucene build would automatically download a non-compatible-license file when doing a building the old db-contrib module, so I shy away from that option. I thought about creating a mock-bdb jar that would just throw a special exception when you try to use it (then the unit tests can just print out a warning and users who want to really test/use the functionality could get bdb from Oracle). I thought about apache-extras, but it would be easy for this to become out-of-sync with the rest of the project. I also have a lucene-backed-cache that I wrote to help set up testing scenario. I could contribute that and it would probably perform for many uses. Others with more Lucene experience might improve it and maybe it could perform as good as the bdb-je one? There's a lot of options but its all moot for the moment because the prerequsites in SOLR-2382 are not yet committed.
{quote}
A way to pre-load the backing database
{quote}
You can pre-load the caches with DIHCacheWriter. You then use DIHCacheProcessor to read the data back in later. See TestDIHCacheWriterAndProcessor in SOLR-2382. Is this what you mean?
> DIH Cache backed w/bdb-je
> -------------------------
>
> Key: SOLR-2613
> URL: https://issues.apache.org/jira/browse/SOLR-2613
> Project: Solr
> Issue Type: Improvement
> Components: contrib - DataImportHandler
> Affects Versions: 4.0
> Reporter: James Dyer
> Priority: Minor
> Attachments: SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch
>
>
> This is spun out of SOLR-2382, which provides a framework for multiple cacheing implementations with DIH. This cache implementation is fast & flexible, supporting persistence and delta updates. However, it depends on Berkley Database Java Edition so in order to evaluate this and use it you must download bdb-je from Oracle and accept the license requirements.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (SOLR-2613) DIH Cache backed w/bdb-je
Posted by "James Dyer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
James Dyer updated SOLR-2613:
-----------------------------
Attachment: SOLR-2613.patch
Sync'ed with current trunk and state of SOLR-2382.
> DIH Cache backed w/bdb-je
> -------------------------
>
> Key: SOLR-2613
> URL: https://issues.apache.org/jira/browse/SOLR-2613
> Project: Solr
> Issue Type: Improvement
> Components: contrib - DataImportHandler
> Affects Versions: 4.0
> Reporter: James Dyer
> Priority: Minor
> Attachments: SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch
>
>
> This is spun out of SOLR-2382, which provides a framework for multiple cacheing implementations with DIH. This cache implementation is fast & flexible, supporting persistence and delta updates. However, it depends on Berkley Database Java Edition so in order to evaluate this and use it you must download bdb-je from Oracle and accept the license requirements.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (SOLR-2613) DIH Cache backed w/bdb-je
Posted by "James Dyer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
James Dyer updated SOLR-2613:
-----------------------------
Attachment: SOLR-2613.patch
> DIH Cache backed w/bdb-je
> -------------------------
>
> Key: SOLR-2613
> URL: https://issues.apache.org/jira/browse/SOLR-2613
> Project: Solr
> Issue Type: Improvement
> Components: contrib - DataImportHandler
> Affects Versions: 4.0
> Reporter: James Dyer
> Priority: Minor
> Attachments: SOLR-2613.patch
>
>
> This is spun out of SOLR-2382, which provides a framework for multiple cacheing implementations with DIH. This cache implementation is fast & flexible, supporting persistence and delta updates. However, it depends on Berkley Database Java Edition so in order to evaluate this and use it you must download bdb-je from Oracle and accept the license requirements.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (SOLR-2613) DIH Cache backed w/bdb-je
Posted by "James Dyer (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
James Dyer updated SOLR-2613:
-----------------------------
Attachment: SOLR-2613.patch
Sync'ed with the latest from SOLR-2382.
> DIH Cache backed w/bdb-je
> -------------------------
>
> Key: SOLR-2613
> URL: https://issues.apache.org/jira/browse/SOLR-2613
> Project: Solr
> Issue Type: Improvement
> Components: contrib - DataImportHandler
> Affects Versions: 4.0
> Reporter: James Dyer
> Priority: Minor
> Attachments: SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch
>
>
> This is spun out of SOLR-2382, which provides a framework for multiple cacheing implementations with DIH. This cache implementation is fast & flexible, supporting persistence and delta updates. However, it depends on Berkley Database Java Edition so in order to evaluate this and use it you must download bdb-je from Oracle and accept the license requirements.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (SOLR-2613) DIH Cache backed w/bdb-je
Posted by "Lance Norskog (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13079763#comment-13079763 ]
Lance Norskog commented on SOLR-2613:
-------------------------------------
Suggestions:
* Try a non-Oracle implementation. JDBM [http://sourceforge.net/projects/jdbm/develop] is under the Berkeley license.
* An ant target that downloads the DB implementation.
** The Oracle download requires interaction.
** Thus, a different, completely free implementation would be nice.
* A way to pre-load the backing database. This would make caching scale by orders of magnitude.
> DIH Cache backed w/bdb-je
> -------------------------
>
> Key: SOLR-2613
> URL: https://issues.apache.org/jira/browse/SOLR-2613
> Project: Solr
> Issue Type: Improvement
> Components: contrib - DataImportHandler
> Affects Versions: 4.0
> Reporter: James Dyer
> Priority: Minor
> Attachments: SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch
>
>
> This is spun out of SOLR-2382, which provides a framework for multiple cacheing implementations with DIH. This cache implementation is fast & flexible, supporting persistence and delta updates. However, it depends on Berkley Database Java Edition so in order to evaluate this and use it you must download bdb-je from Oracle and accept the license requirements.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (SOLR-2613) DIH Cache backed w/bdb-je
Posted by "James Dyer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
James Dyer updated SOLR-2613:
-----------------------------
Attachment: SOLR-2613.patch
This version keeps BerkleyBackedCache in sync with the last version from SOLR-2382. This version takes parameters from a Context object rather from a Map.
> DIH Cache backed w/bdb-je
> -------------------------
>
> Key: SOLR-2613
> URL: https://issues.apache.org/jira/browse/SOLR-2613
> Project: Solr
> Issue Type: Improvement
> Components: contrib - DataImportHandler
> Affects Versions: 4.0
> Reporter: James Dyer
> Priority: Minor
> Attachments: SOLR-2613.patch, SOLR-2613.patch
>
>
> This is spun out of SOLR-2382, which provides a framework for multiple cacheing implementations with DIH. This cache implementation is fast & flexible, supporting persistence and delta updates. However, it depends on Berkley Database Java Edition so in order to evaluate this and use it you must download bdb-je from Oracle and accept the license requirements.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org