You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Michael McCandless (JIRA)" <ji...@apache.org> on 2011/06/13 21:30:51 UTC
[jira] [Created] (LUCENE-3198) Change default Directory impl on
64bit linux to MMap
Change default Directory impl on 64bit linux to MMap
----------------------------------------------------
Key: LUCENE-3198
URL: https://issues.apache.org/jira/browse/LUCENE-3198
Project: Lucene - Java
Issue Type: Improvement
Reporter: Michael McCandless
Consistently in my NRT testing on Fedora 13 Linux, 64 bit JVM (Oracle 1.6.0_21) I see MMapDir getting better search and merge performance when compared to NIOFSDir.
I think we should fix the default.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3198) Change default Directory impl on
64bit linux to MMap
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13048821#comment-13048821 ]
Uwe Schindler commented on LUCENE-3198:
---------------------------------------
Thats fine, I just wanted to talk about the whole issue what to enable when and bring together all possible platform possibilities. In general we should per default only enable SimpleFSDirectory on unknown platforms. Maybe NIO is heavily broken on OS XY (Android *lol*)?
> Change default Directory impl on 64bit linux to MMap
> ----------------------------------------------------
>
> Key: LUCENE-3198
> URL: https://issues.apache.org/jira/browse/LUCENE-3198
> Project: Lucene - Java
> Issue Type: Improvement
> Components: core/store
> Reporter: Michael McCandless
> Fix For: 3.3, 4.0
>
>
> Consistently in my NRT testing on Fedora 13 Linux, 64 bit JVM (Oracle 1.6.0_21) I see MMapDir getting better search and merge performance when compared to NIOFSDir.
> I think we should fix the default.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3198) Change default Directory impl on
64bit linux to MMap
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13048812#comment-13048812 ]
Uwe Schindler commented on LUCENE-3198:
---------------------------------------
That means we can now enable MMap for all 64 bit platforms? Solaris, windows, Linux - any others except FreeBSD? FreeBSD needs to be checked, but I assume its also faster there. We can check on lucene.zones maybe.
> Change default Directory impl on 64bit linux to MMap
> ----------------------------------------------------
>
> Key: LUCENE-3198
> URL: https://issues.apache.org/jira/browse/LUCENE-3198
> Project: Lucene - Java
> Issue Type: Improvement
> Components: core/store
> Reporter: Michael McCandless
> Fix For: 3.3, 4.0
>
>
> Consistently in my NRT testing on Fedora 13 Linux, 64 bit JVM (Oracle 1.6.0_21) I see MMapDir getting better search and merge performance when compared to NIOFSDir.
> I think we should fix the default.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Resolved] (LUCENE-3198) Change default Directory impl on
64bit linux to MMap
Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Michael McCandless resolved LUCENE-3198.
----------------------------------------
Resolution: Fixed
OK I cutover just Linux, 64 bit, when unmap is available.
We can open new issues for other platforms when we have some data that MMap is better...
> Change default Directory impl on 64bit linux to MMap
> ----------------------------------------------------
>
> Key: LUCENE-3198
> URL: https://issues.apache.org/jira/browse/LUCENE-3198
> Project: Lucene - Java
> Issue Type: Improvement
> Components: core/store
> Reporter: Michael McCandless
> Fix For: 3.3, 4.0
>
>
> Consistently in my NRT testing on Fedora 13 Linux, 64 bit JVM (Oracle 1.6.0_21) I see MMapDir getting better search and merge performance when compared to NIOFSDir.
> I think we should fix the default.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3198) Change default Directory impl on
64bit linux to MMap
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13048818#comment-13048818 ]
Robert Muir commented on LUCENE-3198:
-------------------------------------
why jump the gun, we can just enable it for linux/64-bit.
if others like freebsd or macos X are tested, then we add those to the list, but mmap is a little bit scary to just apply as a blanket default?
in all cases it should be like the current logic: if (XYZ_OS && 64_bit && *UNMAP_SUPPORTED*)
> Change default Directory impl on 64bit linux to MMap
> ----------------------------------------------------
>
> Key: LUCENE-3198
> URL: https://issues.apache.org/jira/browse/LUCENE-3198
> Project: Lucene - Java
> Issue Type: Improvement
> Components: core/store
> Reporter: Michael McCandless
> Fix For: 3.3, 4.0
>
>
> Consistently in my NRT testing on Fedora 13 Linux, 64 bit JVM (Oracle 1.6.0_21) I see MMapDir getting better search and merge performance when compared to NIOFSDir.
> I think we should fix the default.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-3198) Change default Directory impl on
64bit linux to MMap
Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Michael McCandless updated LUCENE-3198:
---------------------------------------
Component/s: core/store
Fix Version/s: 4.0
3.3
> Change default Directory impl on 64bit linux to MMap
> ----------------------------------------------------
>
> Key: LUCENE-3198
> URL: https://issues.apache.org/jira/browse/LUCENE-3198
> Project: Lucene - Java
> Issue Type: Improvement
> Components: core/store
> Reporter: Michael McCandless
> Fix For: 3.3, 4.0
>
>
> Consistently in my NRT testing on Fedora 13 Linux, 64 bit JVM (Oracle 1.6.0_21) I see MMapDir getting better search and merge performance when compared to NIOFSDir.
> I think we should fix the default.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org