You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "John Wang (JIRA)" <ji...@apache.org> on 2009/09/24 04:09:16 UTC

[jira] Created: (LUCENE-1924) BalancedSegmentMergePolicy, contributed from the Zoie project for realtime indexing

BalancedSegmentMergePolicy, contributed from the Zoie project for realtime indexing
-----------------------------------------------------------------------------------

                 Key: LUCENE-1924
                 URL: https://issues.apache.org/jira/browse/LUCENE-1924
             Project: Lucene - Java
          Issue Type: Improvement
          Components: Index
    Affects Versions: 2.9
            Reporter: John Wang
         Attachments: BalancedSegmentMergePolicy.java

Written by Yasuhiro Matsuda for Zoie realtime indexing system used to handle high update rates to avoid large segment merges.
Detailed write-up is at:

http://code.google.com/p/zoie/wiki/ZoieMergePolicy


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Resolved: (LUCENE-1924) BalancedSegmentMergePolicy, contributed from the Zoie project for realtime indexing

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-1924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael McCandless resolved LUCENE-1924.
----------------------------------------

       Resolution: Fixed
    Fix Version/s: 3.0

Thanks Yasuhiro & John!

> BalancedSegmentMergePolicy, contributed from the Zoie project for realtime indexing
> -----------------------------------------------------------------------------------
>
>                 Key: LUCENE-1924
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1924
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 2.9
>            Reporter: John Wang
>            Assignee: Michael McCandless
>             Fix For: 3.0
>
>         Attachments: BalancedSegmentMergePolicy.java, LUCENE-1924.patch
>
>
> Written by Yasuhiro Matsuda for Zoie realtime indexing system used to handle high update rates to avoid large segment merges.
> Detailed write-up is at:
> http://code.google.com/p/zoie/wiki/ZoieMergePolicy

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Assigned: (LUCENE-1924) BalancedSegmentMergePolicy, contributed from the Zoie project for realtime indexing

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-1924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael McCandless reassigned LUCENE-1924:
------------------------------------------

    Assignee: Michael McCandless

> BalancedSegmentMergePolicy, contributed from the Zoie project for realtime indexing
> -----------------------------------------------------------------------------------
>
>                 Key: LUCENE-1924
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1924
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 2.9
>            Reporter: John Wang
>            Assignee: Michael McCandless
>         Attachments: BalancedSegmentMergePolicy.java
>
>
> Written by Yasuhiro Matsuda for Zoie realtime indexing system used to handle high update rates to avoid large segment merges.
> Detailed write-up is at:
> http://code.google.com/p/zoie/wiki/ZoieMergePolicy

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-1924) BalancedSegmentMergePolicy, contributed from the Zoie project for realtime indexing

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-1924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12759129#action_12759129 ] 

Michael McCandless commented on LUCENE-1924:
--------------------------------------------

We've opened up SegmentInfo/s in 2.9.

> BalancedSegmentMergePolicy, contributed from the Zoie project for realtime indexing
> -----------------------------------------------------------------------------------
>
>                 Key: LUCENE-1924
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1924
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 2.9
>            Reporter: John Wang
>            Assignee: Michael McCandless
>         Attachments: BalancedSegmentMergePolicy.java
>
>
> Written by Yasuhiro Matsuda for Zoie realtime indexing system used to handle high update rates to avoid large segment merges.
> Detailed write-up is at:
> http://code.google.com/p/zoie/wiki/ZoieMergePolicy

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-1924) BalancedSegmentMergePolicy, contributed from the Zoie project for realtime indexing

Posted by "John Wang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-1924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12759108#action_12759108 ] 

John Wang commented on LUCENE-1924:
-----------------------------------

I had put them in the core package under org.apache.lucene.index.

Because it requires access package protected classes, e.g. SegmentInfo, it needs to be in that package.

In terms of which module, totally up to you as you would know what the best place to put it.

A question on the side, MergePolicy is something the API suggests that is customizable, yet SegmentInfo, part of the signature is package protected. Is this something should be opened up to allow for full customization of MergePolicy amonst other things?

Thanks

-John

> BalancedSegmentMergePolicy, contributed from the Zoie project for realtime indexing
> -----------------------------------------------------------------------------------
>
>                 Key: LUCENE-1924
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1924
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 2.9
>            Reporter: John Wang
>            Assignee: Michael McCandless
>         Attachments: BalancedSegmentMergePolicy.java
>
>
> Written by Yasuhiro Matsuda for Zoie realtime indexing system used to handle high update rates to avoid large segment merges.
> Detailed write-up is at:
> http://code.google.com/p/zoie/wiki/ZoieMergePolicy

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Updated: (LUCENE-1924) BalancedSegmentMergePolicy, contributed from the Zoie project for realtime indexing

Posted by "John Wang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-1924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John Wang updated LUCENE-1924:
------------------------------

    Attachment: BalancedSegmentMergePolicy.java

this is a stand-alone class

> BalancedSegmentMergePolicy, contributed from the Zoie project for realtime indexing
> -----------------------------------------------------------------------------------
>
>                 Key: LUCENE-1924
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1924
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 2.9
>            Reporter: John Wang
>         Attachments: BalancedSegmentMergePolicy.java
>
>
> Written by Yasuhiro Matsuda for Zoie realtime indexing system used to handle high update rates to avoid large segment merges.
> Detailed write-up is at:
> http://code.google.com/p/zoie/wiki/ZoieMergePolicy

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-1924) BalancedSegmentMergePolicy, contributed from the Zoie project for realtime indexing

Posted by "John Wang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-1924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12759132#action_12759132 ] 

John Wang commented on LUCENE-1924:
-----------------------------------

Awesome, didn't realize!

Thanks

-John

> BalancedSegmentMergePolicy, contributed from the Zoie project for realtime indexing
> -----------------------------------------------------------------------------------
>
>                 Key: LUCENE-1924
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1924
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 2.9
>            Reporter: John Wang
>            Assignee: Michael McCandless
>         Attachments: BalancedSegmentMergePolicy.java
>
>
> Written by Yasuhiro Matsuda for Zoie realtime indexing system used to handle high update rates to avoid large segment merges.
> Detailed write-up is at:
> http://code.google.com/p/zoie/wiki/ZoieMergePolicy

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Updated: (LUCENE-1924) BalancedSegmentMergePolicy, contributed from the Zoie project for realtime indexing

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-1924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael McCandless updated LUCENE-1924:
---------------------------------------

    Attachment: LUCENE-1924.patch

Trivial formatting changes, basic javadoc, and moved to contrib/misc.

> BalancedSegmentMergePolicy, contributed from the Zoie project for realtime indexing
> -----------------------------------------------------------------------------------
>
>                 Key: LUCENE-1924
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1924
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 2.9
>            Reporter: John Wang
>            Assignee: Michael McCandless
>         Attachments: BalancedSegmentMergePolicy.java, LUCENE-1924.patch
>
>
> Written by Yasuhiro Matsuda for Zoie realtime indexing system used to handle high update rates to avoid large segment merges.
> Detailed write-up is at:
> http://code.google.com/p/zoie/wiki/ZoieMergePolicy

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-1924) BalancedSegmentMergePolicy, contributed from the Zoie project for realtime indexing

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-1924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12759077#action_12759077 ] 

Michael McCandless commented on LUCENE-1924:
--------------------------------------------

This looks great John, thanks.  Where would you put it?  contrib/misc maybe?

> BalancedSegmentMergePolicy, contributed from the Zoie project for realtime indexing
> -----------------------------------------------------------------------------------
>
>                 Key: LUCENE-1924
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1924
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 2.9
>            Reporter: John Wang
>         Attachments: BalancedSegmentMergePolicy.java
>
>
> Written by Yasuhiro Matsuda for Zoie realtime indexing system used to handle high update rates to avoid large segment merges.
> Detailed write-up is at:
> http://code.google.com/p/zoie/wiki/ZoieMergePolicy

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org