You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Karthick Sankarachary (JIRA)" <ji...@apache.org> on 2010/05/02 21:53:55 UTC

[jira] Created: (LUCENE-2435) A Sharding Split Policy For Load-Sharing Index Writes

A Sharding Split Policy For Load-Sharing Index Writes
-----------------------------------------------------

                 Key: LUCENE-2435
                 URL: https://issues.apache.org/jira/browse/LUCENE-2435
             Project: Lucene - Java
          Issue Type: New Feature
          Components: Index
    Affects Versions: 3.0.1
            Reporter: Karthick Sankarachary
         Attachments: LUCENE-2435.patch

(Please note that the feature described in LUCENE-2425 is required reading for this issue.) 

The sharding split policy builds on the remoting split policy, treating each sub-index as a shard of the split index. Optionally, the super-index on which the split writer is built may also be considered to be a shard. The motivation for this policy is to allow a given index to be partitioned across multiple nodes (that define a cluster), which helps to (a) load-balance document writes across the nodes in that cluster and (b) serve search requests from a (narrower) set of sub-indices (that the split rule routes the query to).

Unlike other sharding solutions for Lucene, this approach gives users the ability to (a) pick and choose the types of directories underlying the mirror, and (b) add/remove shards on the fly.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] Updated: (LUCENE-2435) A Sharding Split Policy For Load-Sharing Index Writes

Posted by "Karthick Sankarachary (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Karthick Sankarachary updated LUCENE-2435:
------------------------------------------

    Attachment: LUCENE-2435.patch

> A Sharding Split Policy For Load-Sharing Index Writes
> -----------------------------------------------------
>
>                 Key: LUCENE-2435
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2435
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Index
>    Affects Versions: 3.0.1
>            Reporter: Karthick Sankarachary
>         Attachments: LUCENE-2435.patch
>
>
> (Please note that the feature described in LUCENE-2425 is required reading for this issue.) 
> The sharding split policy builds on the remoting split policy, treating each sub-index as a shard of the split index. Optionally, the super-index on which the split writer is built may also be considered to be a shard. The motivation for this policy is to allow a given index to be partitioned across multiple nodes (that define a cluster), which helps to (a) load-balance document writes across the nodes in that cluster and (b) serve search requests from a (narrower) set of sub-indices (that the split rule routes the query to).
> Unlike other sharding solutions for Lucene, this approach gives users the ability to (a) pick and choose the types of directories underlying the mirror, and (b) add/remove shards on the fly.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org