You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@manifoldcf.apache.org by "Karl Wright (JIRA)" <ji...@apache.org> on 2013/11/13 09:12:17 UTC

[jira] [Resolved] (CONNECTORS-780) For scalability/reliability, allow multiple agents processes to run at the same time

     [ https://issues.apache.org/jira/browse/CONNECTORS-780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Karl Wright resolved CONNECTORS-780.
------------------------------------

       Resolution: Duplicate
    Fix Version/s:     (was: ManifoldCF next)
                   ManifoldCF 1.5

> For scalability/reliability, allow multiple agents processes to run at the same time
> ------------------------------------------------------------------------------------
>
>                 Key: CONNECTORS-780
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-780
>             Project: ManifoldCF
>          Issue Type: Bug
>    Affects Versions: ManifoldCF 1.4
>            Reporter: Karl Wright
>            Assignee: Karl Wright
>             Fix For: ManifoldCF 1.5
>
>
> Today the *Stuffer threads basically know they are unique; this permits them to avoid throwing huge numbers of locks on every iteration. Those cannot therefore be replicated at this time. A good deal of experimentation and/or potential schema changes will be needed to solve this issue - or, possibly, using outside locks to prevent more than one stuffing operation from proceeding at the same time. Also, throttling is meaningless if there are multiple independent ManifoldCF instances in different processes that are unaware of each other - throttling would therefore need to be handled in a way that used the services of ILockManager rather than native synchronizers in order to be scalable in the right way.
> This is related to CONNECTORS-13 and CONNECTORS-286.



--
This message was sent by Atlassian JIRA
(v6.1#6144)