[jira] [Created] (CONNECTORS-780) For scalability/reliability, allow multiple agents processes to run at the same time

["Karl Wright (JIRA)" <ji...@apache.org>]

Karl Wright created CONNECTORS-780:
--------------------------------------

             Summary: For scalability/reliability, allow multiple agents processes to run at the same time
                 Key: CONNECTORS-780
                 URL: https://issues.apache.org/jira/browse/CONNECTORS-780
             Project: ManifoldCF
          Issue Type: Bug
    Affects Versions: ManifoldCF 1.4
            Reporter: Karl Wright
            Assignee: Karl Wright
             Fix For: ManifoldCF next


Today the *Stuffer threads basically know they are unique; this permits them to avoid throwing huge numbers of locks on every iteration. Those cannot therefore be replicated at this time. A good deal of experimentation and/or potential schema changes will be needed to solve this issue - or, possibly, using outside locks to prevent more than one stuffing operation from proceeding at the same time. Also, throttling is meaningless if there are multiple independent ManifoldCF instances in different processes that are unaware of each other - throttling would therefore need to be handled in a way that used the services of ILockManager rather than native synchronizers in order to be scalable in the right way.

This is related to CONNECTORS-13 and CONNECTORS-286.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira