[jira] [Updated] (USERGRID-324) Distributed parallel processing system

["Todd Nine (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/USERGRID-324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Todd Nine updated USERGRID-324:
-------------------------------
    Description: 
We need a system to allow us to build distributed/parallel data process flows.  Some examples are the following.

# Migrations
# Import/Export
# Distributed Indexing on heavily connected entities
# Post processing deletes
# Collection deletes
# Application deletes


I have the following requirements.

# You can define a deployment topology and limit the number of sub processes in the workflow
# Ability to reject requests when there is no capacity
# Preferably, do not introduce another dependency (like Zookeeper) and deploy it in the stack war file
# An easy intuitive interface for programming flows which will work in a single node, or clustered environment

Some examples
Reindex 



> Distributed parallel processing system
> --------------------------------------
>
>                 Key: USERGRID-324
>                 URL: https://issues.apache.org/jira/browse/USERGRID-324
>             Project: Usergrid
>          Issue Type: Story
>            Reporter: Todd Nine
>            Assignee: Todd Nine
>
> We need a system to allow us to build distributed/parallel data process flows.  Some examples are the following.
> # Migrations
> # Import/Export
> # Distributed Indexing on heavily connected entities
> # Post processing deletes
> # Collection deletes
> # Application deletes
> I have the following requirements.
> # You can define a deployment topology and limit the number of sub processes in the workflow
> # Ability to reject requests when there is no capacity
> # Preferably, do not introduce another dependency (like Zookeeper) and deploy it in the stack war file
> # An easy intuitive interface for programming flows which will work in a single node, or clustered environment
> Some examples
> Reindex 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)