You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@storm.apache.org by "Robert Joseph Evans (JIRA)" <ji...@apache.org> on 2015/06/24 18:32:05 UTC

[jira] [Created] (STORM-907) More Intellegent Backpressure

Robert Joseph Evans created STORM-907:
-----------------------------------------

             Summary: More Intellegent Backpressure
                 Key: STORM-907
                 URL: https://issues.apache.org/jira/browse/STORM-907
             Project: Apache Storm
          Issue Type: Improvement
            Reporter: Robert Joseph Evans


As a follow on to STORM-886 we should look at ways to automatically adjust the back-pressure to meet SLAs.

Using an SLA latency goal for a topology from something like STORM-815 or STORM-594 we should be able to come up with a time budget for each stage in a DAG.  We will have to play games if there are loops in a topology, but it should be doable.  We could then adjust the budget based off of actual latency numbers measured while running.  Then throttle the upstream bolts/spouts so that the predicted time spent in the downstream queue will be under the budget for that stage.

I see this as a complement to the bang-bang controller from STORM-886 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)